'Ispublished' in SpecimenResultsSummary fails

[DerekSikes]

Issue Documentation is http://handbook.arctosdb.org/how_to/How-to-Use-Issues-in-Arctos.html

Describe the bug
A clear and concise description of what the bug is.

When
Ispublished
is selected in a specimen summary it provides a 1 if any of the found specimens of that taxon are cited, and a 0 if none of them are, per taxon.

I did such a search and all? (or some? or most??) of the results for this were wrong. There were many taxa listed with 0 that had citations so they should have had a 1 instead of a 0.

To Reproduce
Steps to reproduce the behavior:

Search UAM:Ento + UAMObs:Ento for a specimen results summary with
Order
Family
Scientific Name
IsPublished

selected

limit the search to Species = notnull, state = Alaska

get 12301 records
3636 of these have a 0 for IsPublished thus indicating that none of the specimens of these 3636 taxa should have any citations.

However, lots of them do, eg:

Calliphora alaskensis
Araneus trifolium

Expected behavior
A clear and concise description of what you expected to happen.
0 for those without any citations
1 for those with at least 1 cited specimen

Data
If this involves external data, attach the actual data that caused the problem. Do not attach a transformation or subset. You may ZIP most formats to attach, or request a Box email address for very large files.

data attached

Priority
Please assign a priority-label. Unprioritized issues get sent into a black hole of despair.
High, need this feature for a publication I'm working on.

ArctosSpecimenSummary928373.csv.zip

[dustymc]

The summary is by unique combinations of whatever values you specify. The data you attached contains...

... records which are and are not published. You can delete whatever you don't need, or include Basis of Citation in your search.

[DerekSikes]

This is not the intended summary of this value. I try to use it to see if a taxon/sciname has any published records. As it is working now this is failing to do this. The desired result would be not: Araneus yukon 0 Araneus yukon 1 but Araneus yukon 1 since there is at least 1 record that has a citation. Can this be fixed?

…

-Derek

On Fri, May 20, 2022 at 2:11 PM dustymc ***@***.***> wrote: Closed #4644 <#4644> as completed. — Reply to this email directly, view it on GitHub <#4644 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACFNUM3UIF4MCWY25CSPJYLVLAEZRANCNFSM5VDUN7ZQ> . You are receiving this because you authored the thread.Message ID: ***@***.***>

-- +++++++++++++++++++++++++++++++++++ *Derek S. Sikes*, Curator of Insects, Professor of Entomology University of Alaska Museum (UAM), University of Alaska Fairbanks 1962 Yukon Drive, Fairbanks, AK 99775-6960 ***@***.*** phone: 907-474-6278 he/him/his University of Alaska Museum <https://www.uaf.edu/museum/collections/ento/> - search 357,704 digitized arthropod records <http://arctos.database.museum/uam_ento> +++++++++++++++++++++++++++++++++++ Interested in Alaskan Entomology? Join the Alaska Entomological Society and / or sign up for the email listserv "Alaska Entomological Network" at http://www.akentsoc.org/contact_us

[dustymc]

I don't know any way that form could work in that manner - it's just a grouping, those terms are different, they end up in different groups.

You can search by typestatus=any to get only published records, or we can set up a report if you'll let me know what you need.

[DerekSikes]

I can figure out a way around this from 2 separate downloads: 1) all taxa in the project 2) all taxa known from Alaska with 'ispublished' 3) import both sets into Filemaker & delete all from set 2 that are not published so only published taxa remain 4) make a relationship on the sciname between sets 1&2 & determine matches. (Match = is published). 5) those that are not published are potentially new records for Alaska from the project.

…

-Derek

On Fri, May 20, 2022 at 3:06 PM dustymc ***@***.***> wrote: Reopened #4644 <#4644>. — Reply to this email directly, view it on GitHub <#4644 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACFNUM3YY36JUVSTO7IZET3VLALHBANCNFSM5VDUN7ZQ> . You are receiving this because you authored the thread.Message ID: ***@***.***>

-- +++++++++++++++++++++++++++++++++++ *Derek S. Sikes*, Curator of Insects, Professor of Entomology University of Alaska Museum (UAM), University of Alaska Fairbanks 1962 Yukon Drive, Fairbanks, AK 99775-6960 ***@***.*** phone: 907-474-6278 he/him/his University of Alaska Museum <https://www.uaf.edu/museum/collections/ento/> - search 357,704 digitized arthropod records <http://arctos.database.museum/uam_ento> +++++++++++++++++++++++++++++++++++ Interested in Alaskan Entomology? Join the Alaska Entomological Society and / or sign up for the email listserv "Alaska Entomological Network" at http://www.akentsoc.org/contact_us

[DerekSikes]

Well, I could do the plan below if Arctos would allow me to download csv for #2. I've got the summary results but it's been spinning its wheels for the last 30 minutes trying to prepare the csv download for 464922 catalog records grouped into 17,802 records. ??? Derek

…

On Mon, May 23, 2022 at 9:45 AM Derek Sikes ***@***.***> wrote: I can figure out a way around this from 2 separate downloads: 1) all taxa in the project 2) all taxa known from Alaska with 'ispublished' 3) import both sets into Filemaker & delete all from set 2 that are not published so only published taxa remain 4) make a relationship on the sciname between sets 1&2 & determine matches. (Match = is published). 5) those that are not published are potentially new records for Alaska from the project. -Derek On Fri, May 20, 2022 at 3:06 PM dustymc ***@***.***> wrote: > Reopened #4644 <#4644>. > > — > Reply to this email directly, view it on GitHub > <#4644 (comment)>, or > unsubscribe > <https://github.com/notifications/unsubscribe-auth/ACFNUM3YY36JUVSTO7IZET3VLALHBANCNFSM5VDUN7ZQ> > . > You are receiving this because you authored the thread.Message ID: > ***@***.***> > -- +++++++++++++++++++++++++++++++++++ *Derek S. Sikes*, Curator of Insects, Professor of Entomology University of Alaska Museum (UAM), University of Alaska Fairbanks 1962 Yukon Drive, Fairbanks, AK 99775-6960 ***@***.*** phone: 907-474-6278 he/him/his University of Alaska Museum <https://www.uaf.edu/museum/collections/ento/> - search 357,704 digitized arthropod records <http://arctos.database.museum/uam_ento> +++++++++++++++++++++++++++++++++++ Interested in Alaskan Entomology? Join the Alaska Entomological Society and / or sign up for the email listserv "Alaska Entomological Network" at http://www.akentsoc.org/contact_us

-- +++++++++++++++++++++++++++++++++++ *Derek S. Sikes*, Curator of Insects, Professor of Entomology University of Alaska Museum (UAM), University of Alaska Fairbanks 1962 Yukon Drive, Fairbanks, AK 99775-6960 ***@***.*** phone: 907-474-6278 he/him/his University of Alaska Museum <https://www.uaf.edu/museum/collections/ento/> - search 357,704 digitized arthropod records <http://arctos.database.museum/uam_ento> +++++++++++++++++++++++++++++++++++ Interested in Alaskan Entomology? Join the Alaska Entomological Society and / or sign up for the email listserv "Alaska Entomological Network" at http://www.akentsoc.org/contact_us

[dustymc]

17K should not be a problem, almost certainly your browser/network. I can forward (or figure out the problem) if you'll tell me how to get there.

[DerekSikes]

Dusty, I was able to download no problem but the excel file that I open the csv in has this perpetual problem - see rows 7842 to 7858. Fixing that problem, which has plagued me for years, should be very HIGH priority. There must be a workaround.

…

-Derek

On Tue, Oct 11, 2022 at 7:16 AM dustymc ***@***.***> wrote: 17K should not be a problem, almost certainly your browser/network. I can forward (or figure out the problem) if you'll tell me how to get there. — Reply to this email directly, view it on GitHub <#4644 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACFNUM4K4ONSHKZK2PWYQHDWCWAFDANCNFSM5VDUN7ZQ> . You are receiving this because you authored the thread.Message ID: ***@***.***>

-- +++++++++++++++++++++++++++++++++++ *Derek S. Sikes*, Curator of Insects, Professor of Entomology University of Alaska Museum (UAM), University of Alaska Fairbanks 1962 Yukon Drive, Fairbanks, AK 99775-6960 ***@***.*** phone: 907-474-6278 he/him/his University of Alaska Museum <https://www.uaf.edu/museum/collections/ento/> - search 357,704 digitized arthropod records <http://arctos.database.museum/uam_ento> +++++++++++++++++++++++++++++++++++ Interested in Alaskan Entomology? Join the Alaska Entomological Society and / or sign up for the email listserv "Alaska Entomological Network" at http://www.akentsoc.org/contact_us

[dustymc]

see rows 7842 to 7858

?? not sure what this means ??

[DerekSikes]

Open the attachment in excel and check those rows. If it didn't attach I'm trying again with your other email.

…

-Derek

On Tue, Oct 11, 2022 at 8:14 AM dustymc ***@***.***> wrote: see rows 7842 to 7858 ?? not sure what this means ?? — Reply to this email directly, view it on GitHub <#4644 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACFNUMZVNHTAH2QHPBJXQZLWCWG73ANCNFSM5VDUN7ZQ> . You are receiving this because you authored the thread.Message ID: ***@***.***>

-- +++++++++++++++++++++++++++++++++++ *Derek S. Sikes*, Curator of Insects, Professor of Entomology University of Alaska Museum (UAM), University of Alaska Fairbanks 1962 Yukon Drive, Fairbanks, AK 99775-6960 ***@***.*** phone: 907-474-6278 he/him/his University of Alaska Museum <https://www.uaf.edu/museum/collections/ento/> - search 357,704 digitized arthropod records <http://arctos.database.museum/uam_ento> +++++++++++++++++++++++++++++++++++ Interested in Alaskan Entomology? Join the Alaska Entomological Society and / or sign up for the email listserv "Alaska Entomological Network" at http://www.akentsoc.org/contact_us

[dustymc]

Got an Excel file in email but no idea why CSV wasn't imported correctly - some local setting is my best guess, I can't re-create this (from some other CSV source).

[DerekSikes]

Did you look at rows 7842 to 7858? The way Arctos handles specimen counts leads to failure on excels part for species that have some large number of records.

…

-Derek

On Tue, Oct 11, 2022 at 8:32 AM dustymc ***@***.***> wrote: Got an Excel file in email but no idea why CSV wasn't imported correctly - some local setting is my best guess, I can't re-create this (from some other CSV source). [image: Screen Shot 2022-10-11 at 9 30 54 AM] <https://user-images.githubusercontent.com/5720791/195148579-e5ae5ed5-9b74-4a25-b8e0-7ea4dda4194a.png> [image: Screen Shot 2022-10-11 at 9 31 08 AM] <https://user-images.githubusercontent.com/5720791/195148596-17670d24-d06c-41e1-9a37-c7b479540eea.png> — Reply to this email directly, view it on GitHub <#4644 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACFNUM4R6ENU3XF2YQNMKYDWCWJBDANCNFSM5VDUN7ZQ> . You are receiving this because you authored the thread.Message ID: ***@***.***>

-- +++++++++++++++++++++++++++++++++++ *Derek S. Sikes*, Curator of Insects, Professor of Entomology University of Alaska Museum (UAM), University of Alaska Fairbanks 1962 Yukon Drive, Fairbanks, AK 99775-6960 ***@***.*** phone: 907-474-6278 he/him/his University of Alaska Museum <https://www.uaf.edu/museum/collections/ento/> - search 357,704 digitized arthropod records <http://arctos.database.museum/uam_ento> +++++++++++++++++++++++++++++++++++ Interested in Alaskan Entomology? Join the Alaska Entomological Society and / or sign up for the email listserv "Alaska Entomological Network" at http://www.akentsoc.org/contact_us

[dustymc]

Yes, and from that I can deduce that some tool I don't use was fed data I don't have access to using some procedure of which I have no knowledge, and that didn't work. I'm happy to help however I can, but I need more information to do so. https://handbook.arctosdb.org/how_to/How-to-Use-Issues-in-Arctos.html#issue-protips might be useful?