Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

individualcount is empty / please replace in list view with quantity #4382

Closed
DerekSikes opened this issue Feb 25, 2022 · 14 comments
Closed
Labels
Bug Arctos is not performing as it should.

Comments

@DerekSikes
Copy link

Issue Documentation is http://handbook.arctosdb.org/how_to/How-to-Use-Issues-in-Arctos.html

individualcount is a field that can be displayed on the list view of catalog records. It once held a count of the # of parts but is now empty. It seems its contents have been moved to a field called 'quantity' ??? But this field is not available for display on catalog list view.

I would like this fixed so I can once again see how many parts each record has in list view.

Priority
Please assign a priority-label. Unprioritized issues get sent into a black hole of despair.
high

@DerekSikes DerekSikes added the Bug Arctos is not performing as it should. label Feb 25, 2022
@dustymc
Copy link
Contributor

dustymc commented Feb 25, 2022

Duplicate of #4032 (comment) - let me know what you want (still max(lot_count)?) and I can create the initial attributes.

@DerekSikes
Copy link
Author

DerekSikes commented Feb 25, 2022 via email

@dustymc
Copy link
Contributor

dustymc commented Feb 25, 2022

getting confused between counts of parts and counts of organisms

Yes, that's where the other issue came from. I'm not very good at guessing (probably, I can't know that either!) at what might be cataloged, if this is an important number then it needs to come from the folks who can know. That's you - but I can help with the initial load if you can provide direction. (I know exactly how many parts you claim to have, I can just count them and multiply by lot count, this brings the same kind of certainty to organisms.)

"Yes" - if you can tell me how I can tell those two situations apart.

Sum of whole organism lot counts, or 1 for records with no whole organism part??

@DerekSikes
Copy link
Author

DerekSikes commented Feb 26, 2022 via email

@campmlc
Copy link

campmlc commented Feb 26, 2022

yes= Sum of whole organism lot counts, or 1 for records with no whole
organism part
We have situation of tissues only with no whole organism part, because the voucher is elsewhere. Count should be 1 in that case,( or zero?). Also 1 for multiple events each with multiple non organism parts.

@dustymc
Copy link
Contributor

dustymc commented Feb 26, 2022

doubt we have any

Not many - here they are

temp_uamecic_nwe.csv.zip

I can get the rest out if you want to preview them, but the table's a little huge. Here are a few, hopefully that's sufficient.

arctosprod@arctos>> select * from temp_uamecic order by random() limit 100;
 collection_object_id |      guid       | attribute_value |    attribute     | attribute_units |   determiner   
----------------------+-----------------+-----------------+------------------+-----------------+----------------
             23596658 | UAM:Ento:259614 |               1 | individual count | individuals     | Derek S. Sikes
               554560 | UAM:Ento:411674 |               1 | individual count | individuals     | Derek S. Sikes
             24579699 | UAM:Ento:426671 |               1 | individual count | individuals     | Derek S. Sikes
             22011921 | UAM:Ento:74774  |               1 | individual count | individuals     | Derek S. Sikes
             26513059 | UAM:Ento:344971 |               2 | individual count | individuals     | Derek S. Sikes
             22066971 | UAM:Ento:113567 |               2 | individual count | individuals     | Derek S. Sikes
             22024065 | UAM:Ento:82414  |               1 | individual count | individuals     | Derek S. Sikes
             22148337 | UAM:Ento:136243 |               1 | individual count | individuals     | Derek S. Sikes
             23621847 | UAM:Ento:269440 |               1 | individual count | individuals     | Derek S. Sikes
             28155405 | UAM:Ento:430407 |               1 | individual count | individuals     | Derek S. Sikes
             22143742 | UAM:Ento:133882 |               1 | individual count | individuals     | Derek S. Sikes
             22152151 | UAM:Ento:138759 |               1 | individual count | individuals     | Derek S. Sikes
             29020012 | UAM:Ento:440864 |               1 | individual count | individuals     | Derek S. Sikes
             22856489 | UAM:Ento:245828 |               2 | individual count | individuals     | Derek S. Sikes
             22214386 | UAM:Ento:171363 |               7 | individual count | individuals     | Derek S. Sikes
             28301948 | UAM:Ento:381646 |               1 | individual count | individuals     | Derek S. Sikes
             24377879 | UAM:Ento:306378 |               1 | individual count | individuals     | Derek S. Sikes
             22856441 | UAM:Ento:245804 |               1 | individual count | individuals     | Derek S. Sikes
             24263481 | UAM:Ento:295996 |              12 | individual count | individuals     | Derek S. Sikes
             25885860 | UAM:Ento:427092 |               1 | individual count | individuals     | Derek S. Sikes
             28429567 | UAM:Ento:397570 |               1 | individual count | individuals     | Derek S. Sikes
             22053920 | UAM:Ento:106286 |               1 | individual count | individuals     | Derek S. Sikes
             28462280 | UAM:Ento:402275 |               1 | individual count | individuals     | Derek S. Sikes
             23594953 | UAM:Ento:259198 |               3 | individual count | individuals     | Derek S. Sikes
             22250831 | UAM:Ento:189616 |               1 | individual count | individuals     | Derek S. Sikes
             22213730 | UAM:Ento:171029 |               1 | individual count | individuals     | Derek S. Sikes
             24495180 | UAM:Ento:314680 |               1 | individual count | individuals     | Derek S. Sikes
             22629559 | UAM:Ento:231041 |               1 | individual count | individuals     | Derek S. Sikes
             22254385 | UAM:Ento:191393 |               1 | individual count | individuals     | Derek S. Sikes
             30008551 | UAM:Ento:455433 |               1 | individual count | individuals     | Derek S. Sikes
             28183410 | UAM:Ento:378335 |               1 | individual count | individuals     | Derek S. Sikes
             24465459 | UAM:Ento:313625 |               1 | individual count | individuals     | Derek S. Sikes
             22126793 | UAM:Ento:123320 |               1 | individual count | individuals     | Derek S. Sikes
             28395271 | UAM:Ento:423211 |               1 | individual count | individuals     | Derek S. Sikes
             22297226 | UAM:Ento:212884 |               1 | individual count | individuals     | Derek S. Sikes
             22275456 | UAM:Ento:201954 |               1 | individual count | individuals     | Derek S. Sikes
             28316888 | UAM:Ento:384901 |               1 | individual count | individuals     | Derek S. Sikes
             22111781 | UAM:Ento:108357 |               1 | individual count | individuals     | Derek S. Sikes
             23639180 | UAM:Ento:273564 |               1 | individual count | individuals     | Derek S. Sikes
             23732914 | UAM:Ento:288402 |               1 | individual count | individuals     | Derek S. Sikes
             23752005 | UAM:Ento:289324 |               1 | individual count | individuals     | Derek S. Sikes
             22307416 | UAM:Ento:221840 |               1 | individual count | individuals     | Derek S. Sikes
             22014246 | UAM:Ento:76631  |               1 | individual count | individuals     | Derek S. Sikes
             22052934 | UAM:Ento:97388  |               1 | individual count | individuals     | Derek S. Sikes
             22283012 | UAM:Ento:205744 |               1 | individual count | individuals     | Derek S. Sikes
             23064151 | UAM:Ento:255741 |               1 | individual count | individuals     | Derek S. Sikes
             22219001 | UAM:Ento:173659 |               1 | individual count | individuals     | Derek S. Sikes
             25755480 | UAM:Ento:318374 |               1 | individual count | individuals     | Derek S. Sikes
             23606175 | UAM:Ento:262412 |               1 | individual count | individuals     | Derek S. Sikes
             22208326 | UAM:Ento:168184 |               1 | individual count | individuals     | Derek S. Sikes
             23041588 | UAM:Ento:252701 |               2 | individual count | individuals     | Derek S. Sikes
             28318888 | UAM:Ento:385893 |               1 | individual count | individuals     | Derek S. Sikes
             22189526 | UAM:Ento:158631 |               1 | individual count | individuals     | Derek S. Sikes
             22136386 | UAM:Ento:130115 |               1 | individual count | individuals     | Derek S. Sikes
             21978799 | UAM:Ento:15229  |               1 | individual count | individuals     | Derek S. Sikes
             22920229 | UAM:Ento:248537 |               3 | individual count | individuals     | Derek S. Sikes
             22246123 | UAM:Ento:187260 |               1 | individual count | individuals     | Derek S. Sikes
             28293456 | UAM:Ento:431033 |               1 | individual count | individuals     | Derek S. Sikes
             25846953 | UAM:Ento:329726 |              27 | individual count | individuals     | Derek S. Sikes
             28426625 | UAM:Ento:396099 |               1 | individual count | individuals     | Derek S. Sikes
             28320598 | UAM:Ento:386748 |               1 | individual count | individuals     | Derek S. Sikes
             21998631 | UAM:Ento:27019  |               1 | individual count | individuals     | Derek S. Sikes
             22309210 | UAM:Ento:225904 |               2 | individual count | individuals     | Derek S. Sikes
             22015311 | UAM:Ento:76142  |               1 | individual count | individuals     | Derek S. Sikes
             23788274 | UAM:Ento:292369 |               1 | individual count | individuals     | Derek S. Sikes
             22007545 | UAM:Ento:71889  |               1 | individual count | individuals     | Derek S. Sikes
             28184251 | UAM:Ento:378496 |               1 | individual count | individuals     | Derek S. Sikes
             27972276 | UAM:Ento:374861 |              10 | individual count | individuals     | Derek S. Sikes
             23792928 | UAM:Ento:292594 |               1 | individual count | individuals     | Derek S. Sikes
             22043627 | UAM:Ento:99017  |               1 | individual count | individuals     | Derek S. Sikes
             24393628 | UAM:Ento:310002 |               1 | individual count | individuals     | Derek S. Sikes
             26883741 | UAM:Ento:354589 |               1 | individual count | individuals     | Derek S. Sikes
             22174022 | UAM:Ento:150675 |               3 | individual count | individuals     | Derek S. Sikes
             22036940 | UAM:Ento:95374  |               1 | individual count | individuals     | Derek S. Sikes
             24422652 | UAM:Ento:444980 |               1 | individual count | individuals     | Derek S. Sikes
             22450729 | UAM:Ento:18014  |               1 | individual count | individuals     | Derek S. Sikes
             24359647 | UAM:Ento:302505 |               2 | individual count | individuals     | Derek S. Sikes
             21989536 | UAM:Ento:22984  |               1 | individual count | individuals     | Derek S. Sikes
             23028024 | UAM:Ento:251027 |               1 | individual count | individuals     | Derek S. Sikes
             22213504 | UAM:Ento:170914 |               7 | individual count | individuals     | Derek S. Sikes
             21979550 | UAM:Ento:17335  |               1 | individual count | individuals     | Derek S. Sikes
             22925525 | UAM:Ento:249005 |               1 | individual count | individuals     | Derek S. Sikes
             22265484 | UAM:Ento:196954 |               1 | individual count | individuals     | Derek S. Sikes
             29896030 | UAM:Ento:449857 |               1 | individual count | individuals     | Derek S. Sikes
             24504574 | UAM:Ento:316339 |               1 | individual count | individuals     | Derek S. Sikes
             25793805 | UAM:Ento:322304 |               1 | individual count | individuals     | Derek S. Sikes
             22000980 | UAM:Ento:67988  |               1 | individual count | individuals     | Derek S. Sikes
             22209975 | UAM:Ento:169004 |               1 | individual count | individuals     | Derek S. Sikes
             30016361 | UAM:Ento:456656 |               1 | individual count | individuals     | Derek S. Sikes
             28793022 | UAM:Ento:432795 |               1 | individual count | individuals     | Derek S. Sikes
             22130265 | UAM:Ento:125070 |               1 | individual count | individuals     | Derek S. Sikes
             22247293 | UAM:Ento:187845 |               1 | individual count | individuals     | Derek S. Sikes
             28955568 | UAM:Ento:438090 |               1 | individual count | individuals     | Derek S. Sikes
             22114875 | UAM:Ento:116768 |              50 | individual count | individuals     | Derek S. Sikes
             26733836 | UAM:Ento:347367 |               1 | individual count | individuals     | Derek S. Sikes
             23622678 | UAM:Ento:269779 |               1 | individual count | individuals     | Derek S. Sikes
             22142186 | UAM:Ento:133070 |               1 | individual count | individuals     | Derek S. Sikes
             24219925 | UAM:Ento:444537 |               2 | individual count | individuals     | Derek S. Sikes
             25783268 | UAM:Ento:320064 |               4 | individual count | individuals     | Derek S. Sikes
             22212711 | UAM:Ento:170403 |               1 | individual count | individuals     | Derek S. Sikes
(100 rows)

@dustymc
Copy link
Contributor

dustymc commented Feb 26, 2022

should be

Like most things DWC (or Occurrence, hopefully https://github.com/ArctosDB/internal/issues/168 is going to change things), this completely falls apart when there's any complexity involved. The definition does not help (see the other issue for an example!): "The number of individuals present at the time of the Occurrence." What the hell's that supposed to mean? Something involving spatial and temporal precision? What's the sightability correction factor?! That can't be right....

If this is somehow useful to you, put whatever's useful in there. If it's not, ignore it.

@DerekSikes
Copy link
Author

DerekSikes commented Feb 26, 2022 via email

@dustymc
Copy link
Contributor

dustymc commented Feb 26, 2022

The records without a whole organism - all of them - are in the attached zipped csv.

The pasted-in list is some random records which do have whole organism parts, and the lot count in them is the sum of the lot counts of all whole organism parts.

@DerekSikes
Copy link
Author

DerekSikes commented Feb 26, 2022 via email

@dustymc
Copy link
Contributor

dustymc commented Feb 26, 2022

running in the attribute loader - it'll take a few days

@dustymc dustymc added this to the Active Development milestone Feb 26, 2022
@DerekSikes
Copy link
Author

DerekSikes commented Feb 28, 2022 via email

@dustymc
Copy link
Contributor

dustymc commented Feb 28, 2022

It's not the same data. One represents physical things, one is conceptual. How physical things map to conceptual is potentially complicated and varies by collection.

I could come up with some sort of a report that finds records without the attribute and guesses at individuals, if that would be useful.

@DerekSikes
Copy link
Author

DerekSikes commented Feb 28, 2022 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug Arctos is not performing as it should.
Projects
None yet
Development

No branches or pull requests

3 participants