Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Clayrs can see! #29

Merged
merged 198 commits into from
Jul 4, 2023
Merged

Clayrs can see! #29

merged 198 commits into from
Jul 4, 2023

Conversation

Silleellie
Copy link
Collaborator

Changes will be written in the release 0.5.1

Silleellie and others added 30 commits November 9, 2022 13:22
@Silleellie
implemented context manager for multithreading
92d227f
@Silleellie
initial implementation of the images of visual content techniques
184e722
@Silleellie
Merge branch 'sparql_query_update' of https://github.com/swapUniba/Cl…
ebfad5b 
…ayRS into visual_content_analyzer
@m-elio
added PostProcessor for visual techniques (PCA)
cff1a10
@m-elio
added PostProcessor logic
fe373ac
@m-elio
renamed processors module name
d159e33
@Silleellie
set the abstract class ImageProcessor to be a torch module
aff7f61
@Silleellie
initial implementation KMeans
1d12d89
@Silleellie
moved initial implementation of visual techniques to its own module
49a17f5
@Silleellie
updated references to modules in init files
70e4297
@Silleellie
implemented built in torch transformers for image preprocessing
bf79dc2
@m-elio
made EmbeddingField a numpy array container
3b17ee8
@m-elio
implemented RandomProjection and FeatureAgglomeration
5252db9
@m-elio
added postprocessors and improved abstraction
6f55091
@m-elio
added and refined pre-existing visual content techniques
06f0cac
@m-elio
added missing calls to postprocess method
e6216b0
@Silleellie
init distinction PerUserCBAlgorithm
9605ee0
@Silleellie
adapted per user cb algorithms to extend new cb subclass
93a2add
@Silleellie
updated torch version
a196cf9
@m-elio
roc curve implemented as plot metric
c91ce30
@m-elio
added initial vbpr implementation
865a2c1
@m-elio
added torch tensor as accepted representation
2e2376b
@Silleellie
added possibility to throw away content loaded
32567ae
@m-elio
from feature matrix to features by dataloader
111580b
@m-elio
various adjustment to vbpr fit w.r.t. previous changes
da19b9b
@m-elio
storing representation in memory without saving them
ce39eb1
@Silleellie
added FromNPY class
05cb21c
@Silleellie
fixed syntax error
0a4f535
@Silleellie
flattening before combining
877a37e
@Silleellie
added vbpr implementation which gives replicability with cornac
077b74c
Silleellie and others added 27 commits July 3, 2023 16:53
@Silleellie @m-elio
added possibility to keep order of results when threading
fe1edd9 
Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@Silleellie @m-elio
added possibility to multi thread pickle dump of ca output
66dd425 
Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@Silleellie @m-elio
definitive fix mismatch issue content analyzer dataloader
f7cf2df 
Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@Silleellie @m-elio
fixed GPU mode for opencv
ecde77c 
Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@Silleellie @m-elio
added possibility to define function on PytorchImageModels output
2e6b7d2 
Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@Silleellie @m-elio
fixed __str__ and __repr__
6af9cd2 
Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@Silleellie @m-elio
reverted to [0,1] range for loaded images
90ba2f9 
Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@Silleellie @m-elio
fix duplicate serialization when multithreading
46c7986 
Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@Silleellie @m-elio
set eval mode for Pytorch Image Models
f024aff 
Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@Silleellie @m-elio
added model name to __str__ of high level techniques
4aaa637 
Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@Silleellie @m-elio
fix report class extracting tuple as arguments
1191e4e 
Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@Silleellie @m-elio
integer id representation now separated by "/" in yml file
657f8fc 
Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@Silleellie @m-elio
report now available also for recsys objects w/o calling pred/rank me…
985632a 
…thod

Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@Silleellie @m-elio
added opencv as requirement
50c62c5 
Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@Silleellie @m-elio
renamed count to error count for error on images load
7175218 
Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@Silleellie @m-elio
renamed clayrs_can_see to clayrs following merge of visual changes
999d49c 
Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@Silleellie @m-elio
moved test images to different folder
b199d6f 
Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@Silleellie @m-elio
changed name for relative path source
d8d9287 
Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@Silleellie @m-elio
added None when image can't be loaded
5ecb7fb 
Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@Silleellie @m-elio
fixed path for downloaded images
1a7cb36 
Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@Silleellie @m-elio
added constant for root of repository
9d3e3b2 
Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@Silleellie @m-elio
fixed and adjusted visual techniques tests
80aea70 
Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@Silleellie
Merge branch 'master' of https://github.com/swapUniba/ClayRS
35df7ee 
# Conflicts:
#	README.md
#	colab_examples/1_tfidf_centroid.ipynb
#	colab_examples/2_embeddings_randomforest.ipynb
#	colab_examples/3_graph_pagerank.ipynb
#	colab_examples/4_evaluate_other_recs.ipynb
#	requirements.txt
#	setup.py
@Silleellie @m-elio
updated notebooks for clayrs can see update
89dcc43 
Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@Silleellie @m-elio
fixed test report ca
519c57d 
Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@Silleellie @m-elio
removed outdated recsys report test
8857276 
Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@Silleellie @m-elio
fixed rmtree with os remove
1c8b93a 
Co-authored-by: m-elio <m-elio@users.noreply.github.com>
@codecov
Copy link

codecov bot commented Jul 3, 2023 •
edited
Loading

Codecov Report

Patch coverage: 95.94% and project coverage change: +0.77 🎉

Comparison is base (e9b06cf) 94.70% compared to head (1c8b93a) 95.48%.

Additional details and impacted files 
@@            Coverage Diff             @@
##           master      #29      +/-   ##
==========================================
+ Coverage   94.70%   95.48%   +0.77%     
==========================================
  Files          82       90       +8     
  Lines        4345     5399    +1054     
==========================================
+ Hits         4115     5155    +1040     
- Misses        230      244      +14
Flag Coverage Δ
python_3.10 95.48% <95.94%> (+0.77%) ⬆️
python_3.8 95.47% <95.94%> (+0.77%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
.../embeddings/embedding_learner/embedding_learner.py 96.00% <ø> (ø)
...production_techniques/synset_document_frequency.py 100.00% <ø> (ø)
...yzer/field_content_production_techniques/tf_idf.py 100.00% <ø> (ø)
...lyzer/information_processor/ekphrasis_processor.py 92.50% <ø> (ø)
...t_analyzer/information_processor/nltk_processor.py 97.22% <ø> (ø)
clayrs/content_analyzer/utils/id_merger.py 100.00% <ø> (ø)
...s/graphs/feature_selection/feature_selection_fn.py 100.00% <ø> (ø)
...ys/graphs/nx_implementation/nx_bipartite_graphs.py 98.38% <ø> (ø)
...content_analyzer/content_representation/content.py 86.66% <26.66%> (-6.78%) ⬇️
...tent_analyzer/embeddings/embedding_loader/sbert.py 83.33% <50.00%> (+1.51%) ⬆️
... and 46 more

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

@Silleellie Silleellie merged commit 414b4dc into master Jul 4, 2023
@Silleellie Silleellie deleted the clayrs_can_see branch July 4, 2023 15:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@Silleellie @m-elio