Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Database Migration for sorting images: #352

Merged
merged 40 commits into from
Jul 21, 2021

Conversation

jLeonBi
Copy link
Contributor

@jLeonBi jLeonBi commented May 31, 2021

  • Add hash to images table
  • Add similarity index to images table

jLeonBi added 7 commits May 31, 2021 13:09
- Add hash to images table
- Add similarity index to images table
- HashValueGenrertor.py generates Hashvalue for one Image
- SimilarityIndexGenerator.py generates the index for each Image by the hash value
- Job and Test for Generating Hash Value per Image
- Job and Test for generating Similarity Index for Images
- Change Migrations to nullable
- Write first Test that checks if string is in (does not work because of no Storga?)
- Write Job for generating Image hash
- Add input and output to script
- add constructor to similarityIndexjob
- add nullable Job to HashGeneratorTest
.docker/worker.dockerfile Outdated Show resolved Hide resolved
jLeonBi and others added 4 commits June 15, 2021 13:35
jLeonBi added 2 commits June 16, 2021 13:22
- correct syntax for setting hash value
- Use getThumbnail function for getting bytstring image
- add input and output json
- add dummy pythton in associated test
- test where the teste case fail
-add more mock function
jLeonBi added 3 commits June 21, 2021 14:50
- job generates the hash for an image and saves it
- but insecure about so many mock functions
- update HashValueGenerator for Base64 images and test the in and output
- update SimilarityIndexGenerator for in and output and test it also
- change from list with dict as entries to one dict with id as key and SI as value
-The similarity index will be computed and assigned
-Test execute positiv
app/Jobs/GenerateHashValue.php Outdated Show resolved Hide resolved
app/Jobs/GenerateHashValue.php Outdated Show resolved Hide resolved
tests/php/Jobs/GenerateHashValueTest.php Outdated Show resolved Hide resolved
tests/php/Jobs/GenerateHashValueTest.php Outdated Show resolved Hide resolved
tests/php/Jobs/GenerateSimilarityIndexTest.php Outdated Show resolved Hide resolved
app/Jobs/GenerateSimilarityIndex.php Outdated Show resolved Hide resolved
app/Jobs/GenerateSimilarityIndex.php Outdated Show resolved Hide resolved
app/Jobs/GenerateSimilarityIndex.php Outdated Show resolved Hide resolved
jLeonBi added 3 commits June 24, 2021 10:25
-remove stub functions in both test cases
-change input and output from generateHashValue
-change hash migration from string to longText
-remove 3 foreach parts and replace with one collection statement
-start GenerateHashValueJob in ProcessNewImage after thumbnail is created
-start GenerateSimilarityIndex in GHV Job after asking if every image has hash
-add one testimage in GHV Test for checking if every image in volume has hash
app/Jobs/GenerateHashValue.php Outdated Show resolved Hide resolved
app/Jobs/GenerateHashValue.php Outdated Show resolved Hide resolved
app/Jobs/GenerateSimilarityIndex.php Outdated Show resolved Hide resolved
app/Jobs/GenerateSimilarityIndex.php Outdated Show resolved Hide resolved
app/Jobs/GenerateSimilarityIndex.php Outdated Show resolved Hide resolved
tests/php/Jobs/GenerateHashValueTest.php Outdated Show resolved Hide resolved
- suggestions in SimilarityIndexJob
app/Jobs/TrackObject.php Outdated Show resolved Hide resolved
.npmrc Outdated Show resolved Hide resolved
.npmrc Outdated Show resolved Hide resolved
.npmrc Outdated Show resolved Hide resolved
- add old npmrc
- add 404 if volume media type
- import api
jLeonBi added 2 commits July 17, 2021 18:08
-add Test for Missing one Sim index
- add Test for missing all Sim indices
-Test are not working because of not handling case
- add 404 error if similarity index is missing
- fix similarity controller query
- fix similarity sorter
Copy link
Member

@mzur mzur left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Neat, thanks!

@mzur mzur marked this pull request as ready for review July 21, 2021 12:52
@mzur mzur changed the base branch from master to similarity-sort July 21, 2021 12:56
@mzur mzur merged commit def9e34 into biigle:similarity-sort Jul 21, 2021
@mzur
Copy link
Member

mzur commented Jul 21, 2021

Development of this feature can continue in the similarity-sort branch.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants