Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update/feature subsetting #504

Open
wants to merge 20 commits into
base: master
Choose a base branch
from

Conversation

hamshkhawar
Copy link
Member

This PR is updated to new plugin standards

Copy link
Member

@bengtl bengtl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some minor changes, please see comments in files.

@@ -38,19 +39,20 @@ If WIPP is running, navigate to the plugins page and add a new plugin. Paste the

## Options

This plugin takes one input argument and one output argument:
This plugin takes twelve input arguments and one output argument:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Eleven input..?

4. `imageFeature` - Tabular data featuring image filenames
5. `tabularFeature` - Tabular feature that will be used to filter images
6. `groupVar` - This is a mandatory input across which to subset data. This can take either 1 or 2 variables as input and if 2 variables are provided then the second variable will be treated as the minor grouping variable. In our example, if the `z` is provided as input, then within a subcollection, the mean of the feature value will be taken for all images with the same z. Then the z positions will be filtered out based on the input of `percentile` and `removeDirection` variables. Now if `z,c` are provided as input, then 'c' will be treated as the minor grouping variable which means that the mean will be taken for all images with the same z for each channel. Also, the plugin will ensures that the same values of z positions are filtered out across c.
7. `percentile` and `removeDirection` - These two variables denote the critieria with which images are filtered. For example, if percentile is `0.1` and removeDirection is set to `Below` then images with feature value below the 10th percentile will be removed. On the other hand, if removeDirection is set to above then all images with feature value greater than the 10th pecentile will be removed. This enables data subsetting from both `brighfield` and `darkfield` microscopy images.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
7. `percentile` and `removeDirection` - These two variables denote the critieria with which images are filtered. For example, if percentile is `0.1` and removeDirection is set to `Below` then images with feature value below the 10th percentile will be removed. On the other hand, if removeDirection is set to above then all images with feature value greater than the 10th pecentile will be removed. This enables data subsetting from both `brighfield` and `darkfield` microscopy images.
7. `percentile` and `removeDirection` - These two variables denote the critieria with which images are filtered. For example, if percentile is `0.1` and removeDirection is set to `Below` then images with feature value below the 10th percentile will be removed. On the other hand, if removeDirection is set to above then all images with feature value greater than the 10th pecentile will be removed. This enables data subsetting from both `brightfield` and `darkfield` microscopy images.


CHUNK_SIZE = 10000

logger = logging.getLogger(__name__)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It seems the logger is initiated twice? It is already initiated in the main.py

@hamshkhawar hamshkhawar force-pushed the update/feature_subsetting branch from 1febf79 to 0e82f4b Compare April 4, 2024 15:21
@Nicholas-Schaub Nicholas-Schaub requested a review from hsidky as a code owner August 6, 2024 11:12
Copy link
Contributor

@Nicholas-Schaub Nicholas-Schaub left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Versions do not match across files (VERSION, Readme, etc.)

hamshkhawar and others added 4 commits August 16, 2024 12:54
* fix merge conflicts

* fix apply manifest

* fix apply manifest

* remove file

* updated hdbscan-clustering-plugin

* fix bug in tests

* fixed random generation of floats

* fixed docker file and shell script for running docker

* fixed docker files

* renamed plugin and fixed merged conflicts

* fixed docker files
@hamshkhawar
Copy link
Member Author

Versions do not match across files (VERSION, Readme, etc.)

I fixed it and add CLT and ict.yaml file for this plugin

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants