Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add new OP: image_tagging_mapper #423

Merged
merged 11 commits into from
Sep 12, 2024
Merged

Add new OP: image_tagging_mapper #423

merged 11 commits into from
Sep 12, 2024

Conversation

HYLcool
Copy link
Collaborator

@HYLcool HYLcool commented Sep 9, 2024

  • Similar to video_tagging_from_frames_mapper
  • Support user-specified tag field names for all tagging OPs
  • fix the type bug in video_tagging_from_audio_mapper: force the type of result field to list of string.

@drcege drcege added dj:multimodal issues/PRs about multimodal data processing dj:op issues/PRs about some specific OPs labels Sep 12, 2024
@HYLcool HYLcool merged commit c40a308 into main Sep 12, 2024
3 checks passed
@HYLcool HYLcool deleted the op/image_tagging_mapper branch September 12, 2024 07:28
drcege added a commit that referenced this pull request Sep 13, 2024
* temp

* Regress model preloading (#426)

* fix param definition (#424)

* fix param def

* add param check

* use pydantic types (#422)

* use pydantic types

* change config unittest

* fix GenerateInstructionMapper

* update

* Fix (#427)

Fix some words

* Add new OP: image_tagging_mapper (#423)

* * init image tagging mapper

* + Add unittest for image_tagging_mapper
* support specified tag field names for all tagging OPs

* * fix problems of unittest

* + add docs

* * update docs

* * skip two unittests which require ram

* * minor fix for gece's comments

* * merge main into this branch

* + add type hint

* match api call

* match api call

* pre-commit

* decouple API args & add type hints

---------

Co-authored-by: Ce Ge (戈策) <gece@foxmail.com>
Co-authored-by: Cathy0908 <30484308+Cathy0908@users.noreply.github.com>
Co-authored-by: co63oc <co63oc@users.noreply.github.com>
Co-authored-by: Yilun Huang <lielin.hyl@alibaba-inc.com>
Co-authored-by: null <3213204+drcege@users.noreply.github.com>
drcege added a commit that referenced this pull request Nov 11, 2024
* inital implementation

* support params checking and dataset converting

* support filtered and tags

* allow partial execution of op.run

* Service/match api (#428)

* temp

* Regress model preloading (#426)

* fix param definition (#424)

* fix param def

* add param check

* use pydantic types (#422)

* use pydantic types

* change config unittest

* fix GenerateInstructionMapper

* update

* Fix (#427)

Fix some words

* Add new OP: image_tagging_mapper (#423)

* * init image tagging mapper

* + Add unittest for image_tagging_mapper
* support specified tag field names for all tagging OPs

* * fix problems of unittest

* + add docs

* * update docs

* * skip two unittests which require ram

* * minor fix for gece's comments

* * merge main into this branch

* + add type hint

* match api call

* match api call

* pre-commit

* decouple API args & add type hints

---------

Co-authored-by: Ce Ge (戈策) <gece@foxmail.com>
Co-authored-by: Cathy0908 <30484308+Cathy0908@users.noreply.github.com>
Co-authored-by: co63oc <co63oc@users.noreply.github.com>
Co-authored-by: Yilun Huang <lielin.hyl@alibaba-inc.com>
Co-authored-by: null <3213204+drcege@users.noreply.github.com>

* Service/match api (#431)

* temp

* match api call

* match api call

* pre-commit

* decouple API args & add type hints

* agentscope demo

* update demos

* update pre-commt

* add yaml

* update notebooks

* add py

* refine

---------

Co-authored-by: null <3213204+drcege@users.noreply.github.com>
Co-authored-by: gece.gc <gece.gc@alibaba-inc.com>

* update reqs

---------

Co-authored-by: BeachWang <1400012807@pku.edu.cn>
Co-authored-by: Cathy0908 <30484308+Cathy0908@users.noreply.github.com>
Co-authored-by: co63oc <co63oc@users.noreply.github.com>
Co-authored-by: Yilun Huang <lielin.hyl@alibaba-inc.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dj:multimodal issues/PRs about multimodal data processing dj:op issues/PRs about some specific OPs
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants