Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix summarization annotator card #549

Merged
merged 1 commit into from
Aug 8, 2023

Conversation

mtalimanchuk
Copy link
Member

No description provided.

@dilyararimovna dilyararimovna merged commit 31305ae into dev Aug 8, 2023
2 checks passed
@dilyararimovna dilyararimovna deleted the fix/summarization-annotator-card branch August 8, 2023 06:42
smilni pushed a commit that referenced this pull request Aug 8, 2023
dilyararimovna added a commit that referenced this pull request Aug 9, 2023
* robot first commit (no cards)

* feat: do not use sentence ranker url from env (#535)

* Feat/ruxglm prompted dist (#528)

* feat: ignore env secret ru

* feat: add access token

* feat: distribution ruxglm

* fix: ruxglm cards

* fix: use use_auth_token

* fix: eos tokens type

* fix: stats cpu ram

* fix: skills cards

* fix: components cards

* fix: eos tokens

* fix: eos tokens

* fix: eos tokens

* fix: eos tokens

* fix: cards and table

* fix: ADDITIONAL_EOS_TOKENS

* fix: ADDITIONAL_EOS_TOKENS

* fix: codestyle

* fix: universal

* fix: dream persona ru skill name

* fix: prompt selector ru

* fix: replacement

* fix: prompt selecrto

* fix: use params

* fix: timeout and history

* fix: trye very short persona

* fix: increase timeout

* fix: sub replacement tokens correctly

* fix: sub replacement tokens correctly

* fix: use stopping criteria

* fix: typing

* fix: revert long persona

* fix: duplicate spaces

* fix: correct components for russian distribution

* fix: proxy for russian distribution

* feat: universal distr for ru

* feat: universal distr for ru

* fix: remove extra

* fix: working configs

* fix: configs

* feat: ruxglm prompted dists

* fix: component cards

* fix: container name

* fix: remove extra space after new line

* fix: remove extra space after new line

* feat: tests for dream ruxglm

* fix: proxy and ru lang

* fix: change port of universal ru

* fix: rights on file

* fix: tests skills

* fix: test for resp selector

* fix: tests for proxied components

* fix: remove do sample true

* fix: generative params

* feat: used sentence ranker url

* feat: utilized default llm

* Feat/ru prompted dists (#532)

* feat: ignore env secret ru

* feat: add access token

* feat: distribution ruxglm

* fix: ruxglm cards

* fix: use use_auth_token

* fix: eos tokens type

* fix: stats cpu ram

* fix: skills cards

* fix: components cards

* fix: eos tokens

* fix: eos tokens

* fix: eos tokens

* fix: eos tokens

* fix: cards and table

* fix: ADDITIONAL_EOS_TOKENS

* fix: ADDITIONAL_EOS_TOKENS

* fix: codestyle

* fix: universal

* fix: dream persona ru skill name

* fix: prompt selector ru

* fix: replacement

* fix: prompt selecrto

* fix: use params

* fix: timeout and history

* fix: trye very short persona

* fix: increase timeout

* fix: sub replacement tokens correctly

* fix: sub replacement tokens correctly

* fix: use stopping criteria

* fix: typing

* fix: revert long persona

* fix: duplicate spaces

* fix: correct components for russian distribution

* fix: proxy for russian distribution

* feat: universal distr for ru

* feat: universal distr for ru

* fix: remove extra

* fix: working configs

* fix: configs

* feat: ruxglm prompted dists

* fix: component cards

* fix: container name

* first dist (no cards)

* fix: remove extra space after new line

* fix: remove extra space after new line

* feat: tests for dream ruxglm

* fix: proxy and ru lang

* fix: change port of universal ru

* fix: rights on file

* fix: tests skills

* fix: test for resp selector

* multiskill_ru_assistant

* fix: tests for proxied components

* fairytale and action stories dists

* journalist helper dist

* fairytale fixes

* one more fix

* action stories cards

* add quotation marks

* fairytale cards

* storyteller cards

* journalist helper cards

* multiskill ru cards

* agent services cards

* minor fixes

* fix: utilize sentence ranker url

---------

Co-authored-by: dilyararimovna <dilyara.rimovna@gmail.com>

* update components.tsv (#537)

* update components.tsv

* tabulation

* Feat/rugpt 3.5 distribution (#534)

* feat: ignore env secret ru

* feat: add access token

* feat: distribution ruxglm

* fix: ruxglm cards

* fix: use use_auth_token

* fix: eos tokens type

* fix: stats cpu ram

* fix: skills cards

* fix: components cards

* fix: eos tokens

* fix: eos tokens

* fix: eos tokens

* fix: eos tokens

* fix: cards and table

* fix: ADDITIONAL_EOS_TOKENS

* fix: ADDITIONAL_EOS_TOKENS

* fix: codestyle

* fix: universal

* fix: dream persona ru skill name

* fix: prompt selector ru

* fix: replacement

* fix: prompt selecrto

* fix: use params

* fix: timeout and history

* fix: trye very short persona

* fix: increase timeout

* fix: sub replacement tokens correctly

* fix: sub replacement tokens correctly

* fix: use stopping criteria

* fix: typing

* fix: revert long persona

* fix: duplicate spaces

* fix: correct components for russian distribution

* fix: proxy for russian distribution

* feat: universal distr for ru

* feat: universal distr for ru

* fix: remove extra

* fix: working configs

* fix: configs

* feat: ruxglm prompted dists

* fix: component cards

* fix: container name

* fix: remove extra space after new line

* fix: remove extra space after new line

* feat: tests for dream ruxglm

* fix: proxy and ru lang

* fix: change port of universal ru

* fix: rights on file

* fix: tests skills

* fix: test for resp selector

* fix: tests for proxied components

* feat: rugpt-3.5 by sber in universal russian distribution

* fix; wait for it

* fix: models card

* fix: models card

* fix: add to list

* fix: change port

* fix: change port

* fix: change size to correct

* feat: instruction how to add a new model

* fix ru prompt selector, remove unused component (#538)

* feat: replace oasst12b with gptjt (#541)

* Feat/utilize rugpt35 (#540)

* feat: utilize rugpt35

* feat: tests for jounrlist rugpt35

* feat: tests for jounrlist rugpt35

* fix: rights for tfile

* feat: names

* fix: ru_dists_names_and_prompts (#543)

* rename ruxglm to u

* more renaming

* tabs

* tabs

* some more renaming

* short prompt

* many cards and name changes

* fix typo

* fixes for Dilya

* tiny fix

* tiny fix

* huge name check

* names

* typo prompt

* fix: no tests for non existing skills

---------

Co-authored-by: dilyararimovna <dilyara.rimovna@gmail.com>

* fix: cards for ru dists (#544)

* fix: rugpt35 config and envs (#546)

* Summarization models (#393)

* Added abstractive summarization model for English texts

* Added abstractive summarization model for Russian texts

* Added summarization annotator

* Moved rut5 summarizer to dream_russian

* Changed endpoint

* Added model path to Dockerfile

* Updated test

* Updated summarization annotator input

* Updated test

* Changed summarization service url

* Changed test

* Increased timeout

* Updated ram_usage

* Updated ports

* Updated models cards

* Added more info messages

* Fixed path error

* Added summarization output to bot attributes

* Added timeout param to dockerfile

* Updated model cards and ports

* Fixed problem with incorrect batch processing

* Updated summarization save format

* Updated dialog summarization model

* Updated tests

* Minor formatting changes

* Fixed black and flake8 codestyle

* Fixed black codestyle

* Updated models ports

* Small fixes

* Models table upd (#539)

* Fix requirements.txt (#84)

* fix itsdangerous requirements

* pin itsdangerous requirements for all flask==1.1.1 servers

* updated MODELS.md table: added info about models' licensing and commercial use + merged link+name cols to improve overall readability and decrease redundancy

* Update MODELS.md

fixed "is" for better consistency

* fix: format table and add new models back

* fix: sizes of models on gpu

* updated table

---------

Co-authored-by: Andrii.Hura <54397922+AndriiHura@users.noreply.github.com>
Co-authored-by: mtalimanchuk <mtalimanchuk@gmail.com>
Co-authored-by: Dilyara Baymurzina <dilyara.rimovna@gmail.com>

* fix: anthropic model params (#547)

* fix summarization annotator card (#549)

* add cards for prompted robot

* ports and n_utt

* port

* increase WAIT_HOSTS_TIMEOUT in cards

---------

Co-authored-by: Dilyara Zharikova (Baymurzina) <dilyara.rimovna@gmail.com>
Co-authored-by: Maxim Talimanchuk <mtalimanchuk@gmail.com>
Co-authored-by: Nikolay <99244955+Kolpnick@users.noreply.github.com>
Co-authored-by: Anastásis <43078815+nstsj@users.noreply.github.com>
Co-authored-by: Andrii.Hura <54397922+AndriiHura@users.noreply.github.com>
oserikov pushed a commit that referenced this pull request Nov 21, 2024
oserikov pushed a commit that referenced this pull request Nov 21, 2024
* robot first commit (no cards)

* feat: do not use sentence ranker url from env (#535)

* Feat/ruxglm prompted dist (#528)

* feat: ignore env secret ru

* feat: add access token

* feat: distribution ruxglm

* fix: ruxglm cards

* fix: use use_auth_token

* fix: eos tokens type

* fix: stats cpu ram

* fix: skills cards

* fix: components cards

* fix: eos tokens

* fix: eos tokens

* fix: eos tokens

* fix: eos tokens

* fix: cards and table

* fix: ADDITIONAL_EOS_TOKENS

* fix: ADDITIONAL_EOS_TOKENS

* fix: codestyle

* fix: universal

* fix: dream persona ru skill name

* fix: prompt selector ru

* fix: replacement

* fix: prompt selecrto

* fix: use params

* fix: timeout and history

* fix: trye very short persona

* fix: increase timeout

* fix: sub replacement tokens correctly

* fix: sub replacement tokens correctly

* fix: use stopping criteria

* fix: typing

* fix: revert long persona

* fix: duplicate spaces

* fix: correct components for russian distribution

* fix: proxy for russian distribution

* feat: universal distr for ru

* feat: universal distr for ru

* fix: remove extra

* fix: working configs

* fix: configs

* feat: ruxglm prompted dists

* fix: component cards

* fix: container name

* fix: remove extra space after new line

* fix: remove extra space after new line

* feat: tests for dream ruxglm

* fix: proxy and ru lang

* fix: change port of universal ru

* fix: rights on file

* fix: tests skills

* fix: test for resp selector

* fix: tests for proxied components

* fix: remove do sample true

* fix: generative params

* feat: used sentence ranker url

* feat: utilized default llm

* Feat/ru prompted dists (#532)

* feat: ignore env secret ru

* feat: add access token

* feat: distribution ruxglm

* fix: ruxglm cards

* fix: use use_auth_token

* fix: eos tokens type

* fix: stats cpu ram

* fix: skills cards

* fix: components cards

* fix: eos tokens

* fix: eos tokens

* fix: eos tokens

* fix: eos tokens

* fix: cards and table

* fix: ADDITIONAL_EOS_TOKENS

* fix: ADDITIONAL_EOS_TOKENS

* fix: codestyle

* fix: universal

* fix: dream persona ru skill name

* fix: prompt selector ru

* fix: replacement

* fix: prompt selecrto

* fix: use params

* fix: timeout and history

* fix: trye very short persona

* fix: increase timeout

* fix: sub replacement tokens correctly

* fix: sub replacement tokens correctly

* fix: use stopping criteria

* fix: typing

* fix: revert long persona

* fix: duplicate spaces

* fix: correct components for russian distribution

* fix: proxy for russian distribution

* feat: universal distr for ru

* feat: universal distr for ru

* fix: remove extra

* fix: working configs

* fix: configs

* feat: ruxglm prompted dists

* fix: component cards

* fix: container name

* first dist (no cards)

* fix: remove extra space after new line

* fix: remove extra space after new line

* feat: tests for dream ruxglm

* fix: proxy and ru lang

* fix: change port of universal ru

* fix: rights on file

* fix: tests skills

* fix: test for resp selector

* multiskill_ru_assistant

* fix: tests for proxied components

* fairytale and action stories dists

* journalist helper dist

* fairytale fixes

* one more fix

* action stories cards

* add quotation marks

* fairytale cards

* storyteller cards

* journalist helper cards

* multiskill ru cards

* agent services cards

* minor fixes

* fix: utilize sentence ranker url

---------

Co-authored-by: dilyararimovna <dilyara.rimovna@gmail.com>

* update components.tsv (#537)

* update components.tsv

* tabulation

* Feat/rugpt 3.5 distribution (#534)

* feat: ignore env secret ru

* feat: add access token

* feat: distribution ruxglm

* fix: ruxglm cards

* fix: use use_auth_token

* fix: eos tokens type

* fix: stats cpu ram

* fix: skills cards

* fix: components cards

* fix: eos tokens

* fix: eos tokens

* fix: eos tokens

* fix: eos tokens

* fix: cards and table

* fix: ADDITIONAL_EOS_TOKENS

* fix: ADDITIONAL_EOS_TOKENS

* fix: codestyle

* fix: universal

* fix: dream persona ru skill name

* fix: prompt selector ru

* fix: replacement

* fix: prompt selecrto

* fix: use params

* fix: timeout and history

* fix: trye very short persona

* fix: increase timeout

* fix: sub replacement tokens correctly

* fix: sub replacement tokens correctly

* fix: use stopping criteria

* fix: typing

* fix: revert long persona

* fix: duplicate spaces

* fix: correct components for russian distribution

* fix: proxy for russian distribution

* feat: universal distr for ru

* feat: universal distr for ru

* fix: remove extra

* fix: working configs

* fix: configs

* feat: ruxglm prompted dists

* fix: component cards

* fix: container name

* fix: remove extra space after new line

* fix: remove extra space after new line

* feat: tests for dream ruxglm

* fix: proxy and ru lang

* fix: change port of universal ru

* fix: rights on file

* fix: tests skills

* fix: test for resp selector

* fix: tests for proxied components

* feat: rugpt-3.5 by sber in universal russian distribution

* fix; wait for it

* fix: models card

* fix: models card

* fix: add to list

* fix: change port

* fix: change port

* fix: change size to correct

* feat: instruction how to add a new model

* fix ru prompt selector, remove unused component (#538)

* feat: replace oasst12b with gptjt (#541)

* Feat/utilize rugpt35 (#540)

* feat: utilize rugpt35

* feat: tests for jounrlist rugpt35

* feat: tests for jounrlist rugpt35

* fix: rights for tfile

* feat: names

* fix: ru_dists_names_and_prompts (#543)

* rename ruxglm to u

* more renaming

* tabs

* tabs

* some more renaming

* short prompt

* many cards and name changes

* fix typo

* fixes for Dilya

* tiny fix

* tiny fix

* huge name check

* names

* typo prompt

* fix: no tests for non existing skills

---------

Co-authored-by: dilyararimovna <dilyara.rimovna@gmail.com>

* fix: cards for ru dists (#544)

* fix: rugpt35 config and envs (#546)

* Summarization models (#393)

* Added abstractive summarization model for English texts

* Added abstractive summarization model for Russian texts

* Added summarization annotator

* Moved rut5 summarizer to dream_russian

* Changed endpoint

* Added model path to Dockerfile

* Updated test

* Updated summarization annotator input

* Updated test

* Changed summarization service url

* Changed test

* Increased timeout

* Updated ram_usage

* Updated ports

* Updated models cards

* Added more info messages

* Fixed path error

* Added summarization output to bot attributes

* Added timeout param to dockerfile

* Updated model cards and ports

* Fixed problem with incorrect batch processing

* Updated summarization save format

* Updated dialog summarization model

* Updated tests

* Minor formatting changes

* Fixed black and flake8 codestyle

* Fixed black codestyle

* Updated models ports

* Small fixes

* Models table upd (#539)

* Fix requirements.txt (#84)

* fix itsdangerous requirements

* pin itsdangerous requirements for all flask==1.1.1 servers

* updated MODELS.md table: added info about models' licensing and commercial use + merged link+name cols to improve overall readability and decrease redundancy

* Update MODELS.md

fixed "is" for better consistency

* fix: format table and add new models back

* fix: sizes of models on gpu

* updated table

---------

Co-authored-by: Andrii.Hura <54397922+AndriiHura@users.noreply.github.com>
Co-authored-by: mtalimanchuk <mtalimanchuk@gmail.com>
Co-authored-by: Dilyara Baymurzina <dilyara.rimovna@gmail.com>

* fix: anthropic model params (#547)

* fix summarization annotator card (#549)

* add cards for prompted robot

* ports and n_utt

* port

* increase WAIT_HOSTS_TIMEOUT in cards

---------

Co-authored-by: Dilyara Zharikova (Baymurzina) <dilyara.rimovna@gmail.com>
Co-authored-by: Maxim Talimanchuk <mtalimanchuk@gmail.com>
Co-authored-by: Nikolay <99244955+Kolpnick@users.noreply.github.com>
Co-authored-by: Anastásis <43078815+nstsj@users.noreply.github.com>
Co-authored-by: Andrii.Hura <54397922+AndriiHura@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants