Feat/ruxglm prompted dist #528
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
smilni
requested changes
Jul 18, 2023
There was a problem hiding this comment.
dream_persona_ruxglm_prompted
лишний AI откуда-то. исходя из логов модель так и генерит. но плохо, что выбралась гипотеза, которой верно присвоен низкий конфиденс (0.7) из-за отсутствия знака препинания в конце, хотя была норм гипотеза с 0.9. мб стоит ставить 0.5 если нет точки, чтоб сильнее вклад был в действия респонс селектора
это не пофиксить наверное, но иногда просто повторяет промпт. может можно предусмотреть и давать нулевой конфиденс за такое. там обе гипотезы были такие, значит лучше уж дамми.
видимо моделька слишком маленькая, чтоб нормально следовать большому промпту. я бы подумала над тем чтоб урезать промпт раз в пять, пусть там совсем немного будет, но она хоть слушаться будет. а то четко прописан любимый фильм, но ответ вот:
dream_persona_rullama_prompted
нет proxy.yml. локально ничего не поднимается, ллама из-за отсутствия scipy, диалогрпт из-за (вроде) нехватки памяти: логи
# Conflicts: # assistant_dists/dream_persona_rullama_prompted/pipeline_conf.json # components.tsv
smilni
reviewed
Jul 20, 2023
assistant_dists/universal_ru_prompted_assistant/docker-compose.override.yml
Outdated
Show resolved
Hide resolved
services/transformers_lm/service_configs/transformers-lm-ruxglm/service.yml
Show resolved
Hide resolved
smilni
pushed a commit
that referenced
this pull request
Aug 8, 2023
* feat: ignore env secret ru * feat: add access token * feat: distribution ruxglm * fix: ruxglm cards * fix: use use_auth_token * fix: eos tokens type * fix: stats cpu ram * fix: skills cards * fix: components cards * fix: eos tokens * fix: eos tokens * fix: eos tokens * fix: eos tokens * fix: cards and table * fix: ADDITIONAL_EOS_TOKENS * fix: ADDITIONAL_EOS_TOKENS * fix: codestyle * fix: universal * fix: dream persona ru skill name * fix: prompt selector ru * fix: replacement * fix: prompt selecrto * fix: use params * fix: timeout and history * fix: trye very short persona * fix: increase timeout * fix: sub replacement tokens correctly * fix: sub replacement tokens correctly * fix: use stopping criteria * fix: typing * fix: revert long persona * fix: duplicate spaces * fix: correct components for russian distribution * fix: proxy for russian distribution * feat: universal distr for ru * feat: universal distr for ru * fix: remove extra * fix: working configs * fix: configs * feat: ruxglm prompted dists * fix: component cards * fix: container name * fix: remove extra space after new line * fix: remove extra space after new line * feat: tests for dream ruxglm * fix: proxy and ru lang * fix: change port of universal ru * fix: rights on file * fix: tests skills * fix: test for resp selector * fix: tests for proxied components * fix: remove do sample true * fix: generative params * feat: used sentence ranker url * feat: utilized default llm
dilyararimovna
added a commit
that referenced
this pull request
Aug 9, 2023
* robot first commit (no cards) * feat: do not use sentence ranker url from env (#535) * Feat/ruxglm prompted dist (#528) * feat: ignore env secret ru * feat: add access token * feat: distribution ruxglm * fix: ruxglm cards * fix: use use_auth_token * fix: eos tokens type * fix: stats cpu ram * fix: skills cards * fix: components cards * fix: eos tokens * fix: eos tokens * fix: eos tokens * fix: eos tokens * fix: cards and table * fix: ADDITIONAL_EOS_TOKENS * fix: ADDITIONAL_EOS_TOKENS * fix: codestyle * fix: universal * fix: dream persona ru skill name * fix: prompt selector ru * fix: replacement * fix: prompt selecrto * fix: use params * fix: timeout and history * fix: trye very short persona * fix: increase timeout * fix: sub replacement tokens correctly * fix: sub replacement tokens correctly * fix: use stopping criteria * fix: typing * fix: revert long persona * fix: duplicate spaces * fix: correct components for russian distribution * fix: proxy for russian distribution * feat: universal distr for ru * feat: universal distr for ru * fix: remove extra * fix: working configs * fix: configs * feat: ruxglm prompted dists * fix: component cards * fix: container name * fix: remove extra space after new line * fix: remove extra space after new line * feat: tests for dream ruxglm * fix: proxy and ru lang * fix: change port of universal ru * fix: rights on file * fix: tests skills * fix: test for resp selector * fix: tests for proxied components * fix: remove do sample true * fix: generative params * feat: used sentence ranker url * feat: utilized default llm * Feat/ru prompted dists (#532) * feat: ignore env secret ru * feat: add access token * feat: distribution ruxglm * fix: ruxglm cards * fix: use use_auth_token * fix: eos tokens type * fix: stats cpu ram * fix: skills cards * fix: components cards * fix: eos tokens * fix: eos tokens * fix: eos tokens * fix: eos tokens * fix: cards and table * fix: ADDITIONAL_EOS_TOKENS * fix: ADDITIONAL_EOS_TOKENS * fix: codestyle * fix: universal * fix: dream persona ru skill name * fix: prompt selector ru * fix: replacement * fix: prompt selecrto * fix: use params * fix: timeout and history * fix: trye very short persona * fix: increase timeout * fix: sub replacement tokens correctly * fix: sub replacement tokens correctly * fix: use stopping criteria * fix: typing * fix: revert long persona * fix: duplicate spaces * fix: correct components for russian distribution * fix: proxy for russian distribution * feat: universal distr for ru * feat: universal distr for ru * fix: remove extra * fix: working configs * fix: configs * feat: ruxglm prompted dists * fix: component cards * fix: container name * first dist (no cards) * fix: remove extra space after new line * fix: remove extra space after new line * feat: tests for dream ruxglm * fix: proxy and ru lang * fix: change port of universal ru * fix: rights on file * fix: tests skills * fix: test for resp selector * multiskill_ru_assistant * fix: tests for proxied components * fairytale and action stories dists * journalist helper dist * fairytale fixes * one more fix * action stories cards * add quotation marks * fairytale cards * storyteller cards * journalist helper cards * multiskill ru cards * agent services cards * minor fixes * fix: utilize sentence ranker url --------- Co-authored-by: dilyararimovna <dilyara.rimovna@gmail.com> * update components.tsv (#537) * update components.tsv * tabulation * Feat/rugpt 3.5 distribution (#534) * feat: ignore env secret ru * feat: add access token * feat: distribution ruxglm * fix: ruxglm cards * fix: use use_auth_token * fix: eos tokens type * fix: stats cpu ram * fix: skills cards * fix: components cards * fix: eos tokens * fix: eos tokens * fix: eos tokens * fix: eos tokens * fix: cards and table * fix: ADDITIONAL_EOS_TOKENS * fix: ADDITIONAL_EOS_TOKENS * fix: codestyle * fix: universal * fix: dream persona ru skill name * fix: prompt selector ru * fix: replacement * fix: prompt selecrto * fix: use params * fix: timeout and history * fix: trye very short persona * fix: increase timeout * fix: sub replacement tokens correctly * fix: sub replacement tokens correctly * fix: use stopping criteria * fix: typing * fix: revert long persona * fix: duplicate spaces * fix: correct components for russian distribution * fix: proxy for russian distribution * feat: universal distr for ru * feat: universal distr for ru * fix: remove extra * fix: working configs * fix: configs * feat: ruxglm prompted dists * fix: component cards * fix: container name * fix: remove extra space after new line * fix: remove extra space after new line * feat: tests for dream ruxglm * fix: proxy and ru lang * fix: change port of universal ru * fix: rights on file * fix: tests skills * fix: test for resp selector * fix: tests for proxied components * feat: rugpt-3.5 by sber in universal russian distribution * fix; wait for it * fix: models card * fix: models card * fix: add to list * fix: change port * fix: change port * fix: change size to correct * feat: instruction how to add a new model * fix ru prompt selector, remove unused component (#538) * feat: replace oasst12b with gptjt (#541) * Feat/utilize rugpt35 (#540) * feat: utilize rugpt35 * feat: tests for jounrlist rugpt35 * feat: tests for jounrlist rugpt35 * fix: rights for tfile * feat: names * fix: ru_dists_names_and_prompts (#543) * rename ruxglm to u * more renaming * tabs * tabs * some more renaming * short prompt * many cards and name changes * fix typo * fixes for Dilya * tiny fix * tiny fix * huge name check * names * typo prompt * fix: no tests for non existing skills --------- Co-authored-by: dilyararimovna <dilyara.rimovna@gmail.com> * fix: cards for ru dists (#544) * fix: rugpt35 config and envs (#546) * Summarization models (#393) * Added abstractive summarization model for English texts * Added abstractive summarization model for Russian texts * Added summarization annotator * Moved rut5 summarizer to dream_russian * Changed endpoint * Added model path to Dockerfile * Updated test * Updated summarization annotator input * Updated test * Changed summarization service url * Changed test * Increased timeout * Updated ram_usage * Updated ports * Updated models cards * Added more info messages * Fixed path error * Added summarization output to bot attributes * Added timeout param to dockerfile * Updated model cards and ports * Fixed problem with incorrect batch processing * Updated summarization save format * Updated dialog summarization model * Updated tests * Minor formatting changes * Fixed black and flake8 codestyle * Fixed black codestyle * Updated models ports * Small fixes * Models table upd (#539) * Fix requirements.txt (#84) * fix itsdangerous requirements * pin itsdangerous requirements for all flask==1.1.1 servers * updated MODELS.md table: added info about models' licensing and commercial use + merged link+name cols to improve overall readability and decrease redundancy * Update MODELS.md fixed "is" for better consistency * fix: format table and add new models back * fix: sizes of models on gpu * updated table --------- Co-authored-by: Andrii.Hura <54397922+AndriiHura@users.noreply.github.com> Co-authored-by: mtalimanchuk <mtalimanchuk@gmail.com> Co-authored-by: Dilyara Baymurzina <dilyara.rimovna@gmail.com> * fix: anthropic model params (#547) * fix summarization annotator card (#549) * add cards for prompted robot * ports and n_utt * port * increase WAIT_HOSTS_TIMEOUT in cards --------- Co-authored-by: Dilyara Zharikova (Baymurzina) <dilyara.rimovna@gmail.com> Co-authored-by: Maxim Talimanchuk <mtalimanchuk@gmail.com> Co-authored-by: Nikolay <99244955+Kolpnick@users.noreply.github.com> Co-authored-by: Anastásis <43078815+nstsj@users.noreply.github.com> Co-authored-by: Andrii.Hura <54397922+AndriiHura@users.noreply.github.com>
oserikov
pushed a commit
that referenced
this pull request
Nov 21, 2024
* feat: ignore env secret ru * feat: add access token * feat: distribution ruxglm * fix: ruxglm cards * fix: use use_auth_token * fix: eos tokens type * fix: stats cpu ram * fix: skills cards * fix: components cards * fix: eos tokens * fix: eos tokens * fix: eos tokens * fix: eos tokens * fix: cards and table * fix: ADDITIONAL_EOS_TOKENS * fix: ADDITIONAL_EOS_TOKENS * fix: codestyle * fix: universal * fix: dream persona ru skill name * fix: prompt selector ru * fix: replacement * fix: prompt selecrto * fix: use params * fix: timeout and history * fix: trye very short persona * fix: increase timeout * fix: sub replacement tokens correctly * fix: sub replacement tokens correctly * fix: use stopping criteria * fix: typing * fix: revert long persona * fix: duplicate spaces * fix: correct components for russian distribution * fix: proxy for russian distribution * feat: universal distr for ru * feat: universal distr for ru * fix: remove extra * fix: working configs * fix: configs * feat: ruxglm prompted dists * fix: component cards * fix: container name * fix: remove extra space after new line * fix: remove extra space after new line * feat: tests for dream ruxglm * fix: proxy and ru lang * fix: change port of universal ru * fix: rights on file * fix: tests skills * fix: test for resp selector * fix: tests for proxied components * fix: remove do sample true * fix: generative params * feat: used sentence ranker url * feat: utilized default llm
oserikov
pushed a commit
that referenced
this pull request
Nov 21, 2024
* robot first commit (no cards) * feat: do not use sentence ranker url from env (#535) * Feat/ruxglm prompted dist (#528) * feat: ignore env secret ru * feat: add access token * feat: distribution ruxglm * fix: ruxglm cards * fix: use use_auth_token * fix: eos tokens type * fix: stats cpu ram * fix: skills cards * fix: components cards * fix: eos tokens * fix: eos tokens * fix: eos tokens * fix: eos tokens * fix: cards and table * fix: ADDITIONAL_EOS_TOKENS * fix: ADDITIONAL_EOS_TOKENS * fix: codestyle * fix: universal * fix: dream persona ru skill name * fix: prompt selector ru * fix: replacement * fix: prompt selecrto * fix: use params * fix: timeout and history * fix: trye very short persona * fix: increase timeout * fix: sub replacement tokens correctly * fix: sub replacement tokens correctly * fix: use stopping criteria * fix: typing * fix: revert long persona * fix: duplicate spaces * fix: correct components for russian distribution * fix: proxy for russian distribution * feat: universal distr for ru * feat: universal distr for ru * fix: remove extra * fix: working configs * fix: configs * feat: ruxglm prompted dists * fix: component cards * fix: container name * fix: remove extra space after new line * fix: remove extra space after new line * feat: tests for dream ruxglm * fix: proxy and ru lang * fix: change port of universal ru * fix: rights on file * fix: tests skills * fix: test for resp selector * fix: tests for proxied components * fix: remove do sample true * fix: generative params * feat: used sentence ranker url * feat: utilized default llm * Feat/ru prompted dists (#532) * feat: ignore env secret ru * feat: add access token * feat: distribution ruxglm * fix: ruxglm cards * fix: use use_auth_token * fix: eos tokens type * fix: stats cpu ram * fix: skills cards * fix: components cards * fix: eos tokens * fix: eos tokens * fix: eos tokens * fix: eos tokens * fix: cards and table * fix: ADDITIONAL_EOS_TOKENS * fix: ADDITIONAL_EOS_TOKENS * fix: codestyle * fix: universal * fix: dream persona ru skill name * fix: prompt selector ru * fix: replacement * fix: prompt selecrto * fix: use params * fix: timeout and history * fix: trye very short persona * fix: increase timeout * fix: sub replacement tokens correctly * fix: sub replacement tokens correctly * fix: use stopping criteria * fix: typing * fix: revert long persona * fix: duplicate spaces * fix: correct components for russian distribution * fix: proxy for russian distribution * feat: universal distr for ru * feat: universal distr for ru * fix: remove extra * fix: working configs * fix: configs * feat: ruxglm prompted dists * fix: component cards * fix: container name * first dist (no cards) * fix: remove extra space after new line * fix: remove extra space after new line * feat: tests for dream ruxglm * fix: proxy and ru lang * fix: change port of universal ru * fix: rights on file * fix: tests skills * fix: test for resp selector * multiskill_ru_assistant * fix: tests for proxied components * fairytale and action stories dists * journalist helper dist * fairytale fixes * one more fix * action stories cards * add quotation marks * fairytale cards * storyteller cards * journalist helper cards * multiskill ru cards * agent services cards * minor fixes * fix: utilize sentence ranker url --------- Co-authored-by: dilyararimovna <dilyara.rimovna@gmail.com> * update components.tsv (#537) * update components.tsv * tabulation * Feat/rugpt 3.5 distribution (#534) * feat: ignore env secret ru * feat: add access token * feat: distribution ruxglm * fix: ruxglm cards * fix: use use_auth_token * fix: eos tokens type * fix: stats cpu ram * fix: skills cards * fix: components cards * fix: eos tokens * fix: eos tokens * fix: eos tokens * fix: eos tokens * fix: cards and table * fix: ADDITIONAL_EOS_TOKENS * fix: ADDITIONAL_EOS_TOKENS * fix: codestyle * fix: universal * fix: dream persona ru skill name * fix: prompt selector ru * fix: replacement * fix: prompt selecrto * fix: use params * fix: timeout and history * fix: trye very short persona * fix: increase timeout * fix: sub replacement tokens correctly * fix: sub replacement tokens correctly * fix: use stopping criteria * fix: typing * fix: revert long persona * fix: duplicate spaces * fix: correct components for russian distribution * fix: proxy for russian distribution * feat: universal distr for ru * feat: universal distr for ru * fix: remove extra * fix: working configs * fix: configs * feat: ruxglm prompted dists * fix: component cards * fix: container name * fix: remove extra space after new line * fix: remove extra space after new line * feat: tests for dream ruxglm * fix: proxy and ru lang * fix: change port of universal ru * fix: rights on file * fix: tests skills * fix: test for resp selector * fix: tests for proxied components * feat: rugpt-3.5 by sber in universal russian distribution * fix; wait for it * fix: models card * fix: models card * fix: add to list * fix: change port * fix: change port * fix: change size to correct * feat: instruction how to add a new model * fix ru prompt selector, remove unused component (#538) * feat: replace oasst12b with gptjt (#541) * Feat/utilize rugpt35 (#540) * feat: utilize rugpt35 * feat: tests for jounrlist rugpt35 * feat: tests for jounrlist rugpt35 * fix: rights for tfile * feat: names * fix: ru_dists_names_and_prompts (#543) * rename ruxglm to u * more renaming * tabs * tabs * some more renaming * short prompt * many cards and name changes * fix typo * fixes for Dilya * tiny fix * tiny fix * huge name check * names * typo prompt * fix: no tests for non existing skills --------- Co-authored-by: dilyararimovna <dilyara.rimovna@gmail.com> * fix: cards for ru dists (#544) * fix: rugpt35 config and envs (#546) * Summarization models (#393) * Added abstractive summarization model for English texts * Added abstractive summarization model for Russian texts * Added summarization annotator * Moved rut5 summarizer to dream_russian * Changed endpoint * Added model path to Dockerfile * Updated test * Updated summarization annotator input * Updated test * Changed summarization service url * Changed test * Increased timeout * Updated ram_usage * Updated ports * Updated models cards * Added more info messages * Fixed path error * Added summarization output to bot attributes * Added timeout param to dockerfile * Updated model cards and ports * Fixed problem with incorrect batch processing * Updated summarization save format * Updated dialog summarization model * Updated tests * Minor formatting changes * Fixed black and flake8 codestyle * Fixed black codestyle * Updated models ports * Small fixes * Models table upd (#539) * Fix requirements.txt (#84) * fix itsdangerous requirements * pin itsdangerous requirements for all flask==1.1.1 servers * updated MODELS.md table: added info about models' licensing and commercial use + merged link+name cols to improve overall readability and decrease redundancy * Update MODELS.md fixed "is" for better consistency * fix: format table and add new models back * fix: sizes of models on gpu * updated table --------- Co-authored-by: Andrii.Hura <54397922+AndriiHura@users.noreply.github.com> Co-authored-by: mtalimanchuk <mtalimanchuk@gmail.com> Co-authored-by: Dilyara Baymurzina <dilyara.rimovna@gmail.com> * fix: anthropic model params (#547) * fix summarization annotator card (#549) * add cards for prompted robot * ports and n_utt * port * increase WAIT_HOSTS_TIMEOUT in cards --------- Co-authored-by: Dilyara Zharikova (Baymurzina) <dilyara.rimovna@gmail.com> Co-authored-by: Maxim Talimanchuk <mtalimanchuk@gmail.com> Co-authored-by: Nikolay <99244955+Kolpnick@users.noreply.github.com> Co-authored-by: Anastásis <43078815+nstsj@users.noreply.github.com> Co-authored-by: Andrii.Hura <54397922+AndriiHura@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.