Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add XTTS Fine tuning gradio demo #3296

Merged
merged 22 commits into from
Dec 1, 2023
Merged

Add XTTS Fine tuning gradio demo #3296

merged 22 commits into from
Dec 1, 2023

Conversation

Edresson
Copy link
Contributor

@Edresson Edresson commented Nov 23, 2023

This PR has the propose of making XTTS GPT encoder fine-tuning more accessible to beginners users.

It implements a gradio demo that do:

  1. Preprocessing of the uploaded audio or audio files in 🐸 TTS coqui formatter
  2. Train the XTTS GPT encoder with the processed data
  3. Inference support using the fine-tuned model

@Edresson Edresson self-assigned this Nov 23, 2023
@Edresson Edresson marked this pull request as draft November 23, 2023 20:29
@Edresson Edresson marked this pull request as ready for review November 24, 2023 15:15
@Edresson
Copy link
Contributor Author

@WeberJulian Did a Colab notebook to make it accessible for users that do not have GPU: https://colab.research.google.com/drive/1GiI4_X724M8q2W-zZ-jXo7cWTV7RfaH-?usp=sharing

We are also planning to do a video tutorial to make it easier for the beginner's users. As soon it is done we can add it on the docs and then merge it :).

@FurkanGozukara
Copy link

i was planning a tutorial and even had prepared auto data preparer and such haha :d

image

@WeberJulian
Copy link
Contributor

i was planning a tutorial and even had prepared auto data preparer and such haha :d

it's still good to have multiple ways of doing the same things, especially since it might not have the same features.
I see you have an install_TTS.bat, that would be a great addition to the main repo too.

@erogol erogol merged commit 5f900f1 into dev Dec 1, 2023
53 checks passed
@FurkanGozukara
Copy link

awesome merged into dev. i was waiting this

@daswer123
Copy link

Guys, made a modification webui that was comfortable to use locally
https://github.com/daswer123/xtts-finetune-webui

@FurkanGozukara
Copy link

Guys, made a modification webui that was comfortable to use locally https://github.com/daswer123/xtts-finetune-webui

i think they should merge your pull request all positive changes

@lpscr
Copy link

lpscr commented Dec 5, 2023

hi @Edresson
thank you for the you work,
this working with other languages it's not in list like Greece ? just to know if possible right now or need wait updates ,

thank you

@Edresson
Copy link
Contributor Author

Edresson commented Dec 6, 2023

hi @Edresson thank you for the you work, this working with other languages it's not in list like Greece ? just to know if possible right now or need wait updates ,

thank you

Hi @lpscr,

Fine-tuning only works for the supported languages. For non-supported languages it needs a couple of extra steps that are not implemented on the open-source repository.

@lpscr
Copy link

lpscr commented Dec 6, 2023

@Edresson thank you very much for the reply to know i try use with English method to replace the character Greek to English like i say in here #3229 and results its not very good , sometime it's good but most time not good, anyway , do you plan to support Greek ? i just wonder thank you very much for all your amazing work !

@erogol
Copy link
Member

erogol commented Dec 7, 2023

@lpscr we plan to support every language. But we need data. If you have some or are willing to help create some, come join our Discord and DM me.

For fine-tuning you can try transliteration Greek before passing to the model. So the available vocabulary would work that way.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants