Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added names of less-studied languages #4880

Merged
merged 2 commits into from
Aug 24, 2022

Conversation

BenjaminGalliot
Copy link
Contributor

Added names of less-studied languages (nru – Narua and jya – Japhug) for existing datasets.

Copy link
Member

@albertvillanova albertvillanova left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the addition, @BenjaminGalliot.

Just a suggested fix below.

src/datasets/utils/resources/languages.json Outdated Show resolved Hide resolved
Added names of less studied languages (with their Glottolog codes) for existing datasets: Yongning Na (yong1288) and Japhug (japh1234).
Copy link
Member

@albertvillanova albertvillanova left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As pointed out in my comment below, currently we are using IANA language codes, not Glottolog codes.

Also note that in each dataset card, besides the language tag (validated against this file languages.json), users can use other tags to give further details about the language:

  • language_bcp47: to list BCP47 language tags, plus any of the allowed suffixes (script, region, variant,...)
  • language_details: to give further details

src/datasets/utils/resources/languages.json Outdated Show resolved Hide resolved
src/datasets/utils/resources/languages.json Show resolved Hide resolved
src/datasets/utils/resources/languages.json Outdated Show resolved Hide resolved
@BenjaminGalliot
Copy link
Contributor Author

OK, I removed Glottolog codes and only added ISO 639-3 ones. The former are for the moment in corpus card description, language details, and in subcorpora names.

Copy link
Member

@albertvillanova albertvillanova left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks.

@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants