Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

【PaddlePaddle Hackathon】52、在 PaddleNLP 中完善Bert模型下游任务代码,新增Bert预训练权重 #1078

Closed
TCChenlong opened this issue Sep 23, 2021 · 1 comment
Labels

Comments

@TCChenlong
Copy link

TCChenlong commented Sep 23, 2021

(此 ISSUE 为 PaddlePaddle Hackathon 活动的任务 ISSUE,更多详见PaddlePaddle Hackathon

【任务说明】

  • 任务标题:完善Bert模型下游任务代码,新增Bert预训练权重

  • 技术标签:深度学习框架,预训练语言模型

  • 任务难度:中等

  • 详细描述:

  1. 在PaddleNLP的Bert模型代码中,新增 BertForMultipleChoice 和 BertForMaskedLM 这两个类。参考 https://github.com/huggingface/transformers/blob/master/src/transformers/models/bert/modeling_bert.py
  2. 新增 nlptown/bert-base-multilingual-uncased-sentiment,tbs17/MathBERT,ckiplab/bert-base-chinese-ner,ckiplab/bert-base-chinese-pos,ckiplab/bert-base-chinese-ws **五个*模型参*数权重。权重参考:https://huggingface.co/models ,转换文档:如何贡献模型

【提交内容】

  • 任务 PR 到 PaddleNLP(代码+注释)+ 项目单测文件
  • 任务 PR 到 PaddleNLP(贡献模型权重+权重转换代码)

【技术要求】

  • 了解PaddleNLP
  • 了解Hugging-Face transformers
  • 了解预训练语言模型
@github-actions
Copy link

github-actions bot commented Feb 9, 2023

This issue is stale because it has been open for 60 days with no activity. 当前issue 60天内无活动,被标记为stale。

@github-actions github-actions bot added the stale label Feb 9, 2023
@sijunhe sijunhe closed this as completed Feb 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

4 participants