This repository has been archived by the owner on Nov 22, 2022. It is now read-only.
Simple Transformer module components for RoBERTa #1043
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
facebook-github-bot
added
the
CLA Signed
|
This pull request was exported from Phabricator. Differential Revision: D16976484 |
bethebunny
added a commit
to bethebunny/pytext-1
that referenced
this pull request
Oct 11, 2019
Summary: Pull Request resolved: facebookresearch#1043 Simple Transformer module components that can fully implement RoBERTa. These are fully scriptable, and were used to create a single TorchScript instance of the RoBERTa encoder, but might be useful again in the future. For now I'm not adding Configs to them, I'm curious whether and how reviewers think these might be made most useful. Differential Revision: D16976484 fbshipit-source-id: 588e2827d7f4c93bea62823cefd0d01c901107a6
bethebunny
force-pushed
the
export-D16976484
branch
from
95020e6 to
c6170cf
Compare
|
This pull request was exported from Phabricator. Differential Revision: D16976484 |
bethebunny
added a commit
to bethebunny/pytext-1
that referenced
this pull request
Oct 11, 2019
Summary: Pull Request resolved: facebookresearch#1043 Simple Transformer module components that can fully implement RoBERTa. These are fully scriptable, and were used to create a single TorchScript instance of the RoBERTa encoder, but might be useful again in the future. For now I'm not adding Configs to them, I'm curious whether and how reviewers think these might be made most useful. Differential Revision: D16976484 fbshipit-source-id: 3513e814e2ee78eed029e0fe145e39da24dc79c8
bethebunny
force-pushed
the
export-D16976484
branch
from
c6170cf to
8f395dc
Compare
|
This pull request was exported from Phabricator. Differential Revision: D16976484 |
Summary: Pull Request resolved: facebookresearch#1043 Simple Transformer module components that can fully implement RoBERTa. These are fully scriptable, and were used to create a single TorchScript instance of the RoBERTa encoder, but might be useful again in the future. For now I'm not adding Configs to them, I'm curious whether and how reviewers think these might be made most useful. Differential Revision: D16976484 fbshipit-source-id: cede237440746a93b26842ac0fcecbc4b3015b29
bethebunny
force-pushed
the
export-D16976484
branch
from
8f395dc to
44044bf
Compare
|
This pull request was exported from Phabricator. Differential Revision: D16976484 |
|
This pull request has been merged in 20d6f34. |
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary: Simple Transformer module components that can fully implement RoBERTa. These are fully scriptable, and were used to create a single TorchScript instance of the RoBERTa encoder, but might be useful again in the future. For now I'm not adding Configs to them, I'm curious whether and how reviewers think these might be made most useful.
Differential Revision: D16976484