Skip to content
This repository has been archived by the owner on Mar 3, 2024. It is now read-only.

Does it compatible with Chinese pre-trained model? #13

Closed
Flyfoxs opened this issue Aug 27, 2019 · 5 comments
Closed

Does it compatible with Chinese pre-trained model? #13

Flyfoxs opened this issue Aug 27, 2019 · 5 comments
Assignees
Labels
bug Something isn't working

Comments

@Flyfoxs
Copy link

Flyfoxs commented Aug 27, 2019

I try it, and not exception. but the accuracy is very low. So not sure it support Chinese pretrained mode or not.
https://github.com/ymcui/Chinese-PreTrained-XLNet

@Flyfoxs Flyfoxs added the bug Something isn't working label Aug 27, 2019
@lsq357
Copy link

lsq357 commented Aug 28, 2019

@Flyfoxs Which dataset and how encode text to spiece ?

@Flyfoxs
Copy link
Author

Flyfoxs commented Aug 28, 2019

use the dict in this link, the dict is include in the pretrain model https://github.com/ymcui/Chinese-PreTrained-XLNet

you can find the pretrain mode in this link: https://drive.google.com/open?id=1342uBc7ZmQwV6Hm6eUIN_OnBSz1LcvfA

@stale
Copy link

stale bot commented Sep 2, 2019

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@stale stale bot added the wontfix This will not be worked on label Sep 2, 2019
@CyberZHG CyberZHG removed the wontfix This will not be worked on label Sep 3, 2019
@CyberZHG
Copy link
Owner

CyberZHG commented Sep 3, 2019

@Flyfoxs

The Chinese version uses a different activation function for feed-forward layers. You can upgrade to 0.17.0 and the outputs will be the same in this demo.

@CyberZHG CyberZHG changed the title dose it compatible with this pretrain mode Does it compatible with Chinese pre-trained model? Sep 3, 2019
@CyberZHG CyberZHG pinned this issue Sep 3, 2019
@Flyfoxs
Copy link
Author

Flyfoxs commented Sep 6, 2019

thanks . so much

@CyberZHG CyberZHG closed this as completed Sep 9, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants