Skip to content
This repository has been archived by the owner on Jan 27, 2024. It is now read-only.

[UNK] token in the test translation #4

Open
izaskrj opened this issue Oct 29, 2019 · 0 comments
Open

[UNK] token in the test translation #4

izaskrj opened this issue Oct 29, 2019 · 0 comments

Comments

@izaskrj
Copy link

izaskrj commented Oct 29, 2019

I preprocessed the data and trained a model using the suggested configurations. The model generated some [UNK] tokens in the test translation.

I am wondering how that is possible given that with BPE, there are should be no [UNK].
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@izaskrj