Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how to generate this file bert_arb_conll12_features.hdf5 ? #6

Open
aymen-souid opened this issue Dec 6, 2021 · 13 comments
Open

how to generate this file bert_arb_conll12_features.hdf5 ? #6

aymen-souid opened this issue Dec 6, 2021 · 13 comments

Comments

@aymen-souid
Copy link

No description provided.

@juntaoy
Copy link
Owner

juntaoy commented Dec 6, 2021

You will need to use the extract_bert_features.sh, and for doing this you will need provide the arabert 0.1 in tensorflow format

@aymen-souid
Copy link
Author

i think that I've run it successfully , after that I used python evaluate.py arabic_cleaned_bert, and I got this error,
do you have any idea about this issue ?

Screenshot from 2021-12-06 12-39-39

@juntaoy
Copy link
Owner

juntaoy commented Dec 6, 2021

So for the checkpoint_path you need to remove ".index"

@aymen-souid
Copy link
Author

it doesn't seem to be resolved even after removing ".index"
Screenshot from 2021-12-06 14-27-56

@juntaoy
Copy link
Owner

juntaoy commented Dec 6, 2021

There is no error for your new run, it seems you terminated the system manually

@juntaoy
Copy link
Owner

juntaoy commented Dec 6, 2021

It might be a problem with your predict.py, as my code do not print anything liked killed:)

@aymen-souid
Copy link
Author

the "killed" issue was resolved when i restart my PC
but you can have a look at this one ,I can't understand the mismatch between the graph or the problem between the tensors ?

Screenshot from 2021-12-07 11-23-26
Screenshot from 2021-12-07 11-23-31

@juntaoy
Copy link
Owner

juntaoy commented Dec 7, 2021

This is the character embedding, if you use my pre-trained model you need to use the same char_vocab.arabic.txt provided

@aymen-souid
Copy link
Author

i have checked that, but still exactly same error,
is it possible that because you've used another version of arabert ?
I'm using the version uploaded in hugging face "bert-base-arabertv01"

@juntaoy
Copy link
Owner

juntaoy commented Dec 7, 2021

From what I can tell this should be a problem for the character embedding:)

@aymen-souid
Copy link
Author

I made some modifications to the paths in experiment.conf

and I got this error ,any idea how to solve it ?
Screenshot from 2021-12-07 12-59-02
Screenshot from 2021-12-07 12-59-09

@juntaoy
Copy link
Owner

juntaoy commented Dec 7, 2021

I haven't seen this type of error before.

@aymen-souid
Copy link
Author

this error occured when i modified the char_vocab_file in model hyperparameter (in experment.conf), do I need to put the path of the vocab.txt of the arabert or the path of your pretrained model? (this error occurred when I've put the the path of your model) ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants