Docs: Insert eval_collector.data_collect when evaluate from checkpoint (calculate ItemCoverage) #1364
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Hi
When I added ItemCoverage to my metrics config and ran trainer.evaluate from checkpoint, I got the following error.
After reviewing the code, I think the code in the documentation would not set
data.item_nums
to eval_collector, resulting in the above error.I inserted the code
trainer.eval_collector.data_collect(train_data)
and ran it again, then it worked.So, in this PR, I propose to insert this code in
we present how to test a model based on the previous saved parameters.
section (use_modules.rst
).