Skip to content

Commit

Permalink
Removed add_prefix_space parameter for now
Browse files Browse the repository at this point in the history
This is a temporary change that must be reverted once the issue
huggingface/transformers#32682 is solved for
me. This quick fix allow an experimental release to test llama models
and assisted generation
  • Loading branch information
Lyaaaaaaaaaaaaaaa committed Aug 15, 2024
1 parent d50da72 commit 3610d82
Showing 1 changed file with 3 additions and 2 deletions.
5 changes: 3 additions & 2 deletions server/model.py
Original file line number Diff line number Diff line change
Expand Up @@ -351,8 +351,9 @@ def _load(self):
def _load_tokens(self):
try:
self._Tokenizer = AutoTokenizer.from_pretrained(
self._model_path,
add_prefix_space=True
self._model_path
#add_prefix_space=True #TODO Uncomment it. Parameter needed for banned word list.
# TODO This problem must be fixed before stable release. See error https://github.com/huggingface/transformers/issues/32682
)
except Exception as e:
logger.log.error("Error loading tokens in " + self._model_path)
Expand Down

0 comments on commit 3610d82

Please sign in to comment.