Skip to content

Latest commit

 

History

History
6 lines (6 loc) · 395 Bytes

README.md

File metadata and controls

6 lines (6 loc) · 395 Bytes

How to finetune a new Hugging Face model

Using the DBRX yaml as a template, change the following fields for the new model:

  • max_seq_len
  • model/pretrained_model_name_or_path
  • tokenizer/name Open a GitHub issue if these steps don't work. Most new causal LMs should work out of the box.