Skip to content

Commit

Permalink
[Cleanup] Organize run_llama_train.sh options
Browse files Browse the repository at this point in the history
Just a little code motion but it looks cleaner to me this way

ghstack-source-id: 055fbd557cd9cf189e6b9bd6a7048f1204e1dc5c
Pull Request resolved: pytorch#454
  • Loading branch information
wconstab committed Jul 15, 2024
1 parent 6250b0d commit 394a0bc
Showing 1 changed file with 1 addition and 7 deletions.
8 changes: 1 addition & 7 deletions run_llama_train.sh
Original file line number Diff line number Diff line change
Expand Up @@ -7,19 +7,13 @@

set -ex

TRAINER_DIR=${TRAINER_DIR:-/home/$USER/local/torchtitan}

# use envs as local overrides for convenience
# e.g.
# LOG_RANK=0,1 NGPU=4 ./run_llama_train.sh

NGPU=${NGPU:-"8"}
NNODES=${NNODES:-"1"}

# by default log just rank 0 output,
TRAINER_DIR=${TRAINER_DIR:-/home/$USER/local/torchtitan}
LOG_RANK=${LOG_RANK:-0}


CONFIG_FILE=${CONFIG_FILE:-"./train_configs/debug_model.toml"}

overrides=""
Expand Down

0 comments on commit 394a0bc

Please sign in to comment.