Skip to content

Commit

Permalink
examples : fix RoPE defaults to match PR #3240 (#3315)
Browse files Browse the repository at this point in the history
  • Loading branch information
cebtenzzre authored Sep 23, 2023
1 parent bedb92b commit 51a7cf5
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions common/common.h
Original file line number Diff line number Diff line change
Expand Up @@ -48,8 +48,8 @@ struct gpt_params {
float tensor_split[LLAMA_MAX_DEVICES] = {0}; // how split tensors should be distributed across GPUs
int32_t n_probs = 0; // if greater than 0, output the probabilities of top n_probs tokens.
int32_t n_beams = 0; // if non-zero then use beam search of given width.
float rope_freq_base = 10000.0f; // RoPE base frequency
float rope_freq_scale = 1.0f; // RoPE frequency scaling factor
float rope_freq_base = 0.0f; // RoPE base frequency
float rope_freq_scale = 0.0f; // RoPE frequency scaling factor

// sampling parameters
int32_t top_k = 40; // <= 0 to use vocab size
Expand Down

0 comments on commit 51a7cf5

Please sign in to comment.