Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

llama : update llm_build_copy_mask_state comment [no ci] #9385

Merged

Commits on Sep 9, 2024

  1. llama : update llm_build_copy_mask_state comment

    This commit updates the comment, which seems to contain a typo or be an
    outdated comment, in the copy_mask_state function changing the variable
    n_rs to n_kv.
    
    I believe this change is correct and what the comment wants to
    convey is to copy the states that are not going to be used in the
    upcoming processing, which are the tokens states from n_seqs up to
    the number of possible token states n_kv.
    danbev committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    bfeb2f5 View commit details
    Browse the repository at this point in the history