Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Any plans for more Llama type models? #1587

Open
pass-lin opened this issue Apr 20, 2024 · 1 comment
Open

Any plans for more Llama type models? #1587

pass-lin opened this issue Apr 20, 2024 · 1 comment
Assignees
Labels
type:feature New feature or request

Comments

@pass-lin
Copy link

Is there a plan to support more models similar to llama, which only need simple modifications or even no modifications to the existing llama backbone to achieve compatibility?

for example
yi model :https://huggingface.co/01-ai This model is exactly the same as llama.
qwen model :https://huggingface.co/Qwen This model only need to modify three attention bias

Are there plans to support even larger llama models, such as the llama 70B model?

@tirthasheshpatel
Copy link
Contributor

I plan to add larger LLaMA presets in KerasNLP. No plans for Yi or Quen yet.

@sachinprasadhs sachinprasadhs added the type:feature New feature or request label Apr 23, 2024
@mattdangerw mattdangerw changed the title Any plans for more Llama stype model? Any plans for more Llama type models? May 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type:feature New feature or request
Projects
None yet
Development

No branches or pull requests

4 participants