Codes for VPGTrans: Transfer Visual Prompt Generator across LLMs. VL-LLaMA, VL-Vicuna.
-
Updated
Oct 13, 2023 - Python
#
large-scale-language-modeling
Here are 2 public repositories matching this topic...
Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
transformers moe data-parallelism distributed-optimizers model-parallelism megatron mixture-of-experts pipeline-parallelism huggingface-transformers megatron-lm tensor-parallelism large-scale-language-modeling 3d-parallelism zero-1 sequence-parallelism
-
Updated
Dec 14, 2023 - Python
Improve this page
Add a description, image, and links to the large-scale-language-modeling topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the large-scale-language-modeling topic, visit your repo's landing page and select "manage topics."