YAYI 2 是中科闻歌研发的新一代开源大语言模型，采用了超过 2 万亿 Tokens 的高质量、多语言语料进行预训练。(Repo for YaYi 2 Chinese LLMs)
-
Updated
Apr 7, 2024 - Python
#
pretrained-language-model
Here are 89 public repositories matching this topic...
Foundation Architecture for (M)LLMs
machine-learning natural-language-processing translation computer-vision transformer speech-processing multimodal pretrained-language-model
-
Updated
Apr 11, 2024 - Python
A curated list of pretrained sentence and word embedding models
nlp awesome natural-language word-embeddings awesome-list pretrained-models unsupervised-learning embedding-models language-model bert cross-lingual wordembedding sentence-embeddings pretrained-embedding sentence-representations contextualized-representation pretrained-language-model subword-models
-
Updated
Apr 23, 2021 - Python
An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks
natural-language-processing pretrained-language-model prompt-tuning p-tuning parameter-efficient-learning
-
Updated
Nov 16, 2023 - Python
A plug-and-play library for parameter-efficient-tuning (Delta Tuning)
-
Updated
Sep 19, 2024 - Python
中文法律LLaMA (LLaMA for Chinese legel domain)
-
Updated
Aug 28, 2024 - Python
Code associated with the Don't Stop Pretraining ACL 2020 paper
-
Updated
Nov 15, 2021 - Python
Live Training for Open-source Big Models
nlp natural-language-processing deep-learning natural-language-generation natural-language-understanding multi-task-learning pretrained-language-model parameter-efficient-learning
-
Updated
May 30, 2023 - Python
Papers and Datasets on Instruction Tuning and Following. ✨✨✨
prompt survey awesome-list datasets instruction paper-list pretrained-language-model in-context-learning large-language-models instruction-tuning instruction-learning
-
Updated
Apr 4, 2024 - Python
ACL'2023: DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models
text-generation bert diffusion-models pretrained-language-model conditional-generation unconditional-generation
-
Updated
Feb 17, 2024 - Python
MWPToolkit is an open-source framework for math word problem(MWP) solvers.
deep-learning pytorch sequence-to-sequence pretrained-language-model graph-to-tree sequence-to-tree math-word-problem
-
Updated
Sep 28, 2022 - Python
[NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.
natural-language-processing text-classification zero-shot-learning pretrained-language-model training-data-generation attributed-text data-centric-ai large-language-models
-
Updated
Nov 2, 2023 - Python
[NeurIPS 2021] COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining
natural-language-processing deep-learning transformers representation-learning language-model natural-language-understanding pretraining pretrained-language-model contrastive-learning
-
Updated
Jul 25, 2023 - Python
On Transferability of Prompt Tuning for Natural Language Processing
nlp prompt pytorch transfer-learning pretrained-models pretrained-language-model pretrained-language-models prompt-tuning parameter-efficient-learning parameter-efficient-tuning
-
Updated
May 3, 2024 - Python
BERT4ETH: A Pre-trained Transformer for Ethereum Fraud Detection (WWW23)
ethereum blockchain transformer bert fraud-detection deanonymization phishing-detection pretrained-language-model www2023
-
Updated
Jun 21, 2024 - Python
The official code for "TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecasting (ICLR 2024)". TEMPO is one of the very first open source Time Series Foundation Models for forecasting task v1.0 version.
time-series transformers transformer forecasting gpt pretrained-models forecasting-models time-series-analysis pretrained-language-model forecasting-time-series transformers-models foundation-models
-
Updated
Nov 30, 2024 - Python
[WWW 2022] Topic Discovery via Latent Space Clustering of Pretrained Language Model Representations
-
Updated
Feb 10, 2022 - Python
[KDD22] Official PyTorch implementation for "Towards Unified Conversational Recommender Systems via Knowledge-Enhanced Prompt Learning".
dialogue dialog prompt conversation recommender-system recommendation pretrained-models dialogue-systems prompts conversational-bots conversational-ai pretraining pretrained-language-model prompt-tuning
-
Updated
Jan 10, 2025 - Python
CODER: Knowledge infused cross-lingual medical term embedding for term normalization. [JBI, ACL-BioNLP 2022]
-
Updated
Jun 28, 2022 - Python
Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty
text-generation pytorch hypothesis-generation pretrained-language-model gpt4 llm retrieval-augmented-generation acl2024
-
Updated
Apr 13, 2024 - Python
Improve this page
Add a description, image, and links to the pretrained-language-model topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the pretrained-language-model topic, visit your repo's landing page and select "manage topics."