hpcaitech ColossalAI · Discussions · GitHub

Sort by: Latest activity

Discussions

You must be logged in to vote

chatgpt 第三阶段代码实现上的疑问

hust-kevin asked Mar 10, 2023 in Community | Q&A · Unanswered

10
You must be logged in to vote

PPO is on-policy, but its training used a replay buffer?

houghtonweihu started Mar 31, 2023 in Community | General · Closed

3
You must be logged in to vote

Coati SFT Training Process stack in "[extension] Compiling or loading the JIT-built cpu_adam kernel during runtime now"

linmou asked Apr 6, 2023 in Community | Q&A · Unanswered

2
You must be logged in to vote

Gemini的zero方案可以初始化出gpt3级别的模型么？

yhcc asked Jan 14, 2023 in Community | Q&A · Unanswered

7
You must be logged in to vote

does ColossalAI support tensorflow?

robin-ai-ml asked Apr 10, 2023 in Community | Q&A · Unanswered

2
You must be logged in to vote

ColossalAI check failed

forestbat asked Apr 2, 2023 in Community | Q&A · Unanswered

1
You must be logged in to vote

Is there a solution&demo to use all features include PP+TP+DP+ZeRO?

xinghua3632 started Apr 1, 2023 in Community | General

1
You must be logged in to vote

Request of supporting on mac

Jarvis-depot asked Apr 1, 2023 in Community | Q&A · Unanswered

1
You must be logged in to vote

commerical use

janglichao asked Apr 7, 2023 in Community | Q&A · Answered

1
You must be logged in to vote

在第三阶段train_prompts.sh脚本中有命令torchrun --standalone --nproc_per_node=1 train_prompts.py prompts.csv --strategy colossalai_zero2

zhixingheyier asked Mar 31, 2023 in Community | Q&A · Unanswered

2
You must be logged in to vote

If the chatgpt rlhf trainning example Support shardint +tp + lora?

taishiciR asked Mar 29, 2023 in Community | Q&A · Unanswered

2
You must be logged in to vote

关于数据集的疑问

Stark-zheng asked Mar 31, 2023 in Community | Q&A · Unanswered

1
You must be logged in to vote

how to save checkpoint in train_gpt_demo

hmzo asked Feb 16, 2023 in Community | Q&A · Unanswered

3
You must be logged in to vote

[PROPOSAL]: refactor the core API for better usability
API related to API changes welcome contribution Any interested community member can join this project
FrankLeeeee started Mar 8, 2023 in Development | Core

7
You must be logged in to vote

[PROPOSAL]: Build a modern & robust documentation system
documentation Improvements or additions to documentation welcome contribution Any interested community member can join this project
FrankLeeeee started Mar 7, 2023 in Development | User Experience

4
You must be logged in to vote

Why are Chat's Critic model parameters updated with Actor's parameters?

yynil started Apr 2, 2023 in Community | Ideas

2
You must be logged in to vote

'ColossalAI/examples/language/gpt' and 'ColossalAI-Examples/language/gpt' which is the latest demo?

xinghua3632 started Apr 1, 2023 in Community | General · Closed

1
You must be logged in to vote

[PROPOSAL]: unify the access interface to different devices, such as CPU, GPU, XPU

ftian1 started Mar 30, 2023 in Development | Core

2
You must be logged in to vote

使用tensor_parallelize训练bloom，仅保存了分片之后的参数

yangjianxin1 asked Mar 25, 2023 in Community | Q&A · Unanswered

3
You must be logged in to vote

How to save/load model

yiqiang-zhao asked Nov 10, 2022 in Community | Q&A · Unanswered

5
You must be logged in to vote

Approximately how long it takes to train GPT2 with a single RTX3090?

mircop1t asked Mar 25, 2023 in Community | Q&A · Unanswered

1
You must be logged in to vote

ColossalChat tends to defend on its FAKE knowledge and still be authoritative.

pps43 started Mar 30, 2023 in Community | General

1
You must be logged in to vote

An error when runned applications/ChatGPT/examples/train_sft.py

guijuzhejiang asked Mar 23, 2023 in Community | Q&A · Unanswered

1
You must be logged in to vote

GPT throughput (v.s. Megatron-LM)

yurishin929 asked Feb 21, 2023 in Community | Q&A · Unanswered

4
You must be logged in to vote

how to write a distributed application in kubernetes

SamaelChen asked Mar 23, 2023 in Community | Q&A · Unanswered

1