Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs(smmf): multi-model usage and introduction #883

Merged
merged 30 commits into from
Dec 4, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
30 commits
Select commit Hold shift + click to select a range
a05cf60
feat(usage): add tests cases for dashboard
csunny Nov 22, 2023
849d409
pylint: format code style
csunny Nov 22, 2023
f188a68
chores: update contact QR code
csunny Nov 23, 2023
0a1bc2b
Merge branch 'main' into new_tt_dev
csunny Nov 23, 2023
56dd71f
chores: update wechat QR code
csunny Nov 23, 2023
c3a1ed5
Merge branch 'main' into new_tt_dev
csunny Nov 27, 2023
a057e33
docs: rewrite docs use docusaurus
csunny Nov 27, 2023
4ef0038
Merge branch 'new_tt_dev' of github.com:eosphoros-ai/DB-GPT into new_…
junewgl Nov 27, 2023
1ad81ed
docs: new docs address reference
csunny Nov 27, 2023
53b0722
Merge branch 'main' into new_tt_dev
csunny Nov 27, 2023
7c09aff
docs: reference new docs
csunny Nov 27, 2023
1a739ab
docs: update doc content
junewgl Nov 27, 2023
346e0b6
Merge branch 'new_tt_dev' of github.com:eosphoros-ai/DB-GPT into new_…
junewgl Nov 27, 2023
bca701e
docs: optimize model deployment layout
junewgl Nov 27, 2023
04e780c
Merge branch 'main' into new_tt_dev
csunny Nov 28, 2023
c68bffa
docs: change logo to svg
csunny Nov 28, 2023
9919cd3
docs: add img border
junewgl Nov 28, 2023
911b47d
Merge branch 'main' into new_tt_dev
csunny Nov 28, 2023
855870a
Merge branch 'main' into new_tt_dev
csunny Nov 29, 2023
a3eb799
chores: clean extra cache code and update contact info
csunny Nov 29, 2023
edd2463
chores: wechat QR code update
csunny Nov 30, 2023
e636539
fix conflicts:
csunny Nov 30, 2023
d4bf7b5
docs(Model): add multi-model Operation Manual
csunny Nov 30, 2023
7d45c52
docs(smmf): multi-model useage and introduction
csunny Nov 30, 2023
4bfcb24
docs: add StarRocks connections
csunny Dec 1, 2023
c7a25a1
fix: conflicts fix and + new LLMs
csunny Dec 1, 2023
9e43ae4
Merge branch 'main' into new_tt_dev
csunny Dec 1, 2023
7e605f9
chores: remove extra images
csunny Dec 1, 2023
15b218c
fix: change docs address to new
csunny Dec 2, 2023
a324dd8
Merge branch 'main' into new_tt_dev
csunny Dec 4, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@
</p>


[**简体中文**](README.zh.md) | [**Discord**](https://discord.gg/7uQnPuveTY) | [**Documents**](https://db-gpt.readthedocs.io/en/latest/) | [**Wechat**](https://github.com/eosphoros-ai/DB-GPT/blob/main/README.zh.md#%E8%81%94%E7%B3%BB%E6%88%91%E4%BB%AC) | [**Community**](https://github.com/eosphoros-ai/community)
[**简体中文**](README.zh.md) | [**Discord**](https://discord.gg/7uQnPuveTY) | [**Documents**](https://docs.dbgpt.site) | [**Wechat**](https://github.com/eosphoros-ai/DB-GPT/blob/main/README.zh.md#%E8%81%94%E7%B3%BB%E6%88%91%E4%BB%AC) | [**Community**](https://github.com/eosphoros-ai/community)
</div>

## What is DB-GPT?
Expand Down Expand Up @@ -205,9 +205,9 @@ The core capabilities primarily consist of the following components:
- [ ] StarRocks

### Multi-Models And vLLM
- [x] [Cluster Deployment](https://db-gpt.readthedocs.io/en/latest/getting_started/install/cluster/vms/index.html)
- [x] [Cluster Deployment](https://docs.dbgpt.site/docs/installation/model_service/cluster)
- [x] [Fastchat Support](https://github.com/lm-sys/FastChat)
- [x] [vLLM Support](https://db-gpt.readthedocs.io/en/latest/getting_started/install/llm/vllm/vllm.html)
- [x] [vLLM Support](https://docs.dbgpt.site/docs/installation/advanced_usage/vLLM_inference)
- [ ] Cloud-native environment and support for Ray environment
- [ ] Service Registry(eg:nacos)
- [ ] Compatibility with OpenAI's interfaces
Expand All @@ -223,7 +223,7 @@ The core capabilities primarily consist of the following components:
- [ ] Integration of multi-agents and visualization capabilities, defining LLM+Vis new standards

### Cost and Observability
- [x] [debugging](https://db-gpt.readthedocs.io/en/latest/getting_started/observability.html)
- [x] [debugging](https://docs.dbgpt.site/docs/application_manual/advanced_tutorial/debugging)
- [ ] Observability
- [ ] cost & budgets

Expand Down
30 changes: 12 additions & 18 deletions README.zh.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@
</a>
</p>

[**English**](README.md)|[**Discord**](https://discord.gg/7uQnPuveTY)|[**文档**](https://db-gpt.readthedocs.io/projects/db-gpt-docs-zh-cn/zh_CN/latest/)|[**微信**](https://github.com/csunny/DB-GPT/blob/main/README.zh.md#%E8%81%94%E7%B3%BB%E6%88%91%E4%BB%AC)|[**社区**](https://github.com/eosphoros-ai/community)
[**English**](README.md)|[**Discord**](https://discord.gg/7uQnPuveTY)|[**文档**](https://www.yuque.com/eosphoros/dbgpt-docs/bex30nsv60ru0fmx)|[**微信**](https://github.com/csunny/DB-GPT/blob/main/README.zh.md#%E8%81%94%E7%B3%BB%E6%88%91%E4%BB%AC)|[**社区**](https://github.com/eosphoros-ai/community)
</div>

## DB-GPT 是什么?
Expand Down Expand Up @@ -59,10 +59,6 @@ DB-GPT是一个开源的数据库领域大模型框架。目的是构建大模
![excel](https://github.com/eosphoros-ai/DB-GPT/assets/13723926/3044e83b-a71e-41fe-a1e2-98e479e0ab59)

#### 根据自然语言对话生成分析图表
<p align="left">
<img src="./assets/chat_excel/chat_excel_6.png" width="800px" />
</p>

<p align="left">
<img src="./assets/dashboard.png" width="800px" />
</p>
Expand All @@ -79,14 +75,14 @@ DB-GPT是一个开源的数据库领域大模型框架。目的是构建大模
- [**源码安装**](https://www.yuque.com/eosphoros/dbgpt-docs/urh3fcx8tu0s9xmb)
- [**Docker安装**](https://www.yuque.com/eosphoros/dbgpt-docs/glf87qg4xxcyrp89)
- [**Docker Compose安装**](https://www.yuque.com/eosphoros/dbgpt-docs/wwdu11e0v5nkfzin)
- [**产品使用手册**](https://www.yuque.com/eosphoros/dbgpt-docs/tkspdd0tcy2vlnu4)
- [**数据对话**](https://www.yuque.com/eosphoros/dbgpt-docs/gd9hbhi1dextqgbz)
- [**使用手册**](https://www.yuque.com/eosphoros/dbgpt-docs/tkspdd0tcy2vlnu4)
- [**知识库**](https://www.yuque.com/eosphoros/dbgpt-docs/ycyz3d9b62fccqxh)
- [**ChatExcel**](https://www.yuque.com/eosphoros/dbgpt-docs/prugoype0xd2g4bb)
- [**数据对话**](https://www.yuque.com/eosphoros/dbgpt-docs/gd9hbhi1dextqgbz)
- [**Excel对话**](https://www.yuque.com/eosphoros/dbgpt-docs/prugoype0xd2g4bb)
- [**数据库对话**](https://www.yuque.com/eosphoros/dbgpt-docs/wswpv3zcm2c9snmg)
- [**报表分析**](https://www.yuque.com/eosphoros/dbgpt-docs/vsv49p33eg4p5xc1)
- [**插件**](https://www.yuque.com/eosphoros/dbgpt-docs/pom41m7oqtdd57hm)
- [**如何部署模型服务**](https://www.yuque.com/eosphoros/dbgpt-docs/vubxiv9cqed5mc6o)
- [**模型服务部署**](https://www.yuque.com/eosphoros/dbgpt-docs/vubxiv9cqed5mc6o)
- [**单机部署**](https://www.yuque.com/eosphoros/dbgpt-docs/kwg1ed88lu5fgawb)
- [**集群部署**](https://www.yuque.com/eosphoros/dbgpt-docs/gmbp9619ytyn2v1s)
- [**vLLM**](https://www.yuque.com/eosphoros/dbgpt-docs/bhy9igdvanx1uluf)
Expand All @@ -106,7 +102,7 @@ DB-GPT是一个开源的数据库领域大模型框架。目的是构建大模

围绕大语言模型、Text2SQL数据集、LoRA/QLoRA/Pturning等微调方法构建的自动化微调轻量框架, 让TextSQL微调像流水线一样方便。详见: [DB-GPT-Hub](https://github.com/eosphoros-ai/DB-GPT-Hub)

- **Data-Driven Multi-Agents&Plugins**
- **数据驱动的Agents插件**

支持自定义插件执行任务,原生支持Auto-GPT插件模型,Agents协议采用Agent Protocol标准

Expand Down Expand Up @@ -145,7 +141,7 @@ DB-GPT是一个开源的数据库领域大模型框架。目的是构建大模

- **GBI**:生成式BI是DB-GPT项目的核心能力之一,为构建企业报表分析、业务洞察提供基础的数智化技术保障。

- **Fine-tune框架**: 模型微调是任何一个企业在垂直、细分领域落地不可或缺的能力,DB-GPT提供了完整的微调框架,实现与DB-GPT项目的无缝打通,在最近的微调中,基于spider的准确率已经做到了82.5%
- **微调框架**: 模型微调是任何一个企业在垂直、细分领域落地不可或缺的能力,DB-GPT提供了完整的微调框架,实现与DB-GPT项目的无缝打通,在最近的微调中,基于spider的准确率已经做到了82.5%

- **数据驱动的Multi-Agents框架**: DB-GPT提供了数据驱动的自进化微调框架,目标是可以持续基于数据做决策与执行。

Expand All @@ -167,8 +163,7 @@ DB-GPT是一个开源的数据库领域大模型框架。目的是构建大模

🌐 [AutoDL镜像](https://www.codewithgpu.com/i/eosphoros-ai/DB-GPT/dbgpt)

🌐 [阿里云镜像](http://dbgpt.site/web/#/p/dc4bb97e0bc15302dbf3a5d5571142dd)

🌐 [小程序云部署](https://www.yuque.com/eosphoros/dbgpt-docs/ek12ly8k661tbyn8)

### 多语言切换

Expand All @@ -178,7 +173,7 @@ DB-GPT是一个开源的数据库领域大模型框架。目的是构建大模

### 多模型使用

[使用指南](https://db-gpt.readthedocs.io/projects/db-gpt-docs-zh-cn/zh_CN/latest/modules/llms.html)
[使用指南](https://www.yuque.com/eosphoros/dbgpt-docs/huzgcf2abzvqy8uv)

# 贡献
> 提交代码前请先执行 `black .`
Expand Down Expand Up @@ -243,13 +238,12 @@ The MIT License (MIT)


### 多模型管理与推理优化
- [x] [集群部署](https://db-gpt.readthedocs.io/en/latest/getting_started/install/cluster/vms/index.html)
- [x] [fastchat支持](https://github.com/lm-sys/FastChat)
- [x] [集群部署](https://www.yuque.com/eosphoros/dbgpt-docs/gmbp9619ytyn2v1s)
- [x] [fastchat支持](https://github.com/lm-sys/FastChat)
- [x] [vLLM 支持](https://db-gpt.readthedocs.io/en/latest/getting_started/install/llm/vllm/vllm.html)
- [x] [vLLM 支持](https://www.yuque.com/eosphoros/dbgpt-docs/bhy9igdvanx1uluf)
- [x] 上层接口兼容Openai
- [ ] 云原生环境与Ray环境支持
- [ ] 注册中心引入nacos
- [ ] 上层接口兼容Openai
- [ ] Embedding模型扩充,优化

### Agents与插件市场
Expand Down
Binary file removed assets/DB-GPT-Product.jpg
Binary file not shown.
Binary file removed assets/chatSQL.png
Binary file not shown.
Empty file removed assets/chat_agent/__init__.py
Empty file.
Binary file removed assets/chat_agent/agent_hub_1.png
Binary file not shown.
Binary file removed assets/chat_agent/agent_hub_2.png
Binary file not shown.
Binary file removed assets/chat_agent/chat_agent0.png
Binary file not shown.
Binary file removed assets/chat_agent/chat_agent1.png
Binary file not shown.
Binary file removed assets/chat_agent/chat_agent2.png
Binary file not shown.
Binary file removed assets/chat_dashboard/chat_dashboard_1.png
Binary file not shown.
Binary file removed assets/chat_dashboard/chat_dashboard_2.png
Binary file not shown.
Binary file removed assets/chat_excel/chat_excel_1.png
Binary file not shown.
Binary file removed assets/chat_excel/chat_excel_2.png
Binary file not shown.
Binary file removed assets/chat_excel/chat_excel_3.png
Binary file not shown.
Binary file removed assets/chat_excel/chat_excel_4.png
Binary file not shown.
Binary file removed assets/chat_excel/chat_excel_5.png
Binary file not shown.
Binary file removed assets/chat_excel/chat_excel_6.png
Binary file not shown.
Binary file removed assets/chat_excel/chat_excel_7.png
Binary file not shown.
Binary file removed assets/chat_knowledge.png
Binary file not shown.
Binary file removed assets/chat_knowledge_zh.png
Binary file not shown.
Binary file removed assets/chatdata.png
Binary file not shown.
Binary file removed assets/chatdb.png
Binary file not shown.
Binary file removed assets/ks.png
Binary file not shown.
Binary file removed assets/llm/dbgpt_llm.jpg
Binary file not shown.