feat(ChatData):update spark datasource (#631)

1.feat:update spark_conn,py 2.doc: deploy and llm use faq
eosphoros-ai · Sep 26, 2023 · 6843fc7 · 6843fc7
2 parents 0e9662a + 7d51a2e
commit 6843fc7
Show file tree

Hide file tree

Showing 12 changed files with 169 additions and 102 deletions.
diff --git a/docs/getting_started/application/chatdb/chatdb.md b/docs/getting_started/application/chatdb/chatdb.md
@@ -35,6 +35,7 @@ now DB-GPT support Datasource Type
 * DuckDB
 * Clickhouse
 * Mssql
+* Spark
 ```
 
 ### 2.ChatData

diff --git a/docs/getting_started/faq/deploy/deploy_faq.md b/docs/getting_started/faq/deploy/deploy_faq.md
@@ -80,4 +80,16 @@ Download and install `Microsoft C++ Build Tools` from [visual-cpp-build-tools](h
 ```
 
 1. Install [CUDA Toolkit](https://developer.nvidia.com/cuda-toolkit-archive)
-2. Reinstall PyTorch [start-locally](https://pytorch.org/get-started/locally/#start-locally) with CUDA support.
+2. Reinstall PyTorch [start-locally](https://pytorch.org/get-started/locally/#start-locally) with CUDA support.
+
+##### Q7: ImportError: cannot import name 'PersistentClient' from 'chromadb'.
+
+```commandline
+pip install chromadb==0.4.10
+```
+
+##### Q8: pydantic.error_wrappers.ValidationError:1 validation error for HuggingFaceEmbeddings.model_kwargs extra not permitted
+
+```commandline
+pip install langchain>=0.0.286
+```
diff --git a/docs/getting_started/faq/llm/llm_faq.md b/docs/getting_started/faq/llm/llm_faq.md
@@ -77,11 +77,19 @@ eg: dbgpt start worker --model_name vicuna-13b-v1.5 \
 
 ```
 
-
 ##### Q7 dbgpt command not found
 
 ```commandline
-pip install -e .
+pip install -e "pip install -e ".[default]"
+```
+
+##### Q8 When starting the worker_manager on a cloud server and registering it with the controller, it is noticed that the worker's exposed IP is a private IP instead of a public IP, which leads to the inability to access the service.
+
+```commandline
+
+--worker_register_host  public_ip     The ip address of current worker to register
+                                to ModelController. If None, the address is
+                                  automatically determined
 ```
 
 
diff --git a/docs/locales/zh_CN/LC_MESSAGES/getting_started/application/chatdb/chatdb.po b/docs/locales/zh_CN/LC_MESSAGES/getting_started/application/chatdb/chatdb.po
@@ -8,7 +8,7 @@ msgid ""
 msgstr ""
 "Project-Id-Version: DB-GPT 👏👏 0.3.5\n"
 "Report-Msgid-Bugs-To: \n"
-"POT-Creation-Date: 2023-08-29 20:30+0800\n"
+"POT-Creation-Date: 2023-09-26 17:51+0800\n"
 "PO-Revision-Date: YEAR-MO-DA HO:MI+ZONE\n"
 "Last-Translator: FULL NAME <EMAIL@ADDRESS>\n"
 "Language: zh_CN\n"
@@ -20,12 +20,12 @@ msgstr ""
 "Generated-By: Babel 2.12.1\n"
 
 #: ../../getting_started/application/chatdb/chatdb.md:1
-#: 46745445059c40848770d89655d4452a
+#: 0cf45852c1fd430090da81836bc961c7
 msgid "ChatData & ChatDB"
 msgstr "ChatData & ChatDB"
 
 #: ../../getting_started/application/chatdb/chatdb.md:3
-#: 494c5e475fbb420eaab49739b696a2ce
+#: 6dc94a787ff844caa21074d71aaf351a
 #, fuzzy
 msgid ""
 "ChatData generates SQL from natural language and executes it. ChatDB "
@@ -41,119 +41,127 @@ msgstr ""
 #: ../../getting_started/application/chatdb/chatdb.md:20
 #: ../../getting_started/application/chatdb/chatdb.md:24
 #: ../../getting_started/application/chatdb/chatdb.md:28
-#: ../../getting_started/application/chatdb/chatdb.md:42
-#: ../../getting_started/application/chatdb/chatdb.md:47
-#: ../../getting_started/application/chatdb/chatdb.md:53
-#: 0b20219c11a14f9ebdfac5ebabcdcd8d 0f8e5d9baaec4602ae57b55b4db286cf
-#: 3a2ef73b33c74d838b5c0ea41b83430d 9de27f6a12dd447eb9434c3b10dce97e
-#: 9fc2b16790534cf9a79ac57d7b54ff27
+#: ../../getting_started/application/chatdb/chatdb.md:43
+#: ../../getting_started/application/chatdb/chatdb.md:48
+#: ../../getting_started/application/chatdb/chatdb.md:54
+#: 826032e82a0a40b2bd122a90a35d0161 91652ef9e3224290b0c89112bcca4474
+#: d396ffa33eef4bef8471040369414420 d7f176a7794048d3ac3573970db86d9d
+#: f80e5611eca64f86baeeed6c860061f9
 msgid "db plugins demonstration"
 msgstr "db plugins demonstration"
 
 #: ../../getting_started/application/chatdb/chatdb.md:7
-#: 8d4f856b1b734434a80d1a9cc43b1611
+#: aa0f978d3ad34b71aacf143a4c807ba1
 msgid "1.Choose Datasource"
 msgstr "1.Choose Datasource"
 
 #: ../../getting_started/application/chatdb/chatdb.md:9
-#: 9218c985e6e24cebab8c098bc49119a3
+#: 8a2338e2fbae44f1b61b2fcf062499d3
 msgid ""
 "If you are using DB-GPT for the first time, you need to add a data source"
 " and set the relevant connection information for the data source."
 msgstr "如果你是第一次使用DB-GPT, 首先需要添加数据源，设置数据源的相关连接信息"
 
 #: ../../getting_started/application/chatdb/chatdb.md:13
-#: ec508b8298bf4657aca722875d34d858
+#: f1d165ab8b564445880e581a2e554434
 msgid "there are some example data in DB-GPT-NEW/DB-GPT/docker/examples"
 msgstr "在DB-GPT-NEW/DB-GPT/docker/examples有数据示例"
 
 #: ../../getting_started/application/chatdb/chatdb.md:15
-#: c92428030b914053ad4c01ab9d78ccff
+#: dd390cb518094c96bf5430bfa821830f
 msgid "you can execute sql script to generate data."
 msgstr "你可以通过执行sql脚本生成测试数据"
 
 #: ../../getting_started/application/chatdb/chatdb.md:18
-#: fa5f5b1bf8994d349ba80b63be472c7f
+#: aebd974d23124daa80af6d74431d1ce3
 msgid "1.1 Datasource management"
 msgstr "1.1 Datasource management"
 
 #: ../../getting_started/application/chatdb/chatdb.md:20
-#: 6bb044bd35b3469ebee61baf394ce613
+#: af4d12aaed5c4fc484a3e7a755a666c2
 msgid ""
 "![db plugins demonstration](https://github.com/eosphoros-ai/DB-"
 "GPT/assets/13723926/7678f07e-9eee-40a9-b980-5b3978a0ed52)"
-msgstr "![db plugins demonstration](https://github.com/eosphoros-ai/DB-"
+msgstr ""
+"![db plugins demonstration](https://github.com/eosphoros-ai/DB-"
 "GPT/assets/13723926/7678f07e-9eee-40a9-b980-5b3978a0ed52)"
 
 #: ../../getting_started/application/chatdb/chatdb.md:22
-#: 23254a25f3464970a7b3e3d7dafa832a
+#: 34b7b9ce0f0142af8179a8e1763a32f8
 msgid "1.2 Connection management"
 msgstr "1.2 Connection管理"
 
 #: ../../getting_started/application/chatdb/chatdb.md:24
-#: e244169193dc48fab1b692f7410aed0b
+#: 00a1af9f4e0a45b9a398f641c8198114
 msgid ""
 "![db plugins demonstration](https://github.com/eosphoros-ai/DB-"
 "GPT/assets/13723926/25b8f5a9-d322-459e-a8b2-bfe8cb42bdd6)"
-msgstr "![db plugins demonstration](https://github.com/eosphoros-ai/DB-"
+msgstr ""
+"![db plugins demonstration](https://github.com/eosphoros-ai/DB-"
 "GPT/assets/13723926/25b8f5a9-d322-459e-a8b2-bfe8cb42bdd6)"
 
 #: ../../getting_started/application/chatdb/chatdb.md:26
-#: 32507323a3884f35991f60646b6077bb
+#: 3b8efc25b482480b8d0f4afe5304ece0
 msgid "1.3 Add Datasource"
 msgstr "1.3 添加Datasource"
 
 #: ../../getting_started/application/chatdb/chatdb.md:28
-#: 3665c149527b4fc3944549454ce81bcf
+#: d36a476e1eb34a46b2d35e6c1c4c39dd
 msgid ""
 "![db plugins demonstration](https://github.com/eosphoros-ai/DB-"
 "GPT/assets/13723926/19ce31a7-4061-4da8-a9cb-efca396cc085)"
-msgstr "![db plugins demonstration](https://github.com/eosphoros-ai/DB-"
+msgstr ""
+"![db plugins demonstration](https://github.com/eosphoros-ai/DB-"
 "GPT/assets/13723926/19ce31a7-4061-4da8-a9cb-efca396cc085)"
 
 #: ../../getting_started/application/chatdb/chatdb.md:31
-#: 23100fa4b1b642699f1faae80f78419b
+#: 9205388f91404099bf1add6d55f33801
 msgid "now DB-GPT support Datasource Type"
 msgstr "DB-GPT支持数据源类型"
 
 #: ../../getting_started/application/chatdb/chatdb.md:33
-#: 54f6ac1232294e72975f2ec8f92a19fd
+#: 197722ccd9e54f8196e3037f0ebd4165
 msgid "Mysql"
 msgstr "Mysql"
 
 #: ../../getting_started/application/chatdb/chatdb.md:34
-#: e2aff57c70fd4f6b81da9548f59e97b7
+#: e859c194648440b19941a42635f37ac5
 msgid "Sqlite"
 msgstr "Sqlite"
 
 #: ../../getting_started/application/chatdb/chatdb.md:35
-#: fc2a02bf5b004896a3c68b0f27f82c7b
+#: 91c695f437064f01bf1d7c85a0ecf5b4
 msgid "DuckDB"
 msgstr "DuckDB"
 
 #: ../../getting_started/application/chatdb/chatdb.md:36
-#: 1c97c47b248741b290265c7d72875d7a
+#: 0a8ff591969c4944890415a84aa64173
 msgid "Clickhouse"
 msgstr "Clickhouse"
 
 #: ../../getting_started/application/chatdb/chatdb.md:37
-#: 5ebd3d4f0ca94f50b5f536f673d68610
+#: d52ec849653141dc95862e82ce5777e0
 #, fuzzy
 msgid "Mssql"
 msgstr "Mysql"
 
-#: ../../getting_started/application/chatdb/chatdb.md:40
-#: dcdac0c0e6e24305ad601e5ccd82c877
+#: ../../getting_started/application/chatdb/chatdb.md:38
+#: 430a72d857114422aeecd5595df41881
+msgid "Spark"
+msgstr "Spark"
+
+#: ../../getting_started/application/chatdb/chatdb.md:41
+#: b615a70971e7443291ba33e8bc12b437
 msgid "2.ChatData"
 msgstr "2.ChatData"
 
-#: ../../getting_started/application/chatdb/chatdb.md:41
-#: c15bd38f6f754e0b8820a8afc0a8358b
+#: ../../getting_started/application/chatdb/chatdb.md:42
+#: e3542c64926143958e71c7cb21d25c78
 msgid "Preview Mode"
 msgstr "Preview Mode"
 
-#: ../../getting_started/application/chatdb/chatdb.md:42
-#: b43ffb3cf0734fc8b17ab3865856eda8
+#: ../../getting_started/application/chatdb/chatdb.md:43
+#: e32f26b7c22141e181b5345a644dffd5
 #, fuzzy
 msgid ""
 "After successfully setting up the data source, you can start conversing "
@@ -165,32 +173,34 @@ msgstr ""
 "设置数据源成功后就可以和数据库进行对话了。你可以让它帮你生成SQL，也可以和问它数据库元数据的相关信息。 ![db plugins "
 "demonstration](../../../../assets/chat_data/chatdata_eg.png)"
 
-#: ../../getting_started/application/chatdb/chatdb.md:46
-#: 3f31a98fbf804b3495344ee95505e037
+#: ../../getting_started/application/chatdb/chatdb.md:47
+#: 4d5c0465a01b4f5a964d0e803f9cbc89
 msgid "Editor Mode"
 msgstr "Editor Mode"
 
-#: ../../getting_started/application/chatdb/chatdb.md:47
-#: e3c071be4daa40d0b03af97dbafe1713
+#: ../../getting_started/application/chatdb/chatdb.md:48
+#: 79b088787e8f43258bcc4292c89ad1b0
 msgid ""
 "In Editor Mode, you can edit your sql and execute it. ![db plugins "
 "demonstration](https://github.com/eosphoros-ai/DB-"
 "GPT/assets/13723926/1a896dc1-7c0e-4354-8629-30357ffd8d7f)"
-msgstr "编辑器模式下可以在线编辑sql进行调试. ![db plugins "
-"demonstration](https://github.com/eosphoros-ai/DB-"
+msgstr ""
+"编辑器模式下可以在线编辑sql进行调试. ![db plugins demonstration](https://github.com"
+"/eosphoros-ai/DB-"
 "GPT/assets/13723926/1a896dc1-7c0e-4354-8629-30357ffd8d7f)"
 
-#: ../../getting_started/application/chatdb/chatdb.md:51
-#: 6c694afb12dc4ef28bb58db80d15190c
+#: ../../getting_started/application/chatdb/chatdb.md:52
+#: 9efaf27749614cd4bea07146edddf558
 msgid "3.ChatDB"
 msgstr "3.ChatDB"
 
-#: ../../getting_started/application/chatdb/chatdb.md:53
-#: 631503240cf64cc8b80a9f5e43aae0dd
+#: ../../getting_started/application/chatdb/chatdb.md:54
+#: b2dc15f067064c60974e532c3e2f5893
 msgid ""
 "![db plugins demonstration](https://github.com/eosphoros-ai/DB-"
 "GPT/assets/13723926/e04bc1b1-2c58-4b33-af62-97e89098ace7)"
-msgstr "![db plugins demonstration](https://github.com/eosphoros-ai/DB-"
+msgstr ""
+"![db plugins demonstration](https://github.com/eosphoros-ai/DB-"
 "GPT/assets/13723926/e04bc1b1-2c58-4b33-af62-97e89098ace7)"
 
 #~ msgid "![db plugins demonstration](../../../../assets/chat_data/db_entry.png)"
-Original file line number
+Diff line change
@@ Expand Up / @@ -35,6 +35,7 @@ now DB-GPT support Datasource Type @@
     * DuckDB
     * Clickhouse
     * Mssql
+    * Spark
     ```
     ### 2.ChatData
@@ Expand Down @@