Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

PGvector service #86

Merged
merged 42 commits into from
Jun 5, 2024
Merged

PGvector service #86

merged 42 commits into from
Jun 5, 2024

Conversation

ganesanintel
Copy link
Collaborator

Description

The summary of the proposed changes as long as the relevant motivation and context.

Issues

List the issue or RFC link this PR is working on. If there is no such link, please mark it as n/a.

Type of change

List the type of change like below. Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds new functionality)
  • Breaking change (fix or feature that would break existing design and interface)

Dependencies

List the newly introduced 3rd party dependency if exists.

Tests

Describe the tests that you ran to verify your changes.

zhlsunshine and others added 27 commits June 3, 2024 20:51
@zhlsunshine @ganesanintel
The embedding model should be consistent for microservice retriever (o…
f7030c7 
…pea-project#69)

* embedding model should be consistent both for ingestion and redis retriever

Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

* fix the DOC.

Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add comments for changes.

Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

* add comments for changes.

Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add comments for changes.

Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: zhlsunshine <huailong.zhang@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@ashahba @lvliang-intel @ganesanintel
Misc header and style updates (opea-project#70)
6771f26 
Signed-off-by: Abolfazl Shahbazi <abolfazl.shahbazi@intel.com>
Co-authored-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@letonghan @ganesanintel
fix streaming issue (opea-project#81)
d89bebf 
Signed-off-by: letonghan <letong.han@intel.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@tylertitsworth @ganesanintel
Add Container Build Action (opea-project#77)
ed1a5aa 
Signed-off-by: tylertitsworth <tyler.titsworth@intel.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@XinyuYe-Intel @ganesanintel
Added readmes for dataprep and vectorstores (opea-project#83)
989f477 
* added readmes for dataprep and vectorstores.

---------

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@chensuyue @ganesanintel
remove the label in docker image tag (opea-project#84)
f0acc2a 
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@ganesanintel
PGvector service
6cdc5fd 
Signed-off-by: V, Ganesan <ganean.v@intel.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@pre-commit-ci @ganesanintel
[pre-commit.ci] auto fixes from pre-commit.com hooks
b0d2639 
for more information, see https://pre-commit.ci

Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@ganesanintel
fixed a typo
8e67521 
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@lvliang-intel @pre-commit-ci @ganesanintel
Refactor llms code structure (opea-project#85)
db16101 
* Refactor llms code structure

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

---------

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@lvliang-intel @ganesanintel
Fix LLM filename (opea-project#87)
f3d5067 
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@letonghan @ganesanintel
Add Timeout for LLM Microservice (opea-project#91)
defc189 
Signed-off-by: letonghan <letong.han@intel.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@ganesanintel
changed container name
4c07292 
Signed-off-by: V, Ganesan <ganean.v@intel.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@pre-commit-ci @ganesanintel
[pre-commit.ci] auto fixes from pre-commit.com hooks
ad7a9cc 
for more information, see https://pre-commit.ci

Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@letonghan @pre-commit-ci @ganesanintel
Enable Benchmark with Langsmith (opea-project#96)
6d42749 
* update benchmark with langsmith

Signed-off-by: letonghan <letong.han@intel.com>

---------

Signed-off-by: letonghan <letong.han@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@ganesanintel
Added support for LlamaGuard2 (opea-project#90)
5c2ed5b 
* added LlamaGuard2 support

Signed-off-by: Tyler Wilbers <tyler.wilbers@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Tyler Wilbers <tyler.wilbers@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: lvliang-intel <liang1.lv@intel.com>

Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@XinyuYe-Intel @pre-commit-ci
@lvliang-intel @ganesanintel
Added more file formats support in dataprep microservice (opea-projec…
8cf37cf 
…t#93)

* added more file formats support.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>


---------

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@xiguiw @ganesanintel
Format opea docker images name (opea-project#103)
011c7d1 
Signed-off-by: Wang, Xigui <xigui.wang@intel.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@xiguiw @ganesanintel
Update retrieve and reranking README.md (opea-project#101)
28af518 
Signed-off-by: Wang, Xigui <xigui.wang@intel.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@letonghan @Spycsh @ganesanintel
update docker image name in readme (opea-project#99)
7c67970 
Signed-off-by: letonghan <letong.han@intel.com>
Co-authored-by: Sihan Chen <39623753+Spycsh@users.noreply.github.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@preethivenkatesh @xiguiw
@letonghan @Spycsh @ganesanintel
Updated ASR, TTS Readme (opea-project#106)
074668e 
* Update README.md

* Update README.md

Signed-off-by: preethivenkatesh <preethi.venkatesh@intel.com>

* Update README.md

Signed-off-by: preethivenkatesh <preethi.venkatesh@intel.com>

* Update retrieve and reranking README.md (opea-project#101)

Signed-off-by: Wang, Xigui <xigui.wang@intel.com>
Signed-off-by: preethivenkatesh <preethi.venkatesh@intel.com>

* update docker image name in readme (opea-project#99)

Signed-off-by: letonghan <letong.han@intel.com>
Co-authored-by: Sihan Chen <39623753+Spycsh@users.noreply.github.com>
Signed-off-by: preethivenkatesh <preethi.venkatesh@intel.com>

---------

Signed-off-by: preethivenkatesh <preethi.venkatesh@intel.com>
Signed-off-by: Wang, Xigui <xigui.wang@intel.com>
Signed-off-by: letonghan <letong.han@intel.com>
Co-authored-by: xiguiw <111278656+xiguiw@users.noreply.github.com>
Co-authored-by: Letong Han <106566639+letonghan@users.noreply.github.com>
Co-authored-by: Sihan Chen <39623753+Spycsh@users.noreply.github.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@NeoZhangJianyu @arthw @ganesanintel
fix grammar error (opea-project#100)
6e448e7 
Signed-off-by: arthw <14088817+arthw@users.noreply.github.com>
Co-authored-by: arthw <14088817+arthw@users.noreply.github.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@lvliang-intel @ganesanintel
Refine Gateway API (opea-project#105)
a841737 
* Refine gateway API

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* refine user message handling

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix ci issue

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* fix issues

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Letong Han <106566639+letonghan@users.noreply.github.com>

Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@letonghan @ganesanintel
refine output format of llm (opea-project#107)
572e65d 
Signed-off-by: letonghan <letong.han@intel.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@lvliang-intel @pre-commit-ci @ganesanintel
Update workflow test script (opea-project#108)
7211dc8 
* Update workflow test script

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* fix parameter

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix role setting

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

---------

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@chensuyue @ganesanintel
add workflow test for microservice (opea-project#97)
83d74c4 
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Spycsh <sihan.chen@intel.com>
Signed-off-by: letonghan <letong.han@intel.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@Spycsh @pre-commit-ci @ganesanintel
fix curl command format in readme and test (opea-project#110)
73d9d3e 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
yao531441 and others added 13 commits June 3, 2024 20:51
@yao531441 @ganesanintel
Llama3 and phi3 validation result update. (opea-project#79)
17a181b 
* Llama3 and Phi3 validation results update

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@tianyil1 @ganesanintel
Added the microservice of vLLM (opea-project#78)
0ddc968 
* refine the vllm microservice

Signed-off-by: tianyil1 <tianyi.liu@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* rename the rayllm to ray_serve

Signed-off-by: tianyil1 <tianyi.liu@intel.com>

* refactor the ray service code structure

Signed-off-by: tianyil1 <tianyi.liu@intel.com>

* refine the vllm and readme

Signed-off-by: tianyil1 <tianyi.liu@intel.com>

* update the readme with correct ray service name

Signed-off-by: tianyil1 <tianyi.liu@intel.com>

* update the readme

Signed-off-by: tianyil1 <tianyi.liu@intel.com>

* refine the readme

Signed-off-by: tianyil1 <tianyi.liu@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: tianyil1 <tianyi.liu@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@lvliang-intel @ganesanintel
fixed api call parameter and added no proxy (opea-project#115)
9806cfb 
Signed-off-by: Tyler Wilbers <tyler.wilbers@intel.com>
Co-authored-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@lkk12014402 @ganesanintel
llm server for lm-eval (opea-project#82)
0fb1b51 
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@lkk12014402 @ganesanintel
change GenAIEval to evals (opea-project#121)
15daecf 
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@zehao-intel @lvliang-intel @ganesanintel
Update Readme for introducing Comps (opea-project#118)
81f7400 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
Co-authored-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@letonghan @ganesanintel
update llm microservice output to binary (opea-project#123)
99ca05c 
Signed-off-by: letonghan <letong.han@intel.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@letonghan @ganesanintel
fix stream=false doesn't work issue (opea-project#124)
f53f382 
Signed-off-by: letonghan <letong.han@intel.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@tianyil1 @ganesanintel
Added the microservice of Ray (opea-project#104)
faf64c2 
* initially add the ray microservice

Signed-off-by: tianyil1 <tianyi.liu@intel.com>

* refine the ray_serve dockerfile without the host network

Signed-off-by: tianyil1 <tianyi.liu@intel.com>

* rename the overlapped name

Signed-off-by: tianyil1 <tianyi.liu@intel.com>

* refine the readme and script

Signed-off-by: tianyil1 <tianyi.liu@intel.com>

* refine the readme and api_server_openai with the correct format

Signed-off-by: tianyil1 <tianyi.liu@intel.com>

* refine the llm response

Signed-off-by: tianyil1 <tianyi.liu@intel.com>

* refine the readme

Signed-off-by: tianyil1 <tianyi.liu@intel.com>

* refine the readme

Signed-off-by: tianyil1 <tianyi.liu@intel.com>

* refine the readme

Signed-off-by: tianyil1 <tianyi.liu@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: tianyil1 <tianyi.liu@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@chensuyue @ganesanintel
unify license copyright (opea-project#127)
0686ff7 
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@chensuyue @ganesanintel
bump release version into v0.6 (opea-project#128)
73843b4 
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@lvliang-intel @ganesanintel
Update HF token environment variable (opea-project#116)
20ccdc9 
* Update TF token environment variable

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* add token

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

---------

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@Spycsh @ganesanintel
Add aio orchestrator to boost concurrent serving (opea-project#130)
254b7d5 
* aio scheduler

* fix test

Signed-off-by: Spycsh <sihan.chen@intel.com>

* ix req

* fix streaming

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix

---------

Signed-off-by: Spycsh <sihan.chen@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@hshen14 hshen14 merged commit 1b70010 into opea-project:main Jun 5, 2024
6 checks passed
@chensuyue
Copy link
Collaborator

Please contribute an e2e test for this microservice, like this one: https://github.com/opea-project/GenAIComps/blob/main/tests/test_reranks.sh, please name it as test_vectorstores.sh.

hshen14 added a commit that referenced this pull request Jun 5, 2024
@hshen14
Revert "PGvector service (#86)"
fed72f1 
This reverts commit 1b70010.
chensuyue
chensuyue reviewed Jun 5, 2024
View reviewed changes
comps/vectorstores/langchain/pgvector/__init__.py
@@ -0,0 +1,13 @@
# Copyright (c) 2024 Intel Corporation
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This license header is out of date, please leave it empty (the bot will add it automatically) or add the new one,

Copyright (C) 2024 Intel Corporation   
SPDX-License-Identifier: Apache-2.0

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Addressed in #201

chensuyue
chensuyue reviewed Jun 5, 2024
View reviewed changes
comps/vectorstores/langchain/pgvector/README.md
## 1. Download Pgvector image

```bash
docker pull pgvector/pgvector:0.7.0-pg16
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should be part of the BoM list, please fill in.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

XinyuYe-Intel pushed a commit that referenced this pull request Jun 17, 2024
@ganesanintel @XinyuYe-Intel
PGvector service (#86)
4851cd6 
* Support PGvector service

Signed-off-by: V, Ganesan <ganesan.v@intel.com>
@ganesanintel
Copy link
Collaborator Author

Please contribute an e2e test for this microservice, like this one: https://github.com/opea-project/GenAIComps/blob/main/tests/test_reranks.sh, please name it as test_vectorstores.sh.

Done. Added a testcase in #201.

gadmarkovits pushed a commit to gadmarkovits/GenAIComps that referenced this pull request Jun 19, 2024
@ganesanintel @gadmarkovits
PGvector service (opea-project#86)
3ed9735 
* Support PGvector service

Signed-off-by: V, Ganesan <ganesan.v@intel.com>
Signed-off-by: gadmarkovits <gad.markovits@intel.com>
kevinintel pushed a commit that referenced this pull request Jul 9, 2024
@gadmarkovits
Qdrant retriever microservice (#216)
9b658f4 
* PGvector service (#86)

* Support PGvector service

Signed-off-by: V, Ganesan <ganesan.v@intel.com>
Signed-off-by: gadmarkovits <gad.markovits@intel.com>
yogeshmpandey pushed a commit to yogeshmpandey/GenAIComps that referenced this pull request Jul 10, 2024
@gadmarkovits @yogeshmpandey
Qdrant retriever microservice (opea-project#216)
e6e7732 
* PGvector service (opea-project#86)

* Support PGvector service

Signed-off-by: V, Ganesan <ganesan.v@intel.com>
Signed-off-by: gadmarkovits <gad.markovits@intel.com>
Signed-off-by: Yogesh Pandey <yogesh.pandey@intel.com>
dwhitena pushed a commit to predictionguard/GenAIComps that referenced this pull request Jul 24, 2024
@gadmarkovits @dwhitena
Qdrant retriever microservice (opea-project#216)
c65094f 
* PGvector service (opea-project#86)

* Support PGvector service

Signed-off-by: V, Ganesan <ganesan.v@intel.com>
Signed-off-by: gadmarkovits <gad.markovits@intel.com>
Signed-off-by: Daniel Whitenack <whitenack.daniel@gmail.com>
lkk12014402 pushed a commit that referenced this pull request Aug 8, 2024
@lvliang-intel
Update README for CodeTrans (#86)
bd6be32 
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@chensuyue chensuyue chensuyue left review comments

@lvliang-intel lvliang-intel lvliang-intel approved these changes

@amberjain1 amberjain1 amberjain1 approved these changes

@hshen14 hshen14 hshen14 approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.