Skip to content

Commit

Permalink
Fix a minor bug for chatqna in docker-compose (#442) (#443)
Browse files Browse the repository at this point in the history
Embedding and reranking services failed to run on GPU H100.
Change the image tag and use CPU for these services. This PR will
fix #442

Signed-off-by: PeterYang12 <yuhan.yang@intel.com>
  • Loading branch information
PeterYang12 authored Jul 24, 2024
1 parent f45f508 commit b46ae8b
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions ChatQnA/docker/gpu/docker_compose.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ services:
REDIS_URL: ${REDIS_URL}
INDEX_NAME: ${INDEX_NAME}
tei-embedding-service:
image: ghcr.io/huggingface/text-embeddings-inference:1.2
image: ghcr.io/huggingface/text-embeddings-inference:cpu-1.2
container_name: tei-embedding-server
ports:
- "8090:80"
Expand Down Expand Up @@ -83,7 +83,7 @@ services:
LANGCHAIN_PROJECT: "opea-retriever-service"
restart: unless-stopped
tei-reranking-service:
image: ghcr.io/huggingface/text-embeddings-inference:1.2
image: ghcr.io/huggingface/text-embeddings-inference:cpu-1.2
container_name: tei-reranking-server
ports:
- "8808:80"
Expand Down

0 comments on commit b46ae8b

Please sign in to comment.