README_chatbot.md

Docker

Follow these instructions to set up and run our provided Docker image.

Set Up Docker Image

Build or Pull the provided docker images.

Prepare Intel Extension for Transformers

git clone https://github.com/intel/intel-extension-for-transformers.git itrex
cd itrex

Build Docker Image on CPU

cd itrex
docker build -f docker/Dockerfile_chatbot --build-arg ITREX_VER=main --target cpu --network=host -t chatbot:latest .

If you need to use proxy, please use the following command

docker build --build-arg http_proxy=${http_proxy} --build-arg https_proxy=${http_proxy} --build-arg ITREX_VER=main --target cpu -f docker/Dockerfile_chatbot -t chatbot:latest .

Build Docker Image on HPU

cd itrex
docker build -f docker/Dockerfile_chatbot --build-arg ITREX_VER=main --target hpu -t chatbot:latest .

Pull From Docker Hub

docker pull intel/ai-tools:itrex-chatbot

Use Docker Image

Utilize the docker container based on docker image.

docker run -itd --net=host --ipc=host <image_id> /bin/bash
docker exec -it <container_id> /bin/bash

Run Simple Test

docker exec -it <container_id> /bin/bash
export no_proxy=localhost,127.0.0.1,intel.com
cd intel_extension_for_transformers/neural_chat/tests
python server/test_textchat_server.py