first cut at redis (onyx-dot-app#2226)

* first cut at redis

* fix startup dependencies on redis

* kombu cleanup - fail silently

* mypy

* add redis_host environment override

* update REDIS_HOST env var in docker-compose.dev.yml

* update the rest of the docker files

* update contributing guide

* renaming cache to cache_volume

* add redis password to various deployments

* try setting up pr testing for helm

* fix indent

* hopefully this release version actually exists

* fix command line option to --chart-dirs

* fetch-depth 0

* edit values.yaml

* try setting ct working directory

* bypass testing only on change for now

* move files and lint them

* update helm testing

* some issues suggest using --config works

* add vespa repo

* add postgresql repo

* increase timeout

* try amd64 runner

* fix redis password reference

* add comment to helm chart testing workflow

* rename helm testing workflow to disable it

---------

Co-authored-by: Richard Kuo <rkuo@rkuo.com>

.github/workflows/pr-helm-chart-testing.yml.disabled.txt

@@ -38,9 +38,15 @@ jobs:
           backend/requirements/model_server.txt
     - run: |
         python -m pip install --upgrade pip
+<<<<<<< HEAD
         pip install --retries 5 --timeout 30 -r backend/requirements/default.txt
         pip install --retries 5 --timeout 30 -r backend/requirements/dev.txt
         pip install --retries 5 --timeout 30 -r backend/requirements/model_server.txt
+=======
+        pip install -r backend/requirements/default.txt
+        pip install -r backend/requirements/dev.txt
+        pip install -r backend/requirements/model_server.txt
+>>>>>>> 6daea805 (first cut at redis (#2226))
 
     - name: Set up chart-testing
       uses: helm/chart-testing-action@v2.6.1

backend/danswer/background/celery/celery_app.py

@@ -1216,4 +1216,4 @@ def on_setup_logging(
             "options": {"priority": DanswerCeleryPriority.HIGH},
         },
     }
-)
+)

deployment/docker_compose/docker-compose.gpu-dev.yml

@@ -365,6 +365,7 @@ services:
 
 
 volumes:
+  cache_volume:
   db_volume:
   vespa_volume:
   # Created by the container itself

deployment/docker_compose/docker-compose.prod-no-letsencrypt.yml

@@ -219,6 +219,7 @@ services:
 
 
 volumes:
+  cache_volume:
   db_volume:
   vespa_volume:
   # Created by the container itself

deployment/docker_compose/docker-compose.prod.yml

@@ -236,6 +236,7 @@ services:
 
 
 volumes:
+  cache_volume:
   db_volume:
   vespa_volume:
   # Created by the container itself

deployment/docker_compose/docker-compose.search-testing.yml

@@ -215,6 +215,7 @@ services:
 
 
 volumes:
+  cache_volume:
   db_volume:
     driver: local
     driver_opts: