Skip to content
This repository has been archived by the owner on Dec 11, 2024. It is now read-only.

chore/merge upstream 2024091301 #55

Merged
merged 132 commits into from
Sep 13, 2024
Merged

chore/merge upstream 2024091301 #55

merged 132 commits into from
Sep 13, 2024

Conversation

onimsha
Copy link

@onimsha onimsha commented Sep 13, 2024

Description

[Provide a brief description of the changes in this PR]

How Has This Been Tested?

[Describe the tests you ran to verify your changes]

Accepted Risk

[Any know risks or failure modes to point out to reviewers]

Related Issue(s)

[If applicable, link to the issue(s) this PR addresses]

Checklist:

  • All of the automated tests pass
  • All PR comments are addressed and marked resolved
  • If there are migrations, they have been rebased to latest main
  • If there are new dependencies, they are added to the requirements
  • If there are new environment variables, they are added to all of the deployment methods
  • If there are new APIs that don't require auth, they are added to PUBLIC_ENDPOINT_SPECS
  • Docker images build and basic functionalities work
  • Author has done a final read through of the PR right before merge

pablonyx and others added 30 commits August 30, 2024 10:54
@pablonyx
update command keys (onyx-dot-app#2271)
8f26728
@pablonyx
Minor search UX improvements + Critical connector fixes (onyx-dot-app…
1835690 
…#2259)
@pablonyx
add better spacing (onyx-dot-app#2265)
e2f4145
@pablonyx
Minor search formatting updates (onyx-dot-app#2276)
b952dbe
@pablonyx
Account for edge case in indexing times with connectors onyx-dot-app#…
f2e8680 
…2190 (onyx-dot-app#2190)
@pablonyx
Minor simplification to chat header (onyx-dot-app#2277)
44c45cb
@pablonyx
add metadata to pdf extraction (onyx-dot-app#2278)
4181124
@pablonyx
allow users to deselect reranking (onyx-dot-app#2243)
df31cac
@Weves
Connector tests (onyx-dot-app#2273)
762b7b1
@hagen-danswer
Added frontend logical polish (onyx-dot-app#2274)
355326f
@Weves
Add connector creation docs
21af852
@pablonyx
Add typing to pdf extraction (onyx-dot-app#2280)
5800c71
@pablonyx
Detect GPU on startup for default multi-pass indexing value (onyx-dot…
76db4b7 
…-app#2242)
@yuhongsun96
Catch LLM Eval Failures (onyx-dot-app#2272)
f01027c
@yuhongsun96
mypy (onyx-dot-app#2283)
580848c
@pablonyx
Very minor update to divider logic (onyx-dot-app#2287)
634de83
@hagen-danswer
Integration tests (onyx-dot-app#2256)
8d443ad 
* initial commit

* almost done

* finished 3 tests

* minor refactor

* built out initial permisison tests

* reworked test_deletion

* removed logging

* all original tests have been converted

* renamed user_groups to user_group

* mypy

* added test for doc set permissions

* unified naming for manager methods

* Refactored models and added new deletion test

* minor additions

* better logging+fixed input variables

* commented out failed tests

* Added readme

* readme update

* Added auth to IT

set auth_type to basic and require_email_verification to false

* Update run-it.yml

* used verify and added to readme

* added api key manager
@hagen-danswer @Weves
logging improvements
a96cea2
@Weves
Update default anthropic / bedrock models
f871b4c
@pablonyx
More explicit Confluence Connector (onyx-dot-app#2289)
c122be2
@hagen-danswer @Weves
Connector deletion fix (onyx-dot-app#2293)
aa84846 
---------

Co-authored-by: Weves <chrisweaver101@gmail.com>
@pablonyx
Ordered indexing status (onyx-dot-app#2292)
910821c
@pablonyx
Add litellm proxy embeddings (onyx-dot-app#2291)
299cb50 
* add litellm proxy

* formatting

* move `api_url` to cloud provider + nits

* remove log

* typing

* quick tuyping fix

* update LiteLLM selection logic

* remove logs + validate functionality

* rename proxy var

* update path casing

* remove pricing for custom models

* functional values
@yuhongsun96
Vespa Log No Response (onyx-dot-app#2295)
32e551b
@Weves
Fix revisions
0027f16
@pablonyx
update code block (onyx-dot-app#2297)
14a9fec
@Weves
Remove unused env variables (onyx-dot-app#2299)
033ec0b
@pablonyx
Add proper typing such that tests pass mypy (onyx-dot-app#2301)
2b14afe 
* add proper typing such that tests pass mypy

* nit (squash)

* minor update
@yuhongsun96
Productboard Minor Fix (onyx-dot-app#2303)
d988a3e
@rkuo-danswer
Update CONTRIBUTING.md (onyx-dot-app#2298)
abe0114
pablonyx and others added 28 commits September 10, 2024 18:04
@pablonyx
Update spread order (onyx-dot-app#2386)
07f49a3 
* update spread

* update
@pablonyx
Add basic virtualization (onyx-dot-app#2370)
3a2a6ab 
* add basic virtualization

* functioning perfectly

* squash

* change ports

* remove some comments

* remove comment

* update buffering clarity
@pablonyx
Improve Dev Experience (onyx-dot-app#2347)
9f6e8bd 
* clean interfaces + improve dex experience

* update formatting

* update ports

* ports

* remove some number of unnecessary lines

* remove unnecssary isPublicGroupSelector checks in all spots

* add comment

* update building
@pablonyx
add ccpair id to logging (onyx-dot-app#2391)
0d749eb
@trial-danswer
Add link to macOS contributions doc for installing Python 3.11 (onyx-…
d42fb6c 
…dot-app#2396)

Co-authored-by: danswer-trial <danswer-trial@danswer-trials-MacBook-Pro.local>
@hagen-danswer
Added HARD_DELETE_CHATS to environment variables (onyx-dot-app#2397)
74a2271
@rkuo-danswer
fixes a bug with deleting connectors and foreign keys (onyx-dot-app#2398
71f2f1a 
)
@rkuo-danswer
Bugfix/connector deletion test (onyx-dot-app#2402)
f4f2fb5 
* fixes a bug with deleting connectors and foreign keys

* test foreign key handling on deletion
@trial-danswer
Misc clarifications for CONTRIBUTING.md (onyx-dot-app#2401)
eab55bd 
* Reorder and clarify dependency installation instructions

* Clarify instructions for local development with Docker external deps vs full Docker stack

* Final words at the end of the local setup process

---------

Co-authored-by: danswer-trial <danswer-trial@danswer-trials-MacBook-Pro.local>
@pablonyx
add claude image-support
2c971cf
@pablonyx
simplify unnecessary display logic (onyx-dot-app#2406)
d90c90d
@pablonyx
Add error table to re-indexing (onyx-dot-app#2388)
2c77dd2 
* add error table to re-indexing

* robustify

* update with proper comment

* add popup

* update typo
@pablonyx
Add env variables for overriding embedding batch size (onyx-dot-app#2395
aee5fcd 
)

* add env variabels for overriding

* proper ports

* proper overrides
@yuhongsun96
Update CONTRIBUTING.md
2654df4
@pablonyx
add bedrock models (onyx-dot-app#2405)
d4d37c9
@pablonyx
Add environment variable for setting vespa search threads (onyx-dot-a…
f69922f 
…pp#2400)
@pablonyx
Add connector deletion failure message (onyx-dot-app#2392)
58bdf9d
@pablonyx
display only failed (onyx-dot-app#2413)
7af572d
@rkuo-danswer
add SSL parameter support for redis (onyx-dot-app#2389)
4bc4da2 
* add SSL parameter support for redis

* add ssl support to redis pool
@rkuo-danswer
fix setting redis_scheme (onyx-dot-app#2416)
eebf98e
@rkuo-danswer
fix enabling ssl in connection pool (onyx-dot-app#2418)
641690e
@pablonyx
Reformatted tailwind config (onyx-dot-app#2417)
a2d775e 
* reformatted tailwind config

* minor update
@hagen-danswer
simple apis now cited/context doc indices (onyx-dot-app#2419)
604ebaf 
* simple apis now cited/context doc indices

* minor fixes
@pablonyx
add a tiny bit of clarity to index doc counts (onyx-dot-app#2414)
79aa5dd
@pablonyx
Warm up reranker on model switch (onyx-dot-app#2408)
cb2169f 
* warm up reranker on model switch

* properly type

* fix issue

* Update search_settings.py
@hagen-danswer
Added search_doc_ids to the simple api to allow for skipping search (o…
e9a616e 
…nyx-dot-app#2421)

* Added search_doc_ids to the simple api to allow for skipping search

* comment

* fixed behaviour
@onimsha
Merge remote-tracking branch 'upstream/main' into chore/merge-upstrea…
d8c25a0 
…m-2024091301
@onimsha
Make Internet Search a system persona
8a9b16f 
Signed-off-by: Alex Co <alex.tuan@mindvalley.com>
@onimsha onimsha merged commit f8c5834 into main Sep 13, 2024
1 of 5 checks passed
@onimsha onimsha deleted the chore/merge-upstream-2024091301 branch September 13, 2024 07:18
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.