Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Rapid prototype of chaiinlit + Fast API , lighter weight than robocorp actions and Librechat. #47

Merged
merged 70 commits into from
Jun 13, 2024
Merged

Rapid prototype of chaiinlit + Fast API , lighter weight than robocorp actions and Librechat. #47

merged 70 commits into from
Jun 13, 2024

Conversation

dividor
Copy link
Contributor

@dividor dividor commented Jun 7, 2024

No description provided.

dividor added 30 commits June 7, 2024 17:16
@dividor
Rapid prototype of chaiinlit + Fast API , lighter weight than robocor…
0b3ce28 
…p actions and Librechat. VERY rough, needed for demo, needs quality and self tests.
@dividor
Tactical UI for the demo
24f0699
@dividor
Tactical UI for demo
e2a91c4
@dividor
Tactical UI for demo
6d0d7a9
@dividor
Tactical UI for demo
c5319f9
@dividor
Cosmetics, exploring other UI and backend options
4514301
@dividor
Major Refactor for simplicity and to remove Librechat in favor of cha…
0add42f 
…inlit for easier product packaging.
@dividor
Major Refactor for simplicity and to remove Librechat in favor of cha…
3fbfdfb 
…inlit for easier product packaging.
@dividor
Major Refactor for simplicity and to remove Librechat in favor of cha…
dd87216 
…inlit for easier product packaging.
@dividor
Major Refactor for simplicity and to remove Librechat in favor of cha…
27785f6 
…inlit for easier product packaging.
@dividor
Major Refactor for simplicity and to remove Librechat in favor of cha…
97793a5 
…inlit for easier product packaging.
@dividor
Major Refactor for simplicity and to remove Librechat in favor of cha…
f66f312 
…inlit for easier product packaging.
@dividor
Major Refactor for simplicity and to remove Librechat in favor of cha…
e1cb7f9 
…inlit for easier product packaging.
@dividor
Major Refactor for simplicity and to remove Librechat in favor of cha…
af48bf5 
…inlit for easier product packaging.
@dividor
Major Refactor for simplicity and to remove Librechat in favor of cha…
ea9efee 
…inlit for easier product packaging.
@dividor
Major Refactor for simplicity and to remove Librechat in favor of cha…
86a4de2 
…inlit for easier product packaging.
@dividor
Major Refactor for simplicity and to remove Librechat in favor of cha…
0d8fce5 
…inlit for easier product packaging.
@dividor
Major Refactor for simplicity and to remove Librechat in favor of cha…
a7fb098 
…inlit for easier product packaging.
@dividor
Major Refactor for simplicity and to remove Librechat in favor of cha…
f78aad8 
…inlit for easier product packaging.
@dividor
Major Refactor for simplicity and to remove Librechat in favor of cha…
7017036 
…inlit for easier product packaging.
@dividor
Major Refactor for simplicity and to remove Librechat in favor of cha…
0a2b4bb 
…inlit for easier product packaging.
@dividor
Major Refactor for simplicity and to remove Librechat in favor of cha…
f889666 
…inlit for easier product packaging.
@dividor
Major Refactor for simplicity and to remove Librechat in favor of cha…
bf6eb1f 
…inlit for easier product packaging.
@dividor
Major Refactor for simplicity and to remove Librechat in favor of cha…
50b6e39 
…inlit for easier product packaging.
@dividor
Major Refactor for simplicity and to remove Librechat in favor of cha…
c6d5618 
…inlit for easier product packaging.
@dividor
Major Refactor for simplicity and to remove Librechat in favor of cha…
3985781 
…inlit for easier product packaging.
@dividor
Major Refactor for simplicity and to remove Librechat in favor of cha…
159f45c 
…inlit for easier product packaging.
@dividor
Major Refactor for simplicity and to remove Librechat in favor of cha…
a48ea98 
…inlit for easier product packaging.
@dividor
Major Refactor for simplicity and to remove Librechat in favor of cha…
d5ca61c 
…inlit for easier product packaging.
@dividor
Added prompt to enable LLM to autmatically add code for determining H…
829660c 
…DX dataset attribution, metadata and raw data download link. These are now added as footers on data recipe results served in the chat UI
dividor added 22 commits June 12, 2024 13:19
@dividor
More work to standardize recipe output to conformant JSON
378fbb8
@dividor
More adjustments to recipes JSON output schema
669fefe
@dividor
Updated deployment for new Azure
855bc3d
@dividor
Updated deployment for new Azure
e96411b
@dividor
Handling of new recipes
89d71f0
@dividor
Removing some async stuff from function calling, not needed
0ed6cdf
@dividor
Various adjustments for demo
7185f28
@dividor
Various adjustments for demo
d020b4c
@dividor
Fix for blank meta data labels
933cd19
@dividor
Prompting about self skills
27f0d48
@dividor
Production HAPI URL
86af72e
@dividor
Jan's new recipes, modified to work with JSON schema
3a37776
@dividor
Prompt adjustments
39ea9c7
@dividor
Protect against non-text
84c2d11
@dividor
Various fixes
3388929
@dividor
Fixed metadata on some recipes
5745262
@dividor
Fixed metadata on some recipes
fbb6398
@dividor
Fixed metadata on some recipes
ab2d68f
@dividor
COnverted sample_metadata to JSON type, fewer conversions throughout
95cec08
@dividor
COnverted sample_metadata to JSON type, fewer conversions throughout
723ed8b
@dividor
COnverted sample_metadata to JSON type, fewer conversions throughout
54d73af
@dividor
Tactical fixes to support memories, recipes txt vs image output, and …
8a3204c 
…no results.
@dividor
Copy link
Contributor Author

dividor commented Jun 13, 2024

The PR covered a lot of things for a big demo. Going forward we will never do this again!

In the PR ...

  1. Removal of Librechat as it had errors we couldn't debug and was too much for requirements. Removing it removed 4 docker services and a lot of complexity
  2. Creation of Chainlit UI in replacement of Librechat. An assistant and flow version (assistant is main focus right now)
  3. New FastAPI backend. Have left robocorp actions in for now
  4. Tactical solution to enforce JSON schema on all recipes, but roadmap is to replace everything by logging recipes into dedicated module instead of generated scripts
  5. Update to CLI and DB to ensure JSON fields are stored as such throughout the system
  6. Updated ingesiton config to use HAPI production URL
  7. Prompt engineering assistant
  8. Updated AI memory check to check all semantic search matches, not one-by-one, fatser and better context
  9. Split utils.py into db.py, llm.py etc
  10. Moved remaining LLM prompts into central template folder for easier management and evaluation
  11. Created an Azure deployment script
  12. Added literal AI for observability
  13. Lots of new recipes, 6 provided by @JanPeterDatakind
  14. Lots of other simplification and refactoring

@dividor dividor changed the title Rapid prototype of chaiinlit + Fast API , lighter weight than robocorp actions and Librechat. VERY rough, needed for demo, needs quality and self tests. Rapid prototype of chaiinlit + Fast API , lighter weight than robocorp actions and Librechat. Jun 13, 2024
@dividor dividor requested a review from JanPeterDatakind June 13, 2024 21:52
JanPeterDatakind
JanPeterDatakind approved these changes Jun 13, 2024
View reviewed changes
Copy link
Contributor

@JanPeterDatakind JanPeterDatakind left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved.

@JanPeterDatakind JanPeterDatakind merged commit 72f7ab7 into main Jun 13, 2024
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@JanPeterDatakind JanPeterDatakind JanPeterDatakind approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@dividor @JanPeterDatakind