Limiting Conversational history

[ManishMadan2882]

• What kind of change does this PR introduce? (Bug fix, feature, docs update, ...)
  1. Trims the conversational history to the number of latest queries not more than finite number of tokens(default 500)
• Why was this change needed? (You can also link to an open issue here)
  Prevents LLM from getting overloaded with large context of history.

[vercel]

@ManishMadan2882 is attempting to deploy a commit to the Arc53 Team on Vercel.

A member of the Team first needs to authorize it.

[codecov]

Codecov Report

Attention: Patch coverage is 13.63636% with 19 lines in your changes missing coverage. Please review.

Project coverage is 35.90%. Comparing base (f8e4e42) to head (1323261).
Report is 8 commits behind head on main.

Files with missing lines	Patch %	Lines
application/utils.py	6.66%	14 Missing ⚠️
application/api/answer/routes.py	33.33%	2 Missing ⚠️
application/retriever/duckduck_search.py	0.00%	2 Missing ⚠️
application/retriever/classic_rag.py	0.00%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1500      +/-   ##
==========================================
+ Coverage   35.89%   35.90%   +0.01%     
==========================================
  Files          68       68              
  Lines        3285     3275      -10     
==========================================
- Hits         1179     1176       -3     
+ Misses       2106     2099       -7     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
docs-gpt	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Dec 17, 2024 3:26pm