Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve: use llm to extract structured data #4

Merged
merged 24 commits into from
Nov 5, 2024
Merged

Improve: use llm to extract structured data #4

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
ff9a592
fix(clippy): Fixed clippy warnings
Oct 29, 2024
37ad641
chore(crawler): Impled addition method to scrape htm by url
Oct 29, 2024
356efcd
chore(feeds): Updated feeds for crawler updates
Oct 29, 2024
5bb7248
chore(prompt): Impled new prompts with returned formats description
Oct 29, 2024
4013418
chore(git): Updated .gitignore file
Oct 29, 2024
d771252
chore(llm)!: save point of changes
Oct 30, 2024
6d4c343
fix(tests): fixed tests after all changes
Oct 30, 2024
1b9208d
feat(server)!: Impled server module based on axum
Oct 30, 2024
04f041a
chore(logger): Added trace mw logger for axum
Oct 30, 2024
b805a34
chore(swagger): Impled swagger service for routers
Oct 31, 2024
e18e0c9
chore(escape): added escape string to own json parser
Oct 31, 2024
7b545cb
merge(changes): merged all changes
Oct 31, 2024
33fa682
fix(cors): allowed all cors with any methods and headers
Nov 1, 2024
f55716e
chore(error): added msg and status for error response
Nov 1, 2024
ed2c779
feat(server): impled deleting workers by route
Nov 1, 2024
5886b77
fix(ci): fixed fmt and clippy warnings
Nov 1, 2024
5a994e6
chore(clippy): fixed warnings
Nov 1, 2024
72d5550
fix(ci): fixed clippy warnings
Nov 2, 2024
dbea4b4
chore(resources): removed useless resources files
Nov 2, 2024
71ecedd
feat(retrieve): impled retrieved module for llm
Nov 2, 2024
326b8fb
chore(tests)!: llm tests save point
Nov 2, 2024
50e9e3a
chore(workers): impled returning workers config into info router
Nov 5, 2024
b53149d
chore(crawler): impled mock for crawler llm module
Nov 5, 2024
72a3e04
feat(crawler): impled crawler llm module
Nov 5, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
.idea
.vscode

/rabbitmq-data
/redis-data
Expand Down
207 changes: 207 additions & 0 deletions Cargo.lock
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Loading
Loading