Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(megaparse): add sdk #3462

Merged
merged 2 commits into from
Nov 8, 2024
Merged

feat(megaparse): add sdk #3462

merged 2 commits into from
Nov 8, 2024

Conversation

chloedia
Copy link
Collaborator

@chloedia chloedia commented Nov 7, 2024

What it does :

Adds the MegaParse API call for parsing using the SDK

@dosubot dosubot bot added the size:L This PR changes 100-499 lines, ignoring generated files. label Nov 7, 2024
@chloedia chloedia mentioned this pull request Nov 7, 2024
AmineDiro
AmineDiro previously approved these changes Nov 7, 2024
Copy link
Collaborator

@AmineDiro AmineDiro left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thx for the PR ! I think we should also have fallback tests. By default we will always choose megaparse class in registry but if we can't instanciate the class we would probably need something else.

We probably need to see if we keep the registry around for quivr-core

AUTO = "auto"
HI_RES = "hi_res"


class MegaparseBaseConfig(BaseModel):
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why do we need to configure it from yaml ?

@dosubot dosubot bot added the lgtm This PR has been approved by a maintainer label Nov 7, 2024
@chloedia
Copy link
Collaborator Author

chloedia commented Nov 8, 2024

#3392

@StanGirard StanGirard changed the title add: megaparse sdk feat(megaparse): add sdk Nov 8, 2024
@StanGirard StanGirard merged commit 190d971 into main Nov 8, 2024
3 of 5 checks passed
@StanGirard StanGirard deleted the feat/add_megaparse_sdk branch November 8, 2024 13:36
StanGirard added a commit that referenced this pull request Nov 18, 2024
🤖 I have created a release *beep* *boop*
---


##
[0.0.24](core-0.0.23...core-0.0.24)
(2024-11-14)


### Features

* kms-migration ([#3446](#3446))
([1356d87](1356d87))
* **megaparse:** add sdk
([#3462](#3462))
([190d971](190d971))


### Bug Fixes

* added chunk_size in tika processor
([#3466](#3466))
([063bbd3](063bbd3))
* modify megaparse strategy
([#3474](#3474))
([da97b2c](da97b2c))
* supported extensions for megaparse
([#3477](#3477))
([72b979d](72b979d))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
lgtm This PR has been approved by a maintainer size:L This PR changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants