Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move document scanning trigger by command line to background task #766

Merged
merged 6 commits into from
Feb 14, 2025

Conversation

danielaskdd
Copy link
Contributor

@danielaskdd danielaskdd commented Feb 13, 2025

Move document scanning trigger by command line to background task

  • Added background document scanning task to lifespan if needed
  • Refactor file conversion to use async execution to prevent blocking event loop of FASTAPI
  • Maintain same functionality as before

…names

• Correct menu tree structure in splash screen
• Fix MilvusVectorDBStorage typo
• Update storage env requirements
- Added background task management
- Prevented concurrent scanning
- Tracked scanning progress
- Improved startup performance
- Enhanced error handling
@danielaskdd danielaskdd changed the title Background scan at startup Move document scanning trigger by command line to background task Feb 13, 2025
- Wrap sync conversion in async function
- Use asyncio.to_thread for non-blocking IO
- Maintain same functionality as before
- Clean up temporary files properly
- Improve responsiveness of file processing
@LarFii LarFii merged commit a5a6b42 into HKUDS:main Feb 14, 2025
1 check passed
@danielaskdd danielaskdd deleted the background-scan-at-startup branch February 16, 2025 13:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants