Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] Big sites scan error: Error: vectorsService.upsertVector - TypeError: (intermediate value) is not iterable (cannot read property undefined) #2617

Closed
waveoffire opened this issue Jun 10, 2024 · 0 comments
Closed

[BUG] Big sites scan error: Error: vectorsService.upsertVector - TypeError: (intermediate value) is not iterable (cannot read property undefined) #2617

waveoffire opened this issue Jun 10, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@waveoffire
Copy link

Describe the bug
I scan the page using Cherio web scraper, if the page I want to scrape is large, I get the error as in the screenshot. smaller pages scrape without any problems. Same if i set Relative Links Limit to 100 - works
Screenshot from 2024-06-10 13-13-42

To Reproduce

  1. Create workflow with cheerio web scraper, like in screenshot
    image

  2. Start Upsert Vector Database

  3. See error

Expected behavior
Database full of vectors :)

Setup

  • Installation pnpm start
  • Flowise Version 1.8.1
  • OS: Linux Ubuntu
  • Browser Chrome, Opera
@HenryHengZJ HenryHengZJ added the bug Something isn't working label Jun 12, 2024
ahmosman pushed a commit to ahmosman/Flowise that referenced this issue Jun 19, 2024
FIX FlowiseAI#2617 Big sites scan error
dca904c
@ahmosman ahmosman mentioned this issue Jun 19, 2024
Merged
ahmosman pushed a commit to ahmosman/Flowise that referenced this issue Jul 4, 2024
FIX FlowiseAI#2617 Big sites scan error - review fix
387147f
HenryHengZJ pushed a commit that referenced this issue Jul 5, 2024
@ahmosman
FIX #2617 Cherio Web Crawler doesn't work with large sites (#2678)
90558ca 
* FIX #2617 Big sites scan error

* FIX #2617 Big sites scan error - review fix

---------

Co-authored-by: Ahmed Osman <ahmed.osman@evolpe.pl>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@HenryHengZJ @waveoffire