Replies: 2 comments
-
I think there should be a node that just saves the data scraped either to a vector store or to a local directory. Sometimes the need for the scraping is not just to generate answers. |
Beta Was this translation helpful? Give feedback.
0 replies
-
There is the rag node |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Currently, FetchNode uses the AsyncChromiumLoader to load the page and the returned content is used further.
I think it would be good if we invested more effort into getting more structured and detailed webpage content:
I mean getting a dict out of the page that includes
Beta Was this translation helpful? Give feedback.
All reactions