Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error in program #3

Open
neofit77 opened this issue Apr 27, 2020 · 1 comment
Open

Error in program #3

neofit77 opened this issue Apr 27, 2020 · 1 comment

Comments

@neofit77
Copy link

Hello, I tested your program for some city on multiple pages and found that the first page hotels were repeated in a random sequence throughout the entire csv file, ie the program does not see pages 2, 3, etc. This error occurred because in the while loop you pass with a request the same address.
The problem is because SPA is used there, and when you press the button on the next page, the URL remains the same, and the content changes dynamically.
I don't think this problem can be solved by a library request but only by selenium.

@augustobottelli
Copy link
Owner

Thanks for pointing it out. Tripadvisor changed its website since I made this scrapper on January. I'll check if i can find a way to solve this problem. If you come out with a solution, don't hesitate to make the PR and i'll merge it

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants