You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hello, I tested your program for some city on multiple pages and found that the first page hotels were repeated in a random sequence throughout the entire csv file, ie the program does not see pages 2, 3, etc. This error occurred because in the while loop you pass with a request the same address.
The problem is because SPA is used there, and when you press the button on the next page, the URL remains the same, and the content changes dynamically.
I don't think this problem can be solved by a library request but only by selenium.
The text was updated successfully, but these errors were encountered:
Thanks for pointing it out. Tripadvisor changed its website since I made this scrapper on January. I'll check if i can find a way to solve this problem. If you come out with a solution, don't hesitate to make the PR and i'll merge it
Hello, I tested your program for some city on multiple pages and found that the first page hotels were repeated in a random sequence throughout the entire csv file, ie the program does not see pages 2, 3, etc. This error occurred because in the while loop you pass with a request the same address.
The problem is because SPA is used there, and when you press the button on the next page, the URL remains the same, and the content changes dynamically.
I don't think this problem can be solved by a library request but only by selenium.
The text was updated successfully, but these errors were encountered: