Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

I can't run with sample code. #4

Open
jolenechen123 opened this issue Jan 16, 2025 · 9 comments
Open

I can't run with sample code. #4

jolenechen123 opened this issue Jan 16, 2025 · 9 comments

Comments

@jolenechen123
Copy link

Hello, your project seems to be broken. When I run the sample program, I get the following error:
ValueError: min() arg is an empty sequence

I wonder if it's because he didn't crawl anything?

image

image

@FaustRen
Copy link
Owner

Hi @jolenechen123 , could you please let me know the following:

  • Version: Which version of the code are you using? The problem you mentioned may exist in version ⚠️ 1.1.0. If you are not using the latest version, please update to 1.1.1.

  • Target Information: If possible, could you share the specific Facebook ID or name of the target you were trying to scrape? This will help me replicate the issue on my side.

@jolenechen123
Copy link
Author

jolenechen123 commented Jan 20, 2025

Hi, I used version 1.1.1 but it still doesn't work.

facebook_user_id = "110699089014688"

Image

I noticed that the crawler didn’t even access 'https://www.facebook.com/api/graphql/', so the list(tmp_creation_array) ends up being empty. Could you help check why?

Image

@FaustRen
Copy link
Owner

@jolenechen123 In your case, you don’t need to log in to execute the program.
You can try increasing the value of the "day_limit" variable. #

Image

Result:

Image

@FaustRen
Copy link
Owner

@jolenechen123
I just discovered that the method for scraping with account login currently has a bug.
I’ll fix it as soon as possible.
Thank you!

@jolenechen123
Copy link
Author

I found that it can be executed normally after I don't log in.

However, my application may still require login functionality for better stability.
Eagerly looking forward to your update.

thank you!

@jolenechen123
Copy link
Author

I found that even without logging in, the crawler program often encounters the error: min() arg is an empty sequence.

Here are some URLs where the error occurred:
https://www.facebook.com/220050085932
https://www.facebook.com/102884532662
https://www.facebook.com/124616330906800

Even after frequently changing proxies, the data is still often inaccessible.

Do you have any good solutions for this? I would really appreciate it.

@FaustRen
Copy link
Owner

FaustRen commented Feb 5, 2025

Did you try to scrape huge posts?

@jolenechen123
Copy link
Author

About 20 news media accounts—is that considered a lot?

@FaustRen
Copy link
Owner

FaustRen commented Feb 5, 2025

If you scrape too many accounts, the Facebook would be ask you login account.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants