-
Notifications
You must be signed in to change notification settings - Fork 2.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Trawl AlternativeTo #13
Comments
@mahmoud is this for grabs? |
For sure! Glad someone else enjoys software spelunking as much as I do. ;) Here are some sources I've looked at, but AlternativeTo isn't one I've gone deep on. AlternativeTo is pretty big, so it'd be good if you were explicit about your method of searching. For instance, take it one category at a time, then others can parallelize or pick up after you're feeling exhausted by the largeness :) If you find good stuff, just paste it in here! No need to do full PRs quite yet unless you really feel like it :) |
Hey! 🙈
So obviously we can't use the api since there's none, I'm going to start writing a scrapy script to scrape AlternativeTo for python projects. I don't know about any security methods in place or limitations that would stop a scrapper, I'll report back if I get hit by any 👍 |
An automated approach! So far I've been all manual. But frankly my manual
approach has only caught like 3-4 an automated approach would have missed.
Searching for probable repo links is all that's necessary. I look forward
to your findings! :)
…On Thu, Dec 27, 2018, 11:27 AM Abdullah Samman ***@***.*** wrote:
Hey! 🙈
it'd be good if you were explicit about your method of searching.
So obviously we can't use the api since there's none
<https://alternativeto.net/about/api/>, I'm going to start writing a
scrapy <https://scrapy.org> script to scrape AlternativeTo for python
projects.
I don't know about any security methods in place or limitations that would
stop a scrapper, I'll report back if I get hit by any 👍
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<#13 (comment)>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/AAH8kSryv5EsvG7rExaZIOsVSpj42KRaks5u9R8pgaJpZM4ZcpMi>
.
|
This comment has been minimized.
This comment has been minimized.
@mahmoud turns out we're overengineering. take a look here 😂, so we don't need to crawl 🙈 I'll make a PR with suitable projects. |
AlternativeTo is a great, semi-structured resource for finding applications. I'd like to go down the list of some of the best-in-class open-source options and see how many are Python, to make sure they're on the list. I've already found a decent number, but there's much more research to be done.
The text was updated successfully, but these errors were encountered: