Sahibinden-crawler requires Python v3+ to run.
$ git clone https://github.com/feyzullahertan/sari-ilan-sitesi-crawler.git
Install requirements.txt > But before you do this, you must create the virtual environment. Tutorial
$ pip install -r requirements.txt
Run it! 😊
$ python main.py
- Add database class
- Add proxy list
- Integrate multiprocessing