Webscraper for www.freelancermap.de

Description

This script scrapes the projects of www.freelancermap.de

Starting from the start url:

the next Button is used until the end is reached.

Results are written to Docker Volume

Configuration

create .env File at root level with values:

USERNAME=''
PASSWORD=''
STARTURL=''

Path to Result file Data.json is defined in compose.yaml file

services:
  webscraping:
    build:
      context: . 
    env_file:
     - .env
    volumes:
    - ./:/usr/src/app/
    ports:
      - 3000:3000

Run the App

docker compose up --build