Skip to content

alaiou/recruitment-test-data-engineering

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

50 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Solution

Implemented a simple schema (close to the CSV data format) including a foreign key constraint on the place. This is to help with faster querying, however one drawback is the longer import time.

Regarding the query output, pure SQL is used for the query and a json file is produced as requested.

Follow the instructions as given in the code test:

Build the docker images

docker compose build

Start the MySQL database

docker compose up database

Make sure the MySQL database is running, and then load the example schema with:

docker compose run --no-TTY database mysql --host=database --user=codetest --password=swordfish codetest <schema.sql

Run the import and output ruby scripts

docker compose run import
docker compose run output

data\summary_output.json holds the result of the query

About

Code test for data engineering candidates

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Ruby 90.2%
  • Dockerfile 9.8%