Fix requirements versions
Add problem weight to course structures
Refactor get_structures to fix a bug that impacts courses reruns
Fix bug that prevented the first course to be considered
Fix bug to consider course structure records with empty active version id.
Fix small bug
Use split_modulestore_django_splitmodulestorecourseindex
table
to get the list of active versions of the courses, instead of mongodb.
Fix a bug in date parsing
Allow "value" key in the fields definition to override the field with a constant value. The field will not be queried, but will be filled with the constant value. E.g., can be set to 'null' if a field is missing the the DB but still needed in the datalake.
Fix bug
Fix bug in date parsing Fix connection to MongoDB: use direct connection and secondaryPreferred to avoid issues in certain clusters Reorganize packages Create and document Dockerfile
Add support for xls file datasources Add set-tables command to query the datasources for existing tables and update the settings
Add support for csv file datasource
Complete refactor of the modules and the settings file. Now datasource and datalake settings are more clearly decoupled.
Initial version