- Clone into your computer (or gitpod).
- Add your transformations into the
./transformations/<pipeline>/
folder. - Configure the project.yml to specify the piplines and transformations in the order you want to execute them.
- Add new transofrmation files as you need them, make sure to include
expected_input
andexpected_output
as examples. - Update your project.yml file as needed to change the order of the transformations.
- Validate your transformations running
$ pipenv run validate
. - Run your pipline by running
$ pipenv run pipeline <pipeline_slug> <dataset_name>
- If you need to clean your outputs :
$ pipenv run clear
-
Notifications
You must be signed in to change notification settings - Fork 2
4GeeksAcademy/dataflow-project-form_entry
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
No description, website, or topics provided.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published