Release 0.9.3

Server mode changes

Project archives can now be stored in S3 instead of the database. This is configured using the archive.s3.bucket, archive.s3.credentials.access-key-id and archive.s3.credentials.secret-access-key configuration parameters.

Workflow changes

The emr> operator now uses ${secret:<key>} syntax.
The http> operator now allows secrets in headers, content and uri using ${secret:<key>} syntax.
Declaring secret access using _secrets is no longer necessary and has been deprecated.
It is now possible to use secrets in td_load> and embulk> configuration using ${secret:<key>} syntax.
The td_run> operator can now run a saved query by id. If the operator command is a number, the query with that id will be run.
The td_ddl> operator now allows entire parameter lists to be parameterized.

General Changes

Secret access limits and policies have been removed. Operators can now access any secret.
Backfills now run sequentially instead of all sessions in parallel.
The Digdag client now sends a User-Agent header that includes the build artifact version.
Project metadata compilation has been moved to the server. The project tarball no longer needs to include a .digdag.dig file when pushing.

Release Date

2017-01-17

Contributors

Daniel Norberg
Mitsunori Komatsu
Sadayuki Furuhashi