3.6.0

What's Changed

• Fix logging of sensitive information in pai.py by @Ali-Razmjoo in #3310
• Fix overly permissive file permissions in luigi/lock.py by @Ali-Razmjoo in #3308
• Fix unsafe shell command in luigi/contrib/lsf.py by @Ali-Razmjoo in #3307
• Fix arbitrary file write during tarfile extraction in luigi/contrib/lsf_runner.py and luigi/contrib/sge_runner.py by @Ali-Razmjoo in #3309
• add ChoiceListParameter by @kitagry in #3305
• Implement mypy plugin for luigi.Task by @hiro-o918 in #3315
• /history/by_task_id : a method to link each task's history uniquely to the SQL database by @tashrifbillah in #3321
• Replace os.rename with os.replace by @yyyyuki in #3322
• Support Dropbox root_namespace_id for Team Spaces by @smrohrer in #3316
• Validate str type before tuple cast by @ikyasam18 in #3323
• fix(luigi/contrib/postgres.py): replace copy_from with copy_expert by @delhomer in #3324
• Drop Support for Python 3.5 and 3.6 by @dlstadther in #3325
• Version 3.6.0 by @dlstadther in #3328

New Contributors

• @Ali-Razmjoo made their first contribution in #3310
• @yyyyuki made their first contribution in #3322
• @ikyasam18 made their first contribution in #3323
• @delhomer made their first contribution in #3324

Full Changelog: v3.5.2...v3.6.0

3.5.2

What's Changed

• Updated luigi.contrib.azureblob to 12.x.y series of azure.storage.blob by @bcamel in #3290
• Fix batch email configuration docs by @ccmaymay in #3296

New Contributors

• @bcamel made their first contribution in #3290
• @ccmaymay made their first contribution in #3296
• @hiro-o918 made their first contribution in #3297
• @shadchin made their first contribution in #3298
• @radeklat made their first contribution in #3277

Full Changelog: 3.5.1...v3.5.2

3.5.1

What's Changed

• don't convert str to tuple in TupleParameter by @kitagry in #3275
• Fix error message in case of unfulfilled dependencies with single output by @GianlucaFicarelli in #3281
• Add option to remove event handler from luigi.Task by @starhel in #3282
• Fix execution summary for optional parameters by @starhel in #3286
• Support Python3.12 by @ukky17 in #3266
• Fixed visualization of SVG graph for tasks directly dependent on each… by @starhel in #3287
• Version 3.5.1 by @andresgomezfrr in #3291

New Contributors

• @kitagry made their first contribution in #3275
• @GianlucaFicarelli made their first contribution in #3281

Full Changelog: 3.5.0...3.5.1

3.5.0

What's Changed

• worker: Log which outputs are missing when task is unexpectedly incomplete by @progval in #3258
• Update dropbox.py for compatibility with Dropbox SDK v11.X.X by @smrohrer in #3259
• Add python 3.11 support by @ukky17 in #3265
• Migrate readthedocs to version 2 by @pablocasares in #3269
• Added Veridas to companies using Luigi by @ironbar in #3268
• Release 3.5.0 by @RRap0so in #3274

New Contributors

• @smrohrer made their first contribution in #3259
• @ukky17 made their first contribution in #3265
• @pablocasares made their first contribution in #3269
• @ironbar made their first contribution in #3268

Full Changelog: 3.4.0...3.5.0

3.4.0

What's Changed

Added

• Add CodeQL workflow by @jorgectf in #3244

Fixed

• Fix compatibility with cythonized tasks. by @MichaelGrupp in #3246
• fix flake8 error in master by @dlstadther in #3248
• Do not escape
  tags in task tooltips, so that the line breaks are… by @ewallace-RI in #3250
• Silence false positive UnconsumedParameterWarning by @starhel in #3235
• Fix pymssql import by @grihabor in #3252

Full Changelog: 3.3.0...3.4.0

3.3.0

Added

• Add host_config_options to allow configuration of DockerTask for GPU resources #3234

Fixed

• Fix bigquery retry #3238
• Fix for applying logging configurations using the a TOML configuration file #3237

3.2.1

Fixed

luigi

• Fix XSS vulnerability #3230
• Fix typo in range_test.py #3228
• Using default_scheduler_url as a mounting point for not root pat… #3216
• Deduplicate outputs in luigi.task.flatten_output (#3106) #3174

3.2.0

Added

luigi

• Improve control over dynamic requirements #3179
• Can pass a JSON schema to DictParameter and ListParameter #3217
• support Python 3.10 #3140

Fixed

luigi

• Update random seed for python 3.11 compatibility #3204
• Fix md5 hash error for FIPS in python 3.9 #3209
• Catch io.UnsupportedOperation exception #3215
• Fix schema validation and add custom validators #3220

3.1.1

3.1.1

Added

luigi

• Add worker config to cache task completion results. (#3178)

Fixed

luigi

• Close requests.Socket in RemoteScheduler before exiting (#3173) (#3175)
• Use int-parameters for random.randrange() (#3177)
• Alternate (probably more correct) fix for #3182 (supercedes #3183) #3185

3.1.0

3.1.0

Added

luigi

• Documentation guidance around release version increments #3074
• Add support for naming tasks in @requires #3077
• Add traceback_max_length parameter for error email notifications #3086
• Document cause of Unfulfilled dependency error #3105
• Add additional OptionalParameter datatype options #3079
• UI: Add rerun command snippet on "show error" modal #3117
• Add support for updating default config parser after loading luigi #3135
• Allow batch_email.email_interval to be set in config as email-internal-minutes #3125
• Allow TimeDeltaParameter to accept input as "seconds" #3125
• Add EnumListParameter to top-level attribute imports #3144
• Enable metrics_custom_import for MetricCollectors #3146
• Improve warning when a parameter is not consumed by a task #3170

luigi.contrib

• Add configure_job BigQuery property #3098
• Add parquet support to BigQuery #3099
• Add network retry logic to BigQuery #3088
• Add run_task_kwargs property to ECS #3083
• Add pickle_protocol attribute and configuration option to Spark #3001
• Add pg8000 driver support to Postgres #3142

Fixed

luigi

• Fix default value for task.disable_window #3081
• Fix deconstructor of LocalTarget when is_tmp attribute dne #3085
• Improved documentation reference to luigi.format.Nop import #3047
• Fix Python 3.10 deprecation warnings #3150
• Remove unnecessary extra call to cls.get_task_namespace() #3129
• Fix documentation typo in notifications_test.py #3151
• Fix docs ci #3158
• Fix task history rendering #3153
• Move max_shown_tasks and max_graph_nodes documentation to correct section #3156
• Fix ability to subclass Task's Register metaclass #3154
• Replace legacy TravicCI readme badge with GithubActions #3159

luigi.contrib

• Fix apache ci
  • #3091
  • #3113
• Fix documentation typo in sqla #3110
• Fix spark cluster mode error for missing path #3111
• Fix connection object passed to rdbms.CopyToTable's _add_metadata_columns() #3011

Removed

luigi

• Remove @Tarrasch from codeowners #3127

Changed

luigi

• Update license copyright year #3108
• Improve error message on parsing default parameter value #3115
• Group tasks by task class in svg graph #3122
• Upgrade tenacity version #3147
• Enable task search to be case insensitive #3157

luigi.contrib

• Update ExternalPythonProgramTask parameters to OptionalParameter #3130
• Allow newer versions of prometheus-client package #3163