Skip to content

Releases: spotify/luigi

3.5.2

04 Sep 11:57
74e6e63
Compare
Choose a tag to compare

What's Changed

  • Updated luigi.contrib.azureblob to 12.x.y series of azure.storage.blob by @bcamel in #3290
  • Fix batch email configuration docs by @ccmaymay in #3296

New Contributors

Full Changelog: 3.5.1...v3.5.2

3.5.1

20 May 08:20
3cafd15
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Changelog: 3.5.0...3.5.1

3.5.0

15 Jan 15:33
367edc2
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Changelog: 3.4.0...3.5.0

3.4.0

05 Oct 11:21
319ce20
Compare
Choose a tag to compare

What's Changed

Added

Fixed

Full Changelog: 3.3.0...3.4.0

3.3.0

04 May 09:55
81f13fc
Compare
Choose a tag to compare

Added

  • Add host_config_options to allow configuration of DockerTask for GPU resources #3234

Fixed

  • Fix bigquery retry #3238
  • Fix for applying logging configurations using the a TOML configuration file #3237

3.2.1

14 Mar 09:49
18bf067
Compare
Choose a tag to compare

Fixed

luigi

  • Fix XSS vulnerability #3230
  • Fix typo in range_test.py #3228
  • Using default_scheduler_url as a mounting point for not root pat… #3216
  • Deduplicate outputs in luigi.task.flatten_output (#3106) #3174

3.2.0

18 Jan 16:10
9d50be4
Compare
Choose a tag to compare

Added

luigi

  • Improve control over dynamic requirements #3179
  • Can pass a JSON schema to DictParameter and ListParameter #3217
  • support Python 3.10 #3140

Fixed

luigi

  • Update random seed for python 3.11 compatibility #3204
  • Fix md5 hash error for FIPS in python 3.9 #3209
  • Catch io.UnsupportedOperation exception #3215
  • Fix schema validation and add custom validators #3220

3.1.1

18 Aug 09:37
bc12ca3
Compare
Choose a tag to compare

3.1.1

Added

luigi

  • Add worker config to cache task completion results. (#3178)

Fixed

luigi

  • Close requests.Socket in RemoteScheduler before exiting (#3173) (#3175)
  • Use int-parameters for random.randrange() (#3177)
  • Alternate (probably more correct) fix for #3182 (supercedes #3183) #3185

3.1.0

20 Jun 12:19
a295041
Compare
Choose a tag to compare

3.1.0

Added

luigi

  • Documentation guidance around release version increments #3074
  • Add support for naming tasks in @requires #3077
  • Add traceback_max_length parameter for error email notifications #3086
  • Document cause of Unfulfilled dependency error #3105
  • Add additional OptionalParameter datatype options #3079
  • UI: Add rerun command snippet on "show error" modal #3117
  • Add support for updating default config parser after loading luigi #3135
  • Allow batch_email.email_interval to be set in config as email-internal-minutes #3125
  • Allow TimeDeltaParameter to accept input as "seconds" #3125
  • Add EnumListParameter to top-level attribute imports #3144
  • Enable metrics_custom_import for MetricCollectors #3146
  • Improve warning when a parameter is not consumed by a task #3170

luigi.contrib

  • Add configure_job BigQuery property #3098
  • Add parquet support to BigQuery #3099
  • Add network retry logic to BigQuery #3088
  • Add run_task_kwargs property to ECS #3083
  • Add pickle_protocol attribute and configuration option to Spark #3001
  • Add pg8000 driver support to Postgres #3142

Fixed

luigi

  • Fix default value for task.disable_window #3081
  • Fix deconstructor of LocalTarget when is_tmp attribute dne #3085
  • Improved documentation reference to luigi.format.Nop import #3047
  • Fix Python 3.10 deprecation warnings #3150
  • Remove unnecessary extra call to cls.get_task_namespace() #3129
  • Fix documentation typo in notifications_test.py #3151
  • Fix docs ci #3158
  • Fix task history rendering #3153
  • Move max_shown_tasks and max_graph_nodes documentation to correct section #3156
  • Fix ability to subclass Task's Register metaclass #3154
  • Replace legacy TravicCI readme badge with GithubActions #3159

luigi.contrib

  • Fix apache ci
  • Fix documentation typo in sqla #3110
  • Fix spark cluster mode error for missing path #3111
  • Fix connection object passed to rdbms.CopyToTable's _add_metadata_columns() #3011

Removed

luigi

  • Remove @Tarrasch from codeowners #3127

Changed

luigi

  • Update license copyright year #3108
  • Improve error message on parsing default parameter value #3115
  • Group tasks by task class in svg graph #3122
  • Upgrade tenacity version #3147
  • Enable task search to be case insensitive #3157

luigi.contrib

  • Update ExternalPythonProgramTask parameters to OptionalParameter #3130
  • Allow newer versions of prometheus-client package #3163

3.0.3

15 Apr 11:39
f2f631b
Compare
Choose a tag to compare

Added:

luigi
  • Adding retry on _obj_exists #3022
  • don't use absolute path in redirect for visualizer #2785
luigi.contrib
  • kubernetes: labels are applied to pod #3007

Fixed:

luigi
  • Flush stream_for_searching_tracking_url #3000
luigi.contrib
  • Fix azureblob tests: use json instead of numpy #3032

Changed:

luigi
  • replace naive retry with tenacity #3026