0.4.0

What's Changed

• Add missing nodepool label by @PhilippeMoussalli in #389
• Implement caching by @PhilippeMoussalli in #387
• Preserve divisions when writing and reading by @RobbeSneyders in #391
• Add commoncrawl pipeline that starts from warc paths by @RobbeSneyders in #392
• Standarize fsspec file access by @PhilippeMoussalli in #397
• Correct default pipeline output by @PhilippeMoussalli in #399
• Add output default to cli runner by @PhilippeMoussalli in #405
• Update caching strategy by @PhilippeMoussalli in #407
• [DataComp] Add T-MARS by @NielsRogge in #374
• Update image embedding component by @NielsRogge in #428
• Improve commoncrawl components by @RobbeSneyders in #403
• Detect pipeline attribute during compile/run by @PhilippeMoussalli in #398
• Add option to setup preemptible VMs by @PhilippeMoussalli in #408
• change meta estimation by @PhilippeMoussalli in #409
• Update custom_component.md by @tillwenke in #425
• Handle different base paths explorer by @PhilippeMoussalli in #427
• Incorporate dask client by @mrchtr in #410
• Set dask local scheduler as default by @mrchtr in #438
• Use auto_mkdir in fs_open calls by @mrchtr in #442

New Contributors

• @tillwenke made their first contribution in #425

Full Changelog: 0.3.2...0.4.0