Skip to content
@webdataset

webdataset

High Performance I/O for Large Scale Deep Learning

Popular repositories Loading

  1. webdataset webdataset Public

    A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.

    Python 2.1k 162

  2. tarp tarp Public

    Fast and simple stream processing of files in tar files, useful for deep learning, big data, and many other applications.

    Go 117 15

  3. WebDataset.jl WebDataset.jl Public

    A high performance I/O library for deep learning in Julia, based on the PyTorch WebDataset library

    Julia 9 1

  4. wdsconversions wdsconversions Public

    conversions of standard pytorch datasets to webdataset format

    Jupyter Notebook 1

Repositories

Showing 4 of 4 repositories
  • WebDataset.jl Public

    A high performance I/O library for deep learning in Julia, based on the PyTorch WebDataset library

    webdataset/WebDataset.jl’s past year of commit activity
    Julia 9 MIT 1 0 48 Updated Jul 16, 2024
  • webdataset Public

    A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.

    webdataset/webdataset’s past year of commit activity
    Python 2,100 BSD-3-Clause 162 99 10 Updated Jul 11, 2024
  • tarp Public

    Fast and simple stream processing of files in tar files, useful for deep learning, big data, and many other applications.

    webdataset/tarp’s past year of commit activity
    Go 117 15 6 3 Updated Dec 10, 2023
  • wdsconversions Public

    conversions of standard pytorch datasets to webdataset format

    webdataset/wdsconversions’s past year of commit activity
    Jupyter Notebook 0 1 0 0 Updated Aug 20, 2022

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…