Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature/pytorch tpu container #14

Merged
merged 22 commits into from
Mar 26, 2024
Merged

Feature/pytorch tpu container #14

merged 22 commits into from
Mar 26, 2024

Commits on Feb 15, 2024

  1. PyTorch TPU Dockerfile

    @shub-kris
    shub-kris committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    d20a488 View commit details
    Browse the repository at this point in the history

  2. PyTorch TPU Dockerfile

    @shub-kris
    shub-kris committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    84ca2b2 View commit details
    Browse the repository at this point in the history

Commits on Feb 16, 2024

  1. Add Notebook

    @shub-kris
    shub-kris committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    42bbd21 View commit details
    Browse the repository at this point in the history

  2. remove: unused dockerfile, sentence-transformers

    @shub-kris
    shub-kris committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    e679d99 View commit details
    Browse the repository at this point in the history

Commits on Feb 21, 2024

  1. Add example with PyTorch_XLA TPU DLC

    @shub-kris
    shub-kris committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    5447403 View commit details
    Browse the repository at this point in the history

  2. Update README to add Single-Host

    @shub-kris
    shub-kris committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    9b2fb84 View commit details
    Browse the repository at this point in the history

  3. Add more info about different hosts

    @shub-kris
    shub-kris committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    de6c186 View commit details
    Browse the repository at this point in the history

Commits on Feb 22, 2024

  1. Replace manual training script with trainer

    @shub-kris
    shub-kris committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    4680bcd View commit details
    Browse the repository at this point in the history

Commits on Feb 23, 2024

  1. Add Dolly, use TRL and OPT-350M

    @shub-kris
    shub-kris committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    0901c59 View commit details
    Browse the repository at this point in the history

  2. Push local changes

    @shub-kris
    shub-kris committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    c2e8a3b View commit details
    Browse the repository at this point in the history

Commits on Feb 26, 2024

  1. Merge branch 'feature/pytorch-tpu-transformers-example' into feature/… 

    …pytorch-tpu-container
    @shub-kris
    shub-kris committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    815b0df View commit details
    Browse the repository at this point in the history

  2. Change name, add transformers trainer example

    @shub-kris
    shub-kris committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    e935b17 View commit details
    Browse the repository at this point in the history

Commits on Feb 28, 2024

  1. Update dockerfile and example according to nightly version

    @shub-kris
    shub-kris committed Feb 28, 2024
    Configuration menu
    Copy the full SHA
    6747611 View commit details
    Browse the repository at this point in the history

  2. Add info to add token

    @shub-kris
    shub-kris committed Feb 28, 2024
    Configuration menu
    Copy the full SHA
    68f94b4 View commit details
    Browse the repository at this point in the history

Commits on Feb 29, 2024

  1. checkpointing is faster with this base image

    @shub-kris
    shub-kris committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    79872fd View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2024

  1. Build transformers and trl from main for checkpointing and sfttrainer… 

    … fix
    @shub-kris
    shub-kris committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    2a80fe2 View commit details
    Browse the repository at this point in the history

  2. Update README

    @shub-kris
    shub-kris committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    b53b200 View commit details
    Browse the repository at this point in the history

  3. Change parameters

    @shub-kris
    shub-kris committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    e75a3dd View commit details
    Browse the repository at this point in the history

Commits on Mar 15, 2024

  1. Change paramters, add example for LLama

    @shub-kris
    shub-kris committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    e3041ad View commit details
    Browse the repository at this point in the history

  2. Rename folder

    @shub-kris
    shub-kris committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    7f2e378 View commit details
    Browse the repository at this point in the history

  3. llama-example: name of function from train_gemma to train_llama

    @shub-kris
    shub-kris committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    6bb2197 View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2024

  1. update(tpu-examples): change model to gemma-7b, add inference at the … 

    …end of training.
    @shub-kris
    shub-kris committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    b119483 View commit details
    Browse the repository at this point in the history