Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add auto configurator to NeMo #10270

Merged
merged 66 commits into from
Sep 7, 2024
Merged

add auto configurator to NeMo #10270

merged 66 commits into from
Sep 7, 2024

Commits on Aug 27, 2024

  1. add base configs 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    cd3bb0b View commit details
    Browse the repository at this point in the history

  2. add auto configurator functionality 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    28d3c02 View commit details
    Browse the repository at this point in the history

  3. Apply isort and black reformatting 

    Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>
    @dimapihtar
    dimapihtar committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    cf50b14 View commit details
    Browse the repository at this point in the history

  4. add runner 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    e89ed25 View commit details
    Browse the repository at this point in the history

  5. add end-to-end example for auto configurator 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    0a2a6a0 View commit details
    Browse the repository at this point in the history

  6. add unit tests for auto configurator 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    b0d8478 View commit details
    Browse the repository at this point in the history

  7. add GPT configs 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    8189de9 View commit details
    Browse the repository at this point in the history

  8. add GPT configs 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    a551658 View commit details
    Browse the repository at this point in the history

  9. Apply isort and black reformatting 

    Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>
    @dimapihtar
    dimapihtar committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    a28f77b View commit details
    Browse the repository at this point in the history

  10. switch to dataclass 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    35522ab View commit details
    Browse the repository at this point in the history

  11. Apply isort and black reformatting 

    Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>
    @dimapihtar
    dimapihtar committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    399385b View commit details
    Browse the repository at this point in the history

  12. switch to dataclass 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    b616b41 View commit details
    Browse the repository at this point in the history

  13. Apply isort and black reformatting 

    Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>
    @dimapihtar
    dimapihtar committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    80054d7 View commit details
    Browse the repository at this point in the history

  14. fix dataclasses usage 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    227a738 View commit details
    Browse the repository at this point in the history

  15. Apply isort and black reformatting 

    Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>
    @dimapihtar
    dimapihtar committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    d0acbca View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2024

  1. remove unused imports 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    9a26476 View commit details
    Browse the repository at this point in the history

  2. remove extra function 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    1315031 View commit details
    Browse the repository at this point in the history

  3. fix docstring style 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    1aafc20 View commit details
    Browse the repository at this point in the history

  4. Apply isort and black reformatting 

    Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>
    @dimapihtar
    dimapihtar committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    bda0100 View commit details
    Browse the repository at this point in the history

  5. take Config object as input for model 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    6d5305e View commit details
    Browse the repository at this point in the history

  6. Apply isort and black reformatting 

    Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>
    @dimapihtar
    dimapihtar committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    bb86c39 View commit details
    Browse the repository at this point in the history

  7. add nemotron support 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    a2099af View commit details
    Browse the repository at this point in the history

  8. Apply isort and black reformatting 

    Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>
    @dimapihtar
    dimapihtar committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    86694e6 View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2024

  1. remove search_config.py 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    0b896b7 View commit details
    Browse the repository at this point in the history

  2. Apply isort and black reformatting 

    Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>
    @dimapihtar
    dimapihtar committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    2d062b0 View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2024

  1. move configs creation to Basic class 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    1e30118 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into dpykhtar/autoconf

    @dimapihtar
    dimapihtar authored Sep 3, 2024
    Configuration menu
    Copy the full SHA
    1f8dde6 View commit details
    Browse the repository at this point in the history

  3. Apply isort and black reformatting 

    Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>
    @dimapihtar
    dimapihtar committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    14b9549 View commit details
    Browse the repository at this point in the history

  4. move to common basic class 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    e1ccec1 View commit details
    Browse the repository at this point in the history

  5. Apply isort and black reformatting 

    Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>
    @dimapihtar
    dimapihtar committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    c641b7d View commit details
    Browse the repository at this point in the history

  6. rename main config 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    71b0420 View commit details
    Browse the repository at this point in the history

  7. remove base configs for models 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    4103009 View commit details
    Browse the repository at this point in the history

  8. Apply isort and black reformatting 

    Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>
    @dimapihtar
    dimapihtar committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    e3793ad View commit details
    Browse the repository at this point in the history

  9. Apply isort and black reformatting 

    Signed-off-by: artbataev <artbataev@users.noreply.github.com>
    @artbataev
    artbataev committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    5815586 View commit details
    Browse the repository at this point in the history

  10. change auto conf functionality 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    4d03be0 View commit details
    Browse the repository at this point in the history

  11. Apply isort and black reformatting 

    Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>
    @dimapihtar
    dimapihtar committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    f812e2b View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2024

  1. fix docstring 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    97f9e61 View commit details
    Browse the repository at this point in the history

  2. Apply isort and black reformatting 

    Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>
    @dimapihtar
    dimapihtar committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    d2fed7a View commit details
    Browse the repository at this point in the history

  3. remove unused imports 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    eb9bae5 View commit details
    Browse the repository at this point in the history

  4. add changes 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    4606ef3 View commit details
    Browse the repository at this point in the history

  5. remove activations_checkpoint_num_layers 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    a4e8128 View commit details
    Browse the repository at this point in the history

  6. remove gbs from config 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    b853a83 View commit details
    Browse the repository at this point in the history

  7. fix logs 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    7040056 View commit details
    Browse the repository at this point in the history

  8. Apply isort and black reformatting 

    Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>
    @dimapihtar
    dimapihtar committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    ae744ae View commit details
    Browse the repository at this point in the history

  9. fix performance calculation 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    eda32ce View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2024

  1. fix end-to-end example 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    ae46957 View commit details
    Browse the repository at this point in the history

  2. Apply isort and black reformatting 

    Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>
    @dimapihtar
    dimapihtar committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    1fe46ed View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into dpykhtar/autoconf

    @dimapihtar
    dimapihtar authored Sep 5, 2024
    Configuration menu
    Copy the full SHA
    25b8e3f View commit details
    Browse the repository at this point in the history

  4. fix model config 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    38082d9 View commit details
    Browse the repository at this point in the history

  5. Apply isort and black reformatting 

    Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>
    @dimapihtar
    dimapihtar committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    0ce1672 View commit details
    Browse the repository at this point in the history

  6. minor changes 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    41c9f29 View commit details
    Browse the repository at this point in the history

  7. minor changes 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    3fdcc83 View commit details
    Browse the repository at this point in the history

  8. Apply isort and black reformatting 

    Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>
    @dimapihtar
    dimapihtar committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    3fbcc16 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2024

  1. fix unit tests 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    010e0de View commit details
    Browse the repository at this point in the history

  2. Apply isort and black reformatting 

    Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>
    @dimapihtar
    dimapihtar committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    7fd82cf View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into dpykhtar/autoconf

    @dimapihtar
    dimapihtar authored Sep 6, 2024
    Configuration menu
    Copy the full SHA
    3a345e8 View commit details
    Browse the repository at this point in the history

  4. add README 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    83e537d View commit details
    Browse the repository at this point in the history

  5. fix README 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    1aa3636 View commit details
    Browse the repository at this point in the history

  6. fix README 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    649eb44 View commit details
    Browse the repository at this point in the history

  7. fix readme 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    c642281 View commit details
    Browse the repository at this point in the history

  8. fix readme 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    7309603 View commit details
    Browse the repository at this point in the history

  9. remove extra arg 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    df1dcb8 View commit details
    Browse the repository at this point in the history

  10. remove unused imports 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    25a148a View commit details
    Browse the repository at this point in the history

  11. add nemo-run installation 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    f006372 View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2024

  1. fix unit tests 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 7, 2024
    Configuration menu
    Copy the full SHA
    9dda193 View commit details
    Browse the repository at this point in the history

  2. fix unit tests 

    Signed-off-by: dimapihtar <dpihtar@gmail.com>
    @dimapihtar
    dimapihtar committed Sep 7, 2024
    Configuration menu
    Copy the full SHA
    c4c5ecb View commit details
    Browse the repository at this point in the history