Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Use LMDB and sparse vectors in nn_ensemble backend #381

Merged
merged 12 commits into from
Jan 29, 2020
Merged

Use LMDB and sparse vectors in nn_ensemble backend #381

merged 12 commits into from
Jan 29, 2020

Commits on Jan 28, 2020

  1. Use LMDB and sparse vectors in nn_ensemble backend, instead of aggreg… 

    …ating large vectors in RAM (#363)
    @osma
    osma committed Jan 28, 2020
    Configuration menu
    Copy the full SHA
    a845cbf View commit details
    Browse the repository at this point in the history

  2. fix whitespace

    @osma
    osma committed Jan 28, 2020
    Configuration menu
    Copy the full SHA
    cd18015 View commit details
    Browse the repository at this point in the history

  3. rename helper functions

    @osma
    osma committed Jan 28, 2020
    Configuration menu
    Copy the full SHA
    940f8f4 View commit details
    Browse the repository at this point in the history

  4. Implement --cached option for nn_ensemble using training data stored … 

    …in LMDB
    @osma
    osma committed Jan 28, 2020
    Configuration menu
    Copy the full SHA
    18cb23b View commit details
    Browse the repository at this point in the history

  5. remove unnecessary variable

    @osma
    osma committed Jan 28, 2020
    Configuration menu
    Copy the full SHA
    41d2953 View commit details
    Browse the repository at this point in the history

  6. remove unused import

    @osma
    osma committed Jan 28, 2020
    Configuration menu
    Copy the full SHA
    838947b View commit details
    Browse the repository at this point in the history

  7. make sure the LMDB is cleared between training runs

    @osma
    osma committed Jan 28, 2020
    Configuration menu
    Copy the full SHA
    c7d7f86 View commit details
    Browse the repository at this point in the history

  8. add unit test for idx <-> key conversions

    @osma
    osma committed Jan 28, 2020
    Configuration menu
    Copy the full SHA
    b882a07 View commit details
    Browse the repository at this point in the history

  9. split off helper function for opening LMDB database

    @osma
    osma committed Jan 28, 2020
    Configuration menu
    Copy the full SHA
    8f2de70 View commit details
    Browse the repository at this point in the history

Commits on Jan 29, 2020

  1. Split off idx/key conversions to functions (to fix test coverage issue)

    @osma
    osma committed Jan 29, 2020
    Configuration menu
    Copy the full SHA
    2f46af9 View commit details
    Browse the repository at this point in the history

  2. use csc_matrix for input matrices, as it's most efficient for this shape

    @osma
    osma committed Jan 29, 2020
    Configuration menu
    Copy the full SHA
    b66ef9c View commit details
    Browse the repository at this point in the history

  3. install LMDB dependency in Docker images

    @osma
    osma committed Jan 29, 2020
    Configuration menu
    Copy the full SHA
    7fa3dac View commit details
    Browse the repository at this point in the history