Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Move GaaS sources, tests, docs, scripts from the rapidsai/GaaS repo to the cugraph repo #2661

Merged
merged 82 commits into from
Sep 2, 2022
Merged

Move GaaS sources, tests, docs, scripts from the rapidsai/GaaS repo to the cugraph repo #2661

merged 82 commits into from
Sep 2, 2022
+4,509 −0

Commits on Apr 21, 2022

  1. first commit

    @rlratzel
    rlratzel committed Apr 21, 2022
    Configuration menu
    Copy the full SHA
    41ed4ca View commit details
    Browse the repository at this point in the history

  2. Initial version of GaaS which includes a client and server with APIs … 

    …for graph management and a sampling algo (node2vec). This also includes test cases and a demo script.
    @rlratzel
    rlratzel committed Apr 21, 2022
    Configuration menu
    Copy the full SHA
    70abd33 View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2022

  1. Cleaned up and added documentation, fixed mechanism to find datasets … 

    …in demo1.py
    @rlratzel
    rlratzel committed Apr 22, 2022
    Configuration menu
    Copy the full SHA
    68b86f3 View commit details
    Browse the repository at this point in the history

  2. Added more info to README.md

    @rlratzel
    rlratzel committed Apr 22, 2022
    Configuration menu
    Copy the full SHA
    52b793b View commit details
    Browse the repository at this point in the history

  3. Merge pull request #1 from rlratzel/main 

    Create initial version of GaaS client, server, tests, and demo
    @rlratzel
    rlratzel authored Apr 22, 2022
    Configuration menu
    Copy the full SHA
    b32b286 View commit details
    Browse the repository at this point in the history

Commits on May 15, 2022

  1. Initial passing test for support for server-side extensions.

    @rlratzel
    rlratzel committed May 15, 2022
    Configuration menu
    Copy the full SHA
    b586718 View commit details
    Browse the repository at this point in the history

Commits on May 16, 2022

  1. Added ability to unload extensions, added load/unload/call graph crea… 

    …tion extensions functions to Thrift and client API.
    @rlratzel
    rlratzel committed May 16, 2022
    Configuration menu
    Copy the full SHA
    873ea8b View commit details
    Browse the repository at this point in the history

Commits on May 17, 2022

  1. Added proper CLI parsing, added CLI option to read a graph creation e… 

    …xtension dir at startup.
    @rlratzel
    rlratzel committed May 17, 2022
    Configuration menu
    Copy the full SHA
    00a7535 View commit details
    Browse the repository at this point in the history

  2. Updated client tests with fixture to auto start and stop a server sub… 

    …process.
    @rlratzel
    rlratzel committed May 17, 2022
    Configuration menu
    Copy the full SHA
    8256c10 View commit details
    Browse the repository at this point in the history

Commits on May 18, 2022

  1. Added uptime() function (mainly to use as a ping function) and change… 

    …d tests to use that to determine if the server was ready, updated tests to cover preloaded extensions from the server CLI.
    @rlratzel
    rlratzel committed May 18, 2022
    Configuration menu
    Copy the full SHA
    b3eec7d View commit details
    Browse the repository at this point in the history

  2. Renamed test_client.py to test_e2e.py to better reflect that it is an… 

    … end-to-end test and not just a unit test for the client API, made changes to allow tests to run without setting PYTHONPATH.
    @rlratzel
    rlratzel committed May 18, 2022
    Configuration menu
    Copy the full SHA
    cfc86fe View commit details
    Browse the repository at this point in the history

  3. docstring formatting updates.

    @rlratzel
    rlratzel committed May 18, 2022
    Configuration menu
    Copy the full SHA
    6a98c80 View commit details
    Browse the repository at this point in the history

  4. Docstring updates.

    @rlratzel
    rlratzel committed May 18, 2022
    Configuration menu
    Copy the full SHA
    6386b5c View commit details
    Browse the repository at this point in the history

  5. Minor tweak to docstring.

    @rlratzel
    rlratzel committed May 18, 2022
    Configuration menu
    Copy the full SHA
    6972b2b View commit details
    Browse the repository at this point in the history

  6. Fixed imports to use absolute names, raising GaasError instead of all… 

    …owing thriftpy2.transport.TTransportError to be raised so users do not need to import thriftpy2 to catch exceptions from GaaS.
    @rlratzel
    rlratzel committed May 18, 2022
    Configuration menu
    Copy the full SHA
    b8a923e View commit details
    Browse the repository at this point in the history

  7. Added option to set client connection timeout when making APIs calls … 

    …with a default of 90 seconds.
    @rlratzel
    rlratzel committed May 18, 2022
    Configuration menu
    Copy the full SHA
    79cba4f View commit details
    Browse the repository at this point in the history

Commits on May 22, 2022

  1. Initial version of get_graph_vertex_dataframe_rows() working, still n… 

    …eeds cleanup and docs.
    @rlratzel
    rlratzel committed May 22, 2022
    Configuration menu
    Copy the full SHA
    6cb91e7 View commit details
    Browse the repository at this point in the history

  2. Removed custom Thrift type not needed, added assertions to tests and … 

    …removed debugging code.
    @rlratzel
    rlratzel committed May 22, 2022
    Configuration menu
    Copy the full SHA
    761b337 View commit details
    Browse the repository at this point in the history

  3. Refactor in preparation for get_graph_edge_dataframe_rows(), added su… 

    …pport for retrieving the entire table if necessary instead of just individual rows.
    @rlratzel
    rlratzel committed May 22, 2022
    Configuration menu
    Copy the full SHA
    d03d70d View commit details
    Browse the repository at this point in the history

  4. Merge pull request rapidsai#8 from rlratzel/branch-22.06-updates_for_… 

    …dgl_1

Add ability to load graphs server-side using custom functions
    @rlratzel
    rlratzel authored May 22, 2022
    Configuration menu
    Copy the full SHA
    1ecf61a View commit details
    Browse the repository at this point in the history

  5. Merge branch 'branch-22.06-updates_for_dgl_1' into branch-22.06-updat… 

    …es_for_dgl_2
    @rlratzel
    rlratzel committed May 22, 2022
    Configuration menu
    Copy the full SHA
    e668087 View commit details
    Browse the repository at this point in the history

  6. Refactorings to reuse code easier, added shape API and edges APIs and… 

    … tests to match the corresponding get_graph_vertex_dataframe_*() APIs.

(this uncovered assumptions in the tests about the internal dataframe ordering which are currently non-deterministic, still working on this)
    @rlratzel
    rlratzel committed May 22, 2022
    Configuration menu
    Copy the full SHA
    a6d8f04 View commit details
    Browse the repository at this point in the history

Commits on May 23, 2022

  1. Updated tests to not be sensitive to the PG internal dataframe row or… 

    …der.
    @rlratzel
    rlratzel committed May 23, 2022
    Configuration menu
    Copy the full SHA
    ba3b2de View commit details
    Browse the repository at this point in the history

  2. Added batched_ego_graphs() API and test.

    @rlratzel
    rlratzel committed May 23, 2022
    Configuration menu
    Copy the full SHA
    a45740c View commit details
    Browse the repository at this point in the history

Commits on May 24, 2022

  1. Added API and test for retrieving edge IDs for a list of edges.

    @rlratzel
    rlratzel committed May 24, 2022
    Configuration menu
    Copy the full SHA
    384460c View commit details
    Browse the repository at this point in the history

  2. Changed method to get data from device to host and also sending numpy… 

    … bytes over RPC call.
    @rlratzel
    rlratzel committed May 24, 2022
    Configuration menu
    Copy the full SHA
    3c03460 View commit details
    Browse the repository at this point in the history

  3. Changed binary fields in return struct to lists but only convert from… 

    … cudf to numpy (and omit tolist()) for return types. Still need to remove debug prints!
    @rlratzel
    rlratzel committed May 24, 2022
    Configuration menu
    Copy the full SHA
    b8f13ad View commit details
    Browse the repository at this point in the history

Commits on May 27, 2022

  1. some updates for pyg

    @alexbarghi-nv
    alexbarghi-nv committed May 27, 2022
    Configuration menu
    Copy the full SHA
    4a2e40b View commit details
    Browse the repository at this point in the history

  2. remove useless files

    @alexbarghi-nv
    alexbarghi-nv committed May 27, 2022
    Configuration menu
    Copy the full SHA
    5400e40 View commit details
    Browse the repository at this point in the history

  3. merge rick's changes

    @alexbarghi-nv
    alexbarghi-nv committed May 27, 2022
    Configuration menu
    Copy the full SHA
    c00bb10 View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2022

  1. gaas changes for support of property access in PyG

    @alexbarghi-nv
    alexbarghi-nv committed Jun 3, 2022
    Configuration menu
    Copy the full SHA
    3197825 View commit details
    Browse the repository at this point in the history

  2. remove useless file

    @alexbarghi-nv
    alexbarghi-nv committed Jun 3, 2022
    Configuration menu
    Copy the full SHA
    be5f73d View commit details
    Browse the repository at this point in the history

  3. remove useless files

    @alexbarghi-nv
    alexbarghi-nv committed Jun 3, 2022
    Configuration menu
    Copy the full SHA
    10f3302 View commit details
    Browse the repository at this point in the history

  4. remove cufile

    @alexbarghi-nv
    alexbarghi-nv committed Jun 3, 2022
    Configuration menu
    Copy the full SHA
    a40bb43 View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2022

  1. Merge pull request rapidsai#10 from alexbarghi-nv/updates_for_pyg_aba… 

    …rghi_01

Updates to GaaS for PyG and DGL
    @rlratzel
    rlratzel authored Jun 8, 2022
    Configuration menu
    Copy the full SHA
    80a72b9 View commit details
    Browse the repository at this point in the history

  2. Updates to make server single-threaded. Also added some crude test sc… 

    …ripts to ensure 8 clients can concurrently access the server without problems.
    @rlratzel
    rlratzel committed Jun 8, 2022
    Configuration menu
    Copy the full SHA
    5e4e39a View commit details
    Browse the repository at this point in the history

  3. Removed unused import.

    @rlratzel
    rlratzel committed Jun 8, 2022
    Configuration menu
    Copy the full SHA
    7c5c997 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2022

  1. updates for pyg

    @alexbarghi-nv
    alexbarghi-nv committed Jun 13, 2022
    Configuration menu
    Copy the full SHA
    9cbdb62 View commit details
    Browse the repository at this point in the history

  2. remove uselsess file

    @alexbarghi-nv
    alexbarghi-nv committed Jun 13, 2022
    Configuration menu
    Copy the full SHA
    8159078 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'branch-22.06' of https://github.com/rapidsai/gaas into … 

    …updates_for_pyg_abarghi_01
    @alexbarghi-nv
    alexbarghi-nv committed Jun 13, 2022
    Configuration menu
    Copy the full SHA
    0a11019 View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2022

  1. remove unwanted files

    @alexbarghi-nv
    alexbarghi-nv committed Jun 14, 2022
    Configuration menu
    Copy the full SHA
    ec82b5f View commit details
    Browse the repository at this point in the history

  2. remove cufile

    @alexbarghi-nv
    alexbarghi-nv committed Jun 14, 2022
    Configuration menu
    Copy the full SHA
    cb148f5 View commit details
    Browse the repository at this point in the history

  3. Merge pull request rapidsai#12 from alexbarghi-nv/updates_for_pyg_aba… 

    …rghi_02

Add Methods to Check Property Validity
    @rlratzel
    rlratzel authored Jun 14, 2022
    Configuration menu
    Copy the full SHA
    aac9d1e View commit details
    Browse the repository at this point in the history

  4. Merge pull request rapidsai#11 from rlratzel/single_threaded_server 

    Updates to make server single-threaded
    @rlratzel
    rlratzel authored Jun 14, 2022
    Configuration menu
    Copy the full SHA
    fa42690 View commit details
    Browse the repository at this point in the history

Commits on Jun 16, 2022

  1. updating the README and adding missing parts

    @BradReesWork
    BradReesWork committed Jun 16, 2022
    Configuration menu
    Copy the full SHA
    71ba0ed View commit details
    Browse the repository at this point in the history

  2. Merge pull request rapidsai#16 from BradReesWork/branch-22.06 

    updating the README and adding missing parts
    @rlratzel
    rlratzel authored Jun 16, 2022
    Configuration menu
    Copy the full SHA
    dcc3431 View commit details
    Browse the repository at this point in the history

  3. Added initial tests and CLI options for having the handler use a dask… 

    … cluster.
    @rlratzel
    rlratzel committed Jun 16, 2022
    Configuration menu
    Copy the full SHA
    66ceb0c View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'upstream/branch-22.08' into branch-22.0… 

    …8-mg_updates
    @rlratzel
    rlratzel committed Jun 16, 2022
    Configuration menu
    Copy the full SHA
    42b03e1 View commit details
    Browse the repository at this point in the history

Commits on Jun 17, 2022

  1. uniform neighbor sampling

    @alexbarghi-nv
    alexbarghi-nv committed Jun 17, 2022
    Configuration menu
    Copy the full SHA
    9779388 View commit details
    Browse the repository at this point in the history

  2. Delete .nfs0000000001128f2f00000e4d

    @alexbarghi-nv
    alexbarghi-nv authored Jun 17, 2022
    Configuration menu
    Copy the full SHA
    51e93c5 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2022

  1. add renumber=True to from_cudf_edgelist call

    @alexbarghi-nv
    alexbarghi-nv committed Jun 21, 2022
    Configuration menu
    Copy the full SHA
    19f0b30 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'uniform_neighbor_sampling' of https://github.com/alexba… 

    …rghi-nv/gaas into uniform_neighbor_sampling
    @alexbarghi-nv
    alexbarghi-nv committed Jun 21, 2022
    Configuration menu
    Copy the full SHA
    61fe30e View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2022

  1. graphsage updates

    @alexbarghi-nv
    alexbarghi-nv committed Jun 22, 2022
    Configuration menu
    Copy the full SHA
    7bd0927 View commit details
    Browse the repository at this point in the history

Commits on Jun 29, 2022

  1. Merge remote-tracking branch 'alexbarghi-nv/uniform_neighbor_sampling… 

    …' into branch-22.08-mg_updates

Added updates for initial support for MGPropertyGraph and additional tests
    @rlratzel
    rlratzel committed Jun 29, 2022
    Configuration menu
    Copy the full SHA
    a999733 View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2022

  1. Updates to handle closing dask client connection properly, added test… 

    …s and updates for shape methods for MG.
    @rlratzel
    rlratzel committed Jun 30, 2022
    Configuration menu
    Copy the full SHA
    46f08da View commit details
    Browse the repository at this point in the history

Commits on Jul 14, 2022

  1. Removed shape APIs and replaced with info APIs, reordered methods for… 

    … consistency, moved graph_id arg to end for uniform_neighbor_sampling for consistency, added tests for info APIs, temporarily disabled vertex shape test while discussing if it is needed or not.
    @rlratzel
    rlratzel committed Jul 14, 2022
    Configuration menu
    Copy the full SHA
    de4dcec View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2022

  1. Added code and tests for supporting the new get_graph_info() API and … 

    …ensuring it can support the use cases for the old shape() APIs.
    @rlratzel
    rlratzel committed Jul 16, 2022
    Configuration menu
    Copy the full SHA
    c1d1327 View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2022

  1. resolve conflict

    @alexbarghi-nv
    alexbarghi-nv committed Jul 19, 2022
    Configuration menu
    Copy the full SHA
    f0dcc47 View commit details
    Browse the repository at this point in the history

  2. fix neighbor sampling to work with current api

    @alexbarghi-nv
    alexbarghi-nv committed Jul 19, 2022
    Configuration menu
    Copy the full SHA
    76c6087 View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2022

  1. Updated graph_info API to use new keys consistent with PG updates.

    @rlratzel
    rlratzel committed Aug 8, 2022
    Configuration menu
    Copy the full SHA
    21aa53a View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2022

  1. Updates to accommodate latest PG changes, removed get_num_*() APIs wh… 

    …ich are obsoleted by get_graph_info(), removed now invalide taxpayers data, updated tests for these changes.
    @rlratzel
    rlratzel committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    fc280b3 View commit details
    Browse the repository at this point in the history

Commits on Aug 17, 2022

  1. Started new test for uniform_neighbor_sampling.

    @rlratzel
    rlratzel committed Aug 17, 2022
    Configuration menu
    Copy the full SHA
    00712af View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'alexbarghi-nv/uniform_neighbor_sampling… 

    …' into branch-22.10-mg_updates
    @rlratzel
    rlratzel committed Aug 17, 2022
    Configuration menu
    Copy the full SHA
    fdd5a05 View commit details
    Browse the repository at this point in the history

  3. Update python/gaas_server/gaas_handler.py 

    Co-authored-by: Rick Ratzel <3039903+rlratzel@users.noreply.github.com>
    @alexbarghi-nv @rlratzel
    alexbarghi-nv and rlratzel authored Aug 17, 2022
    Configuration menu
    Copy the full SHA
    94ee72e View commit details
    Browse the repository at this point in the history

  4. remove unused imports

    @alexbarghi-nv
    alexbarghi-nv committed Aug 17, 2022
    Configuration menu
    Copy the full SHA
    ea7c307 View commit details
    Browse the repository at this point in the history

  5. Merge pull request rapidsai#18 from alexbarghi-nv/uniform_neighbor_sa… 

    …mpling

Updates to GaaS for Uniform Neighbor Sampling
    @rlratzel
    rlratzel authored Aug 17, 2022
    Configuration menu
    Copy the full SHA
    a34c43c View commit details
    Browse the repository at this point in the history

Commits on Aug 18, 2022

  1. Updated SG uniform_neighbor_sampling test to add a passing case.

    @rlratzel
    rlratzel committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    a156199 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/branch-22.08' into branch-22.1… 

    …0-mg_updates
    @rlratzel
    rlratzel committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    55abf5d View commit details
    Browse the repository at this point in the history

  3. Initial working version of MG support for uniform_neighbor_sampling.

    @rlratzel
    rlratzel committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    f0700aa View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2022

  1. Added code to allow the server facade arg to extension functions to b… 

    …e optional, updated adn added tests accordingly.
    @rlratzel
    rlratzel committed Aug 19, 2022
    Configuration menu
    Copy the full SHA
    6151b58 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2022

  1. Removed get_graph_*_dataframe_rows() and replaced them with get_graph… 

    …_*_data(). Added MG and SG tests to cover different ID types (exposed after a typo went unchecked). Added MG and SG tests to cover get_graph_*_data(). Minor cleanup and refactorings.
    @rlratzel
    rlratzel committed Aug 30, 2022
    Configuration menu
    Copy the full SHA
    99a1370 View commit details
    Browse the repository at this point in the history

  2. Moved/renamed files in preparation for migrating to https://github.co… 

    …m/rapidsai/cugraph repo.
    @rlratzel
    rlratzel committed Aug 30, 2022
    Configuration menu
    Copy the full SHA
    2570a7d View commit details
    Browse the repository at this point in the history

  3. Moved helper scripts to new location in preparation for migration to h… 

    …ttps://github.com/rapidsai/cugraph
    @rlratzel
    rlratzel committed Aug 30, 2022
    Configuration menu
    Copy the full SHA
    2485177 View commit details
    Browse the repository at this point in the history

  4. Deleted unused docs folder, moved images and README.md in preparation… 

    … for migration to https://github.com/rapidsai/cugraph
    @rlratzel
    rlratzel committed Aug 30, 2022
    Configuration menu
    Copy the full SHA
    ea3b6eb View commit details
    Browse the repository at this point in the history

  5. Removed all instances of "gaas" strings from source code.

    @rlratzel
    rlratzel committed Aug 30, 2022
    Configuration menu
    Copy the full SHA
    d8320a4 View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2022

  1. Updated tests for new cugraph_service names, all tests pass.

    @rlratzel
    rlratzel committed Aug 31, 2022
    Configuration menu
    Copy the full SHA
    853b9d5 View commit details
    Browse the repository at this point in the history

  2. Remove references to GaaS in docs.

    @rlratzel
    rlratzel committed Aug 31, 2022
    Configuration menu
    Copy the full SHA
    1cf59fa View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2022

  1. Updates from review: copyright update, added args to dask shell scrip… 

    …ts, added FIXMEs.
    @rlratzel
    rlratzel committed Sep 1, 2022
    Configuration menu
    Copy the full SHA
    a550054 View commit details
    Browse the repository at this point in the history

  2. Formatting.

    @rlratzel
    rlratzel committed Sep 1, 2022
    Configuration menu
    Copy the full SHA
    67fcef9 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'branch-22.10-mg_updates' into branch-22.10-migrate_to_c… 

    …ugraph
    @rlratzel
    rlratzel committed Sep 1, 2022
    Configuration menu
    Copy the full SHA
    fd4e355 View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2022

  1. Merge remote-tracking branch 'rlratzel_gaas/branch-22.10-migrate_to_c… 

    …ugraph' into branch-22.10-gaas_migration
    @rlratzel
    rlratzel committed Sep 2, 2022
    Configuration menu
    Copy the full SHA
    7b4ca6e View commit details
    Browse the repository at this point in the history

  2. Changes to address failing flake8 style check.

    @rlratzel
    rlratzel committed Sep 2, 2022
    Configuration menu
    Copy the full SHA
    ade0e0c View commit details
    Browse the repository at this point in the history