Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Save the pi/group as the account and allocation charge number #11

Merged

Conversation

smgallo
Copy link
Contributor

@smgallo smgallo commented Jan 3, 2017

In Open XDMoD, save the PI group or accounting group of a job as the charge number in the account and allocation tables.

Description

To help support allocations in Open XDMoD, save the job's PI or accounting group as the charge number in the allocations and accounts tables. Initially, sites can then run a post-ingest ETL action to update the allocation values. In the case of SDSC this will allow them to send the same data that is sent to the XDCDB into their Open XDMoD instance. Display of allocations data in Open XDMoD is not currently supported, but planned for the future.

Motivation and Context

Provide support for allocations at SDSC. If the allocations are included in the modw.allocations table then a post-ingest process can update the initial and remaining allocation values.

Tests performed

The following steps were performed:

  1. Build an Open XDMoD RPM based on the new code branch
  2. Install and configure this RPM on a cloud instance (xdmod-setup)
  3. Ingest 2 months of debug partition data (sacct, xdmod-shredder, xdmod-ingestor)
  4. Verify that modw.accounts and modw.allocations contain the PI group and that the number of distinct group names/charge numbers is the same in these 2 tables and the modw.jobfact table (with the addition of the "Unknown" account).

Types of changes

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

  • My code follows the code style of this project as found in the CONTRIBUTING document.
  • I have added tests to cover my changes.
  • All new and existing tests passed.

@smgallo smgallo added the enhancement Enhancement of the functionality of an existing feature label Jan 3, 2017
@smgallo smgallo added this to the v6.6.0 milestone Jan 3, 2017
@smgallo smgallo requested a review from jtpalmer January 3, 2017 20:39
@smgallo smgallo merged commit 1330a65 into ubccr:xdmod6.6 Jan 17, 2017
@smgallo smgallo deleted the openxdmod/accountname-as-chargenumber branch January 17, 2017 17:36
@smgallo smgallo added the Category:ETL Extract Transform Load label Apr 26, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Category:ETL Extract Transform Load enhancement Enhancement of the functionality of an existing feature
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants