Job Performance (SUPReMM) Module for Open XDMoD 8.0.0

• Features

  • Improved performance of aggregation process by switching to the ETLv2 framework.
  • Improved performance of shared jobs analysis script.

• Bug Fixes

  • Changed the database table that stores job scripts so that it can support job arrays and fixed
    missing unique key that resulted in redundant data storage.
  • Only show enabled resources in the Internal Dashboard dataflow diagram.

• Miscellaneous

  • Updated documentation and added troubleshooting information.
  • Added a xdmod-supremm-jobinfo script that prints information about individual
    jobs. This is intended to be used for troubleshooting purposes.

SUPReMM Module for Open XDMoD 7.5.1

• Bug Fixes
  • Added acl-config call to the database setup

SUPReMM Module for Open XDMoD 7.0.0

• Features
  • Added support for viewing job peers in Job Viewer (#52)
  • Improved Mongo configuration process (#59)
  • Enabled dataflow diagram for Open XDMoD administrators (#60)
• Bug Fixes
  • Fixed issue that allowed incompatible versions of XDMoD and this module to be installed when installing via RPM (#67)
• Miscellaneous
  • Updated for compatibility with Open XDMoD 7.0.0 (#51)
  • Moved Node.js ETL framework to Open XDMoD repository (#40)
  • Performed work in anticipation of federated instances (#48)
  • Improved development workflow (#41)
  • Improved quality assurance (#42, #49, #50, #55, #56, #58)
  • Improved documentation (#61, #67, #68)

SUPReMM Module for Open XDMoD 6.6.0

• Features
  • Improved application classification code (#27, #39)
• Bug Fixes
  • Fixed Job Viewer load error with version 4 timeseries documents (#24)
  • Fixed aggregators excluding data on certain time boundaries (#25)
  • Fixed handling of certain errors in job summaries (#38)
• Miscellaneous
  • Cleaned up old and/or unused code (#28)
  • Improved logging (#11)
  • Improved quality assurance (#17, #19, #22, #23, #26, #29, #30, #34, #35)

SUPReMM Module for Open XDMoD 6.5.0

Important Note: This update adds a dependency to npm. If you are updating
an existing installation via RPM, you will need to reinstall npm
dependencies afterward. To do this, run the commands below.

# Assuming XDMoD's share directory is RPM default "/usr/share/xdmod"

cd /usr/share/xdmod/etl/js
npm install

• Features
  • General
    • Added peak memory usage metric.
    • Improved application identification data.
    • Added aggregation data removal to the data reset script.
    • Added ability to track metrics for a "projects" filesystem.
  • Job Viewer
    • Added a count column to the detailed metrics pane to show how many
      data points were used to calculate the metrics.
  • Node ETL
    • Added support for uppercase auto-generated labels.
• Bug Fixes
  • Job Viewer
    • Fixed "Show Raw Data" button in Metric Explorer not filtering results
      correctly when using some combinations of drilldowns and filters.
    • Fixed single-point datasets not appearing in exported charts.
    • Fixed Search History tree sorting nodes that should not be sorted.
    • Fixed "Show Raw Data" window in Metric Explorer staying active after
      the chart underneath it changes (for example, when a new chart is
      imported from Usage).
    • Improved handling of raw data specified in kilobytes and megabytes
      in Detailed Metrics pane.
    • Fixed handling of Search History entries that have numeric names.
  • Node ETL
    • Fixed ingestion process hanging indefinitely if it failed to
      connect to the Mongo database at certain points.
    • Fixed SQL statement queue sometimes batching more statements
      together in one MySQL driver call than the driver can handle.
• Refactors and Miscellaneous
  • Spun this module out from the Open XDMoD repository.
    • Note that although the Job Viewer and Node ETL is part of Open XDMoD,
      changes will continued to be tracked as part of SUPReMM as long as it
      is the only user of both.
    • Also note that the Job Viewer is included with Open XDMoD install
      packages, whereas the Node ETL is included with SUPReMM packages.
  • Moved to custom option parser that supports long options and
    multi-character short options.
    • This replaces minimist and removes it as a dependency.

SUPReMM Module for Open XDMoD 6.0.0

• Features
  • General
    • Added ability to redact specific job-level values for some users.
  • Job Viewer
    • Added sort options to search history panel.
    • Organized advanced search filters into categories.
    • Modified timeseries charts to use the timezone of a job's resource
      instead of the timezone used by the web browser.
    • Modified analytics pane to always be present and explain why missing
      data is missing.
    • Modified byte units to use IEC prefixes instead of SI ones.
    • Allowed some metrics to be displayed in multiple tabs.
    • Added tooltips to advanced search filters.
    • Added tooltips to detailed metrics.
    • Added help sections to tabs that didn't have any previously.
    • Added a help button to the at-a-glance analytics.
    • Added a loading message to charts that are loading.
• Bug Fixes
  • Job Viewer
    • Fixed a number of cases where editing a search did not work as
      expected.
    • Fixed case where timeseries chart drilldowns stopped working after
      leaving the Job Viewer and returning.
    • Fixed case where a top-level timeseries chart was exported instead of
      the current, drilled-down chart.
    • Fixed case where timeseries chart drilldowns performed on a chart were
      not reflected in the navigation tree.
    • Fixed case where selecting a low-level timeseries chart in the
      navigation tree opened a top-level chart instead.
    • Fixed basic search resource list loading immediately on page load.

SUPReMM Module for Open XDMoD 5.6.0

• New Features
  • Configuration
    • Switched to URL-based method for specifying Mongo databases.
      • This adds support for Mongo databases that require authentication.
    • Improved setup process to be more user-friendly.
      • The interactive setup script now generates the required
        configuration files.
    • Improved configuration file structure.
  • Data Processing
    • Added ability to transfer ingested/aggregated data between databases.
      • This allows SUPReMM data to be reprocessed in a secondary database
        before deploying a new version of the SUPReMM ingestor in the main
        XDMoD instance.
    • Improved logging for ingestion and aggregation scripts.
  • Job Viewer
    • Added ability to edit searches.
    • Improved layout of search window.
    • Added ability to export timeseries plots as images or CSV data.
• Bug Fixes
  • Job Viewer
    • Added error dialog box for if Quick Job Lookup's resource list fails
      to load instead of silently failing.
    • Fixed existing searches breaking after performing a re-ingest of
      SUPReMM data.
    • Fixed charts sometimes not resizing properly.
    • Fixed memory leak in search history right-click menu.

SUPReMM Module for Open XDMoD 5.5.0 Beta 1

• Initial public release