CIMreader-2.11-2.3.1-3.4.0

Add caching and CIMNetworkTopologyProcessor options.

Assists in repetitive run use-cases (such as in development work).

Usage is to specify all options for post processing (de-duplicate, topology creation, edge creation, etc.) and also the ch.ninecode.cim.cache option as a directory name specific to the combination of files and options used. The CIMReader will write an object cache using saveAsObjectFile after all processing is completed. On subsequent runs with the same ch.ninecode.cim.cache option the object cache is used instead of re-reading and re-processing the CIM files. This offers the chance to reduce processing time by eliminating the overhead of reading and processing the same options each time, and getting right down to the important algorithm directly.

No provision is yet included for testing the staleness of the cache due to CIM file changes or option changes, so this is a manual process so far - caveat emptor.

CIMreader-2.11-2.3.1-3.3.0

Bugfix release:

• avoid null TopologicalNode and TopologicalIsland on Terminal for isolated terminals

CIMreader-2.11-2.3.1-3.2.0

Minor upgrade.

CIMNetworkTopologyProcessor fixes:

• unpersist TopologicalNode and TopologicalIsland with blocking
• force_switch_separate_islands and force_fuse_separate_islands options
• rationalize switch and fuse processing
• CIMTopologyOptions force_retain_switches also ignore open and normalOpen status for island determination

CIMreader-2.11-2.3.1-3.1.0

Minor upgrade.

• Improvements to NetworkTopologyProcessor
  • to checkpoint the Pregel algorithm, note this requires setting the checkpoint directory to have any effect
  • minimize in memory data structure size to ease memory pressure ans speed up shuffle operations
  • use of Kryo serializaion in a more uniform way
  • add BaseVoltage and ConnectivityNodeContainer to generated TopologyNode objects where possible
• update the documentation for the CIMServerJDBC component and other classes

CIMreader-2.11-2.3.1-3.0.0

Maintenance release:

• replace all get[T] with getOrElse[T] in CIMRDD subclasses

CIMReader-2.11-2.3.1-2.9.0

Maintenance release:

• upgrade to Spark 2.3.1

CIMReader-2.11-2.2.2-2.9.0

Maintenance release:

• upgrade to Spark 2.2.2

CIMReader-2.11-2.2.0-2.7.0

Minor enhancements:

• added support for open and retained Switch attributes for network topology processing
• fixed RDD hierarchy for updated RDDs modified by post-processing functions
• improved caching in network topology processor
• many JavaScript generation improvements in support of CIMSpace

CIMReader-2.11-2.1.2-2.7.0

Minor enhancements:

• added support for open and retained Switch attributes for network topology processing
• fixed RDD hierarchy for updated RDDs modified by post-processing functions
• improved caching in network topology processor
• many JavaScript generation improvements in support of CIMSpace

CIMReader-2.11-2.2.0-2.5.0

Maintenance release:

• improve relationship handling
• model normalization