v1.19.1

What's Changed

• Fix updating JIT generated templates in case of config change by @knopers8 in #614

Full Changelog: v1.19.0...v1.19.1

v1.19.0

What's Changed

• AgentCache thread safety by @justonedev1 in #608
• OCTRL-920 Fixes for stuck calibration runs by @knopers8 in #609
• OCTRL-779 Multiple mesos executor fix by @justonedev1 in #613

Full Changelog: v1.18.0...v1.19.0

v1.18.0

This release extends the workflow template context with strings.IsTruthy and strings.IsFalsy functions, and fixes an issue where the legacy CreateAutoEnvironment code path didn't emit events to Kafka.

• AutoEnvironment events:

  • [core] Emit environment events from CreateAutoEnvironment

• IsTruthy/IsFalsy

  • [core] Add IsTruthy/IsFalsy to template system API
  • [docs] Document AliECS workflow/task template language

v1.17.0

This release includes a fix for an issue with workflow parameter precedence, as well as a refactor of the hierarchical key-value store.

• KV store:

  • [common] Upgrade hierarchical KV store to Go generics + unit tests
  • [common] Improve hierarchical KV store test cases
  • [common] Fix override with empty value issue
  • [core] Use gera.Map[string, string] instead of gera.StringMap
  • [core] Remove gera.StringMap
  • [core] Use custom unmarshaler in gera.Map[string, string] instances
  • [core] Test kvStoreUnmarshalYAMLWithTags and YAML→workflow unmarshal
  • [core] Add comments on gera and defaults/vars/userVars mechanism

• Documentation:

  • Update documentation index

v1.16.1

This patch release fixes an issue with integration plugin call management during environment teardown.

• [core] OCTRL-912 Cancel calls pending await upon environment destruction

v1.16.0

This release includes a fix to the DD scheduler plugin and improvements to the environment teardown sequence.

• DD scheduler:

  • [core] Make StfB/StfS-to-FLP maps local for each request

• Environment teardown:

  • [core] Fix missing env ID in a teardown log
  • [core] OCTRL-911 Transitions should not be performed concurrently
  • [core] OCTRL-911 do not teardown an environment in DONE

v1.15.0

This release includes support for user information sent from GUI to the Bookkeeping system, support for hooks to be placed before or after run-related timestamps, and miscellaneous fixes and improvements.

• Bookkeeping and GUI user information:

  • [build] Avoid protobuf namespace clash
  • [coconut] Include user@host in relevant coconut requests
  • [core] New protofile common.proto + User type + regenerate proto
  • [core] Include last known request user in all env and run events
  • [core] Pull and patch Bookkeeping protofiles
  • [core] Regenerate Bookkeeping proto code
  • [core] Update Bookkeeping client for latest proto
  • [core] Set proto User.externalId to explicit presence

• Allow hooks to be placed before or after setting a run-related timestamp:

  • [core] document and test when transition can be cancelled
  • [core] delete run_number only after all STOP_ACTIVITY hooks are called
  • OCTRL-902 [core] Set run timestamps before executing triggers with weight 0
  • OCTRL-899 [core] use SOSOR and EOEOR as run duration for GRP ECS object

• Miscellaneous:

  • added logging filters for IL
  • [executor] Chmod sandbox directory 750→755 so task can read it

• Documentation:

  • [docs] Add documentation on DCS op behaviour

v1.14.0

This release includes miscellaneous core improvements and bug fixes.

• Miscellaneous improvements:

  • [core] test environment's FSM, handling hooks and fix discovered issues
  • [core] OCTRL-891 propagate pdp_beam_type and pdp sor override to tasks
  • [core] Useless lock is useless

• Bug fixes:

  • [core] Publish correct state when tasks_ is done
  • [occ] avoid a leak in JsonMessage::Deserialize

• Documentation:

  • [docs] Update information on AliECS production deployment
  • [docs] Mention usage of cron in checker script

v1.13.0

This release includes various fixes and improvements, including limiting error payload sizes sent to the GUI, addressing a potential race with Mesos offers handling, and more.

• Mesos offers handling:

  • [core] Improve handling of Mesos resource offers

• Miscellaneous fixes:

  • [core] Set state to DONE in last autoEnv event - stopgap until Kafka switch
  • [core] Limit ODC error string length

• Testing and documentation:

  • test the plugin system
  • Update kafka.md

v1.12.0

This release includes ECS state translation for ODC partitions and devices, support for environment event production in auto-transitioning environments, improvements to critical trait representation, and many miscellaneous improvements and fixes.

• Critical trait:

  • [coconut] Show critical trait of tasks in table
  • [core] Remove TaskClassInfo and add critical trait to ShortTaskInfo
  • [core] Track role criticality and return actual critical trait of tasks
  • [core] Task must return traits for non-basic tasks

• Events in auto-transitioning environments:

  • [core] Emit environment events for Teardown and AutoEnv

• ODC to ECS state translation:

  • [core] Convert ODC device and env states to ECS and publish
  • [core] Move state and transition into their own sm package
  • [core] Account for unlikely ODC state "OK"
  • [core] Consistent variable naming
  • [core] New ODC-ECS state mapping, based on previous ECS state
  • [core] Test ODC-ECS state mapping
  • [core] Move task state test to sm package
  • [core] Strong typing for ODC event payloads
  • [core] Send ODC device IDs as string for JS compatibility
  • [core] Account for ODC state MIXED as INVARIANT
  • [core] Fix test
  • [core] Make test more similar to real world behaviour
  • [core] Fix issue with ECS state reverting to UNKNOWN
  • [core] Ensure we don't overwrite the devices now that it's a pointer

• Miscellaneous:

  • [core] Push CallEvents to aliecs.call topic
  • [core] log the failed JIT workflow and detector, push DPL out only to IL
  • [core] demote message about replying to GetEnvironment call
  • remove generic targets in the operation order doc, since they are not supported
  • spurrious brackets
  • fix links
  • fix detail
  • [occ] Fix deserialization of ConfigEntry with empty value
  • OCTRL-893 [core] always log why the environment goes into ERROR
  • OCTRL-894 [core] a FINISHED/DONE task should have INACTIVE status
  • OCTRL-870 [core] Handle escaped config URIs in DPL commands correctly
  • OCTRL-901 Document the order of actions performed during SOR and EOR