* Fix weird array construction bug in metrics API binning method

* Remove async modifier

* Cleanup and add state_snapshot test

* Cleanup

 - @container-images/env-inject@0.1.21
 - @container-images/mds-agency@0.1.22
 - @container-images/mds-audit@0.1.23
 - @container-images/mds-compliance@0.1.22
 - @container-images/mds-daily@0.1.22
 - @container-images/mds-metrics-sheet@0.1.23
 - @container-images/mds-metrics@0.0.4
 - @container-images/mds-native@0.0.20
 - @container-images/mds-policy-author@0.1.22
 - @container-images/mds-policy@0.1.22
 - @container-images/mds-provider@0.1.22
 - @mds-core/mds-agency@0.0.24
 - @mds-core/mds-api-authorizer@0.1.22
 - @mds-core/mds-api-helpers@0.1.22
 - @mds-core/mds-api-server@0.1.22
 - @mds-core/mds-audit@0.1.34
 - @mds-core/mds-cache@0.1.22
 - @mds-core/mds-compliance@0.1.23
 - @mds-core/mds-daily@0.0.23
 - @mds-core/mds-db@0.1.22
 - @mds-core/mds-logger@0.1.20
 - @mds-core/mds-metrics-sheet@0.0.23
 - @mds-core/mds-metrics@0.0.4
 - @mds-core/mds-native@0.0.20
 - @mds-core/mds-policy-author@0.0.19
 - @mds-core/mds-policy@0.0.23
 - @mds-core/mds-provider@1.0.22
 - @mds-core/mds-providers@0.1.22
 - @mds-core/mds-stream@0.1.22
 - @mds-core/mds-test-data@0.1.22
 - @mds-core/mds-types@0.1.19
 - @mds-core/mds-utils@0.1.22

release/0.0.16

 - @container-images/env-inject@0.1.22
 - @container-images/mds-agency@0.1.23
 - @container-images/mds-audit@0.1.24
 - @container-images/mds-compliance@0.1.23
 - @container-images/mds-daily@0.1.23
 - @container-images/mds-metrics-sheet@0.1.24
 - @container-images/mds-metrics@0.0.5
 - @container-images/mds-native@0.0.21
 - @container-images/mds-policy-author@0.1.23
 - @container-images/mds-policy@0.1.23
 - @container-images/mds-provider@0.1.23
 - @mds-core/mds-agency@0.0.25
 - @mds-core/mds-api-authorizer@0.1.23
 - @mds-core/mds-api-helpers@0.1.23
 - @mds-core/mds-api-server@0.1.23
 - @mds-core/mds-audit@0.1.35
 - @mds-core/mds-cache@0.1.23
 - @mds-core/mds-compliance@0.1.24
 - @mds-core/mds-daily@0.0.24
 - @mds-core/mds-db@0.1.23
 - @mds-core/mds-logger@0.1.21
 - @mds-core/mds-metrics-sheet@0.0.24
 - @mds-core/mds-metrics@0.0.5
 - @mds-core/mds-native@0.0.21
 - @mds-core/mds-policy-author@0.0.20
 - @mds-core/mds-policy@0.0.24
 - @mds-core/mds-provider@1.0.23
 - @mds-core/mds-providers@0.1.23
 - @mds-core/mds-stream@0.1.23
 - @mds-core/mds-test-data@0.1.23
 - @mds-core/mds-types@0.1.20
 - @mds-core/mds-utils@0.1.23

release/0.0.17

* Fix `editGeography`.

* ts assist

* Fixed `editGeography` with TS assist.

 - @container-images/env-inject@0.1.23
 - @container-images/mds-agency@0.1.24
 - @container-images/mds-audit@0.1.25
 - @container-images/mds-compliance@0.1.24
 - @container-images/mds-daily@0.1.24
 - @container-images/mds-metrics-sheet@0.1.25
 - @container-images/mds-metrics@0.0.6
 - @container-images/mds-native@0.0.22
 - @container-images/mds-policy-author@0.1.24
 - @container-images/mds-policy@0.1.24
 - @container-images/mds-provider@0.1.24
 - @mds-core/mds-agency@0.0.26
 - @mds-core/mds-api-authorizer@0.1.24
 - @mds-core/mds-api-helpers@0.1.24
 - @mds-core/mds-api-server@0.1.24
 - @mds-core/mds-audit@0.1.36
 - @mds-core/mds-cache@0.1.24
 - @mds-core/mds-compliance@0.1.25
 - @mds-core/mds-daily@0.0.25
 - @mds-core/mds-db@0.1.24
 - @mds-core/mds-logger@0.1.22
 - @mds-core/mds-metrics-sheet@0.0.25
 - @mds-core/mds-metrics@0.0.6
 - @mds-core/mds-native@0.0.22
 - @mds-core/mds-policy-author@0.0.21
 - @mds-core/mds-policy@0.0.25
 - @mds-core/mds-provider@1.0.24
 - @mds-core/mds-providers@0.1.24
 - @mds-core/mds-stream@0.1.24
 - @mds-core/mds-test-data@0.1.24
 - @mds-core/mds-types@0.1.21
 - @mds-core/mds-utils@0.1.24

release/0.0.18

* mdscl/istio: install (un)install via helm straight up

* mdsctl/istio: uninstallIstio cleanup

* Add new tables for audit attachments

* Integrate with audit attachments db tables

* New endpoints to add and delete attachments; return attachments with audits

* Lint

* Minor cleanups to s3 upload key and base url

* Move S3 config to env variables

* Let caller catch writeAttachment exception; type fixes

* Lint

…PI (#42)

* Add MDS vehicle status and location to get audit response

* Add test for provider info in audit response

* Capitalize DESC keyword

* Add provider_event_time to Get Audit response

* Remove references to dropped columns from schema

* Use enums

* Fix import

* Make ORDER BY configurable in readEventsWithTelemetry

* Fix errors when running `yarn image`

* Use optional chaining from TS 3.7

 - @container-images/env-inject@0.1.24
 - @container-images/mds-agency@0.1.25
 - @container-images/mds-audit@0.1.26
 - @container-images/mds-compliance@0.1.25
 - @container-images/mds-daily@0.1.25
 - @container-images/mds-metrics-sheet@0.1.26
 - @container-images/mds-metrics@0.0.7
 - @container-images/mds-native@0.0.23
 - @container-images/mds-policy-author@0.1.25
 - @container-images/mds-policy@0.1.25
 - @container-images/mds-provider@0.1.25
 - @mds-core/mds-agency@0.0.27
 - @mds-core/mds-api-authorizer@0.1.25
 - @mds-core/mds-api-helpers@0.1.25
 - @mds-core/mds-api-server@0.1.25
 - @mds-core/mds-audit@0.1.37
 - @mds-core/mds-cache@0.1.25
 - @mds-core/mds-compliance@0.1.26
 - @mds-core/mds-daily@0.0.26
 - @mds-core/mds-db@0.1.25
 - @mds-core/mds-logger@0.1.23
 - @mds-core/mds-metrics-sheet@0.0.26
 - @mds-core/mds-metrics@0.0.7
 - @mds-core/mds-native@0.0.23
 - @mds-core/mds-policy-author@0.0.22
 - @mds-core/mds-policy@0.0.26
 - @mds-core/mds-provider@1.0.25
 - @mds-core/mds-providers@0.1.25
 - @mds-core/mds-stream@0.1.25
 - @mds-core/mds-test-data@0.1.25
 - @mds-core/mds-types@0.1.22
 - @mds-core/mds-utils@0.1.25

release/0.0.19

…49)

…ary conditions & fluent syntax (#71)

* Overloading log with log level parameter to support ternary conditions & fluent syntax

…code into a new package. (#78)

* Consolidating validator/schema-related code in mds-policy to mds-utils

* Consolidating validator/schema-related code in mds-compliance to mds-utils

* Consolidating validator/schema-related code in mds-compliance to mds-utils

* extracting JSON Schema definitions and code into mds-json-schema

* fixing build errors caused by moving validation to new package

* renaming mds-json-schema -> mds-schema-validators and cleaning up build issues

* moving ValidationError back to mds-utils

* removing hapi/joi from mds-utils

* updating tsconfigs

* Referencing RULE_TYPES when constructing schemas

* Revert "Referencing RULE_TYPES when constructing schemas"

This reverts commit 87def6e.

* Referencing RULE_TYPES when constructing schemas

* Config service client and tests

* Config API and tests

* Config API container image

* Add debug configurations for config api/service

* create a configmap from files in helm/mds/mds-config, mount it to the mds-config pod under that path /mds-config

* Allow settings to use .json or .json5 extensions

…ry data, so most … (#89)

* Compliance engine sorts vehicles by earliest telemetry data, so most recent events will be the ones tagged as violators.

* Updating sort function.

* Removing unnecessary spread operator.

…ng logs (#97)

* Instrument some cache and db operations with timing logs

* Add provider to getVehicles timing log

* Upgrade to latest package dependency versions

* Clean up test scripts using config files

* Bump some coverage levels

* Relax lookup VIN response requirements

* Add logs for missing info; return telemetry when possible

 - @container-images/env-inject@0.1.25
 - @container-images/mds-agency@0.1.26
 - @container-images/mds-audit@0.1.27
 - @container-images/mds-compliance@0.1.26
 - @container-images/mds-config@0.0.2
 - @container-images/mds-daily@0.1.26
 - @container-images/mds-metrics-sheet@0.1.27
 - @container-images/mds-metrics@0.0.8
 - @container-images/mds-native@0.0.24
 - @container-images/mds-policy-author@0.1.26
 - @container-images/mds-policy@0.1.26
 - @container-images/mds-provider@0.1.26
 - @mds-core/mds-agency@0.0.28
 - @mds-core/mds-api-authorizer@0.1.26
 - @mds-core/mds-api-helpers@0.1.26
 - @mds-core/mds-api-server@0.1.26
 - @mds-core/mds-audit@0.1.38
 - @mds-core/mds-cache@0.1.26
 - @mds-core/mds-compliance@0.1.27
 - @mds-core/mds-config-service@0.0.2
 - @mds-core/mds-config@0.0.2
 - @mds-core/mds-daily@0.0.27
 - @mds-core/mds-db@0.1.26
 - @mds-core/mds-logger@0.1.24
 - @mds-core/mds-metrics-sheet@0.0.27
 - @mds-core/mds-metrics@0.0.8
 - @mds-core/mds-native@0.0.24
 - @mds-core/mds-policy-author@0.0.23
 - @mds-core/mds-policy@0.0.27
 - @mds-core/mds-provider@1.0.26
 - @mds-core/mds-providers@0.1.26
 - @mds-core/mds-schema-validators@0.1.2
 - @mds-core/mds-stream@0.1.26
 - @mds-core/mds-test-data@0.1.26
 - @mds-core/mds-types@0.1.23
 - @mds-core/mds-utils@0.1.26

release/0.0.20

* mdsctl: prompt-to-proceed if not using docker-desktop

* mdsctl: bit of cleanup

* Support merging multiple settings files

* Get settings property names from query string

* Support existing single settings property API

* Add Stop datatype, and r/w endpoints to Agency

* Add proper validation when POSTing stops

* Add some basic error handling

* Start adding tests...

* Clean up bad db types

* Test cleanup

* More cleanup

* More cleanup pt2

* More cleanup

* Add read back test

* More tests

* Last of the tests?

* Some formatting cleanup

* Remove unused import

* Make geography_id optional for stops, add lat/lng requirement

* Cleanup

* Review nits

* Clean up schema, use SqlVals()

* Remove markdown plugin

* Update carshare -> car, and add moped type to vehicleTypesCountMapSchema definition

* Break build... this is intentional, I promise

* Revert "Break build... this is intentional, I promise"

This reverts commit d8ba989.

* Fixture updates

* Add recorded column

* Cleanup

* Speed up VIN lookup by parallelizing cache reads

* Refactor makeReadOnlyQuery to permit use of SqlVals()

* Fix minor oversight

…n for MDS-Agency (#99)

* First pass at WS

* Add tsconfig

* Add basic websocket emission to mds-agency

* Emission cleanup

* Add tsconfig

* Cleanup

* Dependency cleanup

* More dependency cleanup

* WIP

* More WIP

* WIP

* WIP

* Manual event triggering works, wheee

* Remove agency socket interaction, to be replaced with reading from KNE

* Added basic auth handling, need to add logic for token expiration. Could also just add a 30s heartbeat requirement.

* Validate auth

* More auth cleanup

* Header validation cleanup

* Generate random events and telemetry to send down websocket

* Nits

* Add outbound ws client

* Message emission working

* Purge console.log

* Clean up authorizers

* Cleanup

* Bump deps

* Bump deps

* Cleanup

* Test coverage

* Cleanup

* Moar cleanup

* So much cleanup

* Bap

* nits

* Moar nits

* Refactor async in forEach to use Promise.all()

* Rename nit

* Export cleanup

* Exception handling cleanup

* Add missing index.ts file

* Remove stale clients

* Make sure to kill the connections too

* Exec function

* Minor authorizer refactor (#111)

* Force exit for agency tests to close open socket

* Moar exit forces

* Import alignment

* Cleanup

* Changes for internal routing and basic helm config

* Remove test code

* Cleanup

…ts (#121)

* Add admin-all scope check when authenticating ws clients

* Nullish coalesce all the things

* Remove unnecessary check

* Don't always start WebSocket server

* Add missing launch file

* use literal branch name as docker suffix

* portable sed

* Cleanup

* update requirement versions

* revert to original dir copy

* cleanup

* Beginning of cleanups

* more cleanup/ removed streaming logic scoped for Q1

* trip-proc cleanup

* type fixes

* ts refactor

* helm reconcile

* mds-logger

* metric cleanup

* helm fixes

* breaking db methods into seperate file

* cache/db refactor

* Clean up geo.ts

* Clean up annotation.ts

* Clean up proc-event.ts

* Clean up proc.ts

* Clean up misc

* Clean up metrics.ts

* Update MetricsTableRow type

* Resolve/suppress all linter warnings, and resolve compilation errors.

* Add eslint-reasons to most directive disables

* Refactor geo.ts files into utils

* Add stricter typing

* Cleanup

* Fix dependencies/versions

* cache/db fixes

* proc fixes

* mdsctl: cleanup (comment out nats)

* Cleanup

* Optional chaining

* Add ParseError

* upgrade natss

* mdsctl: update

* mdsctl: update bin/mdsctl add knative(broker,channel)

* fix typo

* mdsclt: ko hack, mds pause for natss

* mdsctl: s/pause/condition/g

* [WIP] [mds-metrics] Add dump all metrics rows API endpoint (#94)

* WIP

codify types

add initial request handler test

add query construction tests

named args obj (no more defaults)

Add explanatory comments

more comments

* s/timestamp/start_time

* rename some things + cleanup

* update test

* fix incorrect import

* fix type signature

* mdsctl: kne w/o namespace labeling

* Remove default param val

* - Add id column to reports tables
- Restore sorting of code

* Do not initialize the db at startup!

* Reduce unnecessary switch cases

* Fix lint error that's been breaking build

* Upgrade to cloudevents 1.0 with typings

* added presets to mdsctl

* update proc-event

* mdsctl uncomment natss

* Remove deprecated Redis stream

* Remove package-lock file

* Generic server for handling knative cloudevents

* Make handler async

* Unit test placeholder

* [mds-metrics] Adds geography_id and provider_id query params to /metr… (#98)

* [mds-metrics] Adds geography_id and provider_id query params to /metrics/all

Usage: GET /metrics/all?geography_id={}&provider_id={}

Both fields are optional.
Each id query param must be a valid UUID or you'll get a 500.

TODO test w/ cURL or Insomnia @evanxadkins

This is also going into PR #88

Closes [MDSAAS-487](https://lacunadotai.atlassian.net/browse/MDSAAS-487)

* fix up lint and add comment

* remove geography_id query param

* initial stab at vehicle_type querying

* vehicle_type query param support

* add english bin_size support

* switch to nifty time utils

* crazy time validation logic

* add note

* fix mutable moment bug

* add note

* clean up request handler

* clean up notes

* add tsv format query param

* add note

* add some tsv export tests

* fix failing test

* tests should be more stable now

* fix import

* purge link

* remove flaky test (again)

* lint

* type enforcement

* eslint errors

* Regenerate lock file

* Switch trip/provider handlers to event server

* Clean up a couple test commands/timeouts

* Add better parsing logs

* trip-proc update

* promise handling

* prov-proc update

* metrics update

* Handle parse errors from cron source events

* Improve test coverage

* Minor cleanup

* Feature/jwtodd events trips provider processor (#101)

* nats: internal deployment of processors

* cjs: remove hardwired minute interval

* helm: fix cronjobsource schedule

* processors: add cronjob template

* interval: 1m

* event sync

* nats: processor (internal-apis; no need to port-forward), simulator cli, natss broker/channel

* helm/mds: template cleanup(broker, processor-cronjob)

* mdsctl: tad better ko ref

* helm/mds cleanup

* mdsctl: make natss a pre-condition of mds

* mdsctl: cleanup

* bug fixes

* Package update

* [mds-metrics] Add stub endpoint (#103)

* add stub endpoint

* fix async/string

* simplify JSON tsv processing

* re-enable/fix up tsv export in main api

* WIP

* cache update

* cache update

* Update test scripts for new packages

* Update versions of mds-core dependencies

* Add missing dependencies, fix build/test errors

* package updates

* minor syntax changes

* mdsctl: sed of osx; todo: fix for all

* mdsctl: better (osx,windows) natss install

* multimodal changes

* mdsctl: support deleting 2+ images

* mdsctl: build image cleanup, simulator build

* event_count metric addition

* [mds-db] [mds-metrics] Add SqlVals() to processors db queries (#107)

* refactor to use SqlVals()

* revert unrelated changes

* helm/mds: +mds-config, for t in helm/mds/templates/* s/key/name/g, move natss-channel into deploy namespace (eg mds); verified: simulator, logs mds-(event,provider,trip)-processor

* Add unit tests to mds-event-processor (#112)

* Revert "[mds-db] [mds-metrics] Add SqlVals() to processors db queries (#107)"

This reverts commit 0cee743.

* fix weird lint error

* initial test

* crlf yikes

* moar tests

* lower codecov

* more unit tests

* small helm changes

* sqlVals

* small error handling changes

* Revert "sqlVals"

This reverts commit f2299b2.

* vscode settings

* kne/natss:0.11.0, multi-tenant nats/redis msg routing (#115)

* mdsctl: delete 2+ images

* filter prep

* natss: conditionally prefix the event:type with the tenantId else use 'mds' as the default

* rm tenantId dbug

* events/multi-tenancy: patch db statments to vary event-type prefix, attempted to push the tenentId down to utils but bad things happened to my system; next: test concurrent tenants, verify db statements

* kne: move deploy process to helm (from kubectl apply -f [url])

* nats: helm'ify

* nats/helm: pin to gcr

* nats: prioritize (un)install natss via helm

* redis: multi-tenant

* multi-tenant: cleanup

* mdsctl: not to sync kne-contrib from a release

* redis/multi-tenant: clean up comment

* redis/multi-tenant: clean up argument quoting

* mdsctl: helm kne-eventing-init

* nats/multi-tenant: filter out tenant-routing prefix prior to forwarding the message to the handler

* natss event processor: clean-up

* helm/kne-contrib: r0.11.0 natss-channel.yaml

* mdsctl: fixme cleanup

* tenantid: better ternary

* Clean up cloud event parsing.

* Suppress deprecation warnings

* Feature/maxj/sqlvals (#119)

* [mds-audit] Speed up VIN lookup by parallelizing cache reads (#110)

* Speed up VIN lookup by parallelizing cache reads

* Fix build error (#114)

* Update VS Code ESLint settings (#117)

* [mds-db] Refactor makeReadOnlyQuery to permit use of SqlVals() (#116)

* Refactor makeReadOnlyQuery to permit use of SqlVals()

* Fix minor oversight

* re-enable sqlvals

* [mds-agency] [mds-web-sockets] Basic outbound websocket implementation for MDS-Agency (#99)

* First pass at WS

* Add tsconfig

* Add basic websocket emission to mds-agency

* Emission cleanup

* Add tsconfig

* Cleanup

* Dependency cleanup

* More dependency cleanup

* WIP

* More WIP

* WIP

* WIP

* Manual event triggering works, wheee

* Remove agency socket interaction, to be replaced with reading from KNE

* Added basic auth handling, need to add logic for token expiration. Could also just add a 30s heartbeat requirement.

* Validate auth

* More auth cleanup

* Header validation cleanup

* Generate random events and telemetry to send down websocket

* Nits

* Add outbound ws client

* Message emission working

* Purge console.log

* Clean up authorizers

* Cleanup

* Bump deps

* Bump deps

* Cleanup

* Test coverage

* Cleanup

* Moar cleanup

* So much cleanup

* Bap

* nits

* Moar nits

* Refactor async in forEach to use Promise.all()

* Rename nit

* Export cleanup

* Exception handling cleanup

* Add missing index.ts file

* Remove stale clients

* Make sure to kill the connections too

* Exec function

* Minor authorizer refactor (#111)

* Force exit for agency tests to close open socket

* Moar exit forces

* Import alignment

* Cleanup

* Changes for internal routing and basic helm config

* Remove test code

* Cleanup

* [mds-agency] Fix import of package with no default export (#120)

* remove quotes around vals.add()

* follow existing pattern for IN

* clean up unused imports

* more cleanup

* more lint?

* helm/mds: fix values(apis,processors)

* Fix Cloud Event emitter cache

* Remove deprecated test

* Restore cloud event test

* minor proc package fix

* Feature/maxj/additional query params (#118)

* specify multiple provider_id query values

* clean up types, normalize logic to arrays

* add multiple bin processing support

* clean up bin_size handling

* add some additional handling code

* %s/let/return/g

* clean up types/naming

* clean up default arg

* fix test

* mdsctl: fully helm'ify the mds install (by labelling the namespace; noting the cost is an extra 'default' in-memory broker)

* CE prefix metric query removal

* Dependency updates

* added README

* Small cleanups

* Fix helm template

* Fix project reference

* Add unit test to fix coverage

* add recorded column to reporting tables

* Update README.md

* added now util function

* Update README.md

* run triggers on the top of the hour

* helm/kne: remove in-memory-controller; tested with `mdsctl -p processors install:mds,simulator` and observing events propogated to logs

* helm/mds: add `postgresql.password` empty-by-default field with clarifying comment

* helm/knative: remove imc k8s deploy

* [mds-provider-processor] A few unit tests for mds-provider-processor. (#128)

* A few unit tests for mds-provider-processor.

* Fixed test threshold.

* this is not right but it makes tests pass

* Clean up project references

* Adding cache.initialize for consistency.

* unit tests for metric utils

* formatting

* cleanup

* Restore configmap functionality

* type reduction

* hour cron interval

* Mount config volume in all pods (#130)

Co-authored-by: Neil Goldader <avatarneil@gmail.com>
Co-authored-by: Michael Durling <michael@ellis-and-associates.com>
Co-authored-by: James Todd <99516+jwtodd@users.noreply.github.com>
Co-authored-by: Max Johansen <macsj200@gmail.com>
Co-authored-by: Alex Gottschalk <389982+invertigo@users.noreply.github.com>
Co-authored-by: janedotx <jane.x.huang@gmail.com>

…ain (#126)

* mdsclt: rm dashhboard, fix cli

* mdsctl: get cli:[postgresql|redis] working again

* mdsctl: add helm@2 to PATH given it is installed in a non-default/opt location; note: dep on #104, will work as-is if pushed prior

* helm/mds: match #104 re $.Values.apis.env parse error

* mdsctl: helm init cleanup, don't display usage message when an error is present

Co-authored-by: Neil Goldader <avatarneil@gmail.com>

…ket write (#134)

* Don't retry then send a 500 on a failed cache/stream/socket write

* Use recorded_event rather than event

* Refactor telemetry writing

… for provider + vin (#127)

* Return last device registered if db has duplicates for provider + vin

* Fix lint

* Prefer an active device when de-duping

* Load configuration data via service

* Rename a few things...

* Fix tests

Co-authored-by: Neil Goldader <avatarneil@gmail.com>

…aily (#136)

* refactor normalizeToArray()

* use new helper

* Append commit hash to image tag if on non-master branch

* Review nits

Co-authored-by: Neil Goldader <avatarneil@gmail.com>

…ce. (#137)

* Initial web-socket test to get the framework in place.

* Minor refactor

* mdsctl: seed PATH for non-default install bins; confirm remote-deploy only once

* mdsctl: tiller aws

* mdsctl: cleanup

* mdsctl: better remoting, add ability to cycle a pod, lessen remote warning check

* mdsctl: add cycle default, all services and procesors

* mdsctl: cleanup neg responses

* mdsctl: nit

* mdsctl: deploy in-cluster pgcl/redis-cli; note: can remove pcli/redis from brew

* mdsctl: rm brew(pgcli, redis)

* mdsctl: rm dead preset hook

* mdsctl: fix bugs(uninstallHelm, don't require MDS_SIMULATOR_REPOSISORY if MDS_SIMULATOR is set to a viable install)

* mdsctl: move some non-obvious configuration switches to comment-notes

* helm/natss: provide ability to override default resources(requests.cpu, limits.memory)

* readme: update mdsctl invocation

* mdsctl: +grafana; note: not configured correctly just yet

* mdsctl: +(un)install(dnslookup,curl,grafana)

* mdsctl: support kn(eventing,monitoring,serving)

* mdsctl: helm-delete by namespace

* mdsctl: touch ~/.bashrc if it doesn't exist, better bash command-to-brew-recipe mapping support

* helm/natss: set default memory to 512M, override with 32M

* mdsctl: install:knative(monintoring); will be continued in another branch

* natss: default memory=512M, fix mdsctl dns-lookup ns bug

* mdsctl: processors(+websockets)

…g, and add basic health check to WebSocket client (#141)

* First pass at cleaning up telemetry error handling

* Patch the client to properly handle not being able to connect to web-sockets

* More attemps at fixing client code...

* Moar cleanup

* More cleanup

Co-authored-by: Neil Goldader <avatarneil@gmail.com>

* adds metrics:read and metrics:read:provider scoping

* fix error msg

* add note

* push provider query logic to middleware

* simplify logic

* fix import

* lint

* fix unit tests

* coverage

* alphabet

* Support async access token scope validators

* Dependency updates

* ESLint/Prettier

* remove unused function

* lint

* add expected transition values

* Upgrade to Node.js 12 (v12.14.1) runtime

* Upgrade node types

…d scope (#156)

* add unauthorized error if query params attempt to exceed scope

* reorder scope checking

* cleanup spike

* telemetryMap structure change

* optimize registered count metric

* fixed test case

* null vehicle_type cache read bug fix

* service area test cases

* test case type enforcement

* cleanup

* query fix

* reduce logic

* removed unused import

* added error msg

* removed unused import

* syntax edits

* migration script and sql logs

* Remove provider API from City Services cluster

* Remove provider API scopes

Co-authored-by: Neil Goldader <avatarneil@gmail.com>

* increase timeout

* timeout env var

* reorder number cast

… creds (#164)

…cessors (#160)

* cleanup spike

* telemetryMap structure change

* optimize registered count metric

* fixed test case

* null vehicle_type cache read bug fix

* service area test cases

* test case type enforcement

* cleanup

* query fix

* restructure spike

* hscan addition

* proc cache changes

* hscan reformat

* hscan bug fix

* reduced cache maintanence logic

* removed unused import

* edit to cache method names

* merge cleanup

* merge cleanup

* more merge cleanup

* comment syntax

* map edits

* reduced logic

* typdef fixme comment

* revert values.yaml

Co-authored-by: Mark Maxham <max@ellis-and-associates.com>
Co-authored-by: Neil Goldader <avatarneil@gmail.com>

* no mutation

* refactor modules + add test

* Add moment-based timestamps

* Export getCurrentDate()

Co-authored-by: Neil Goldader <avatarneil@gmail.com>

…#168)

…processor. (#143)

* First pass at nats implementation for mds-event-processor

* Some cleanup

* Works in-cluster with manual IP for NATS.connect args

* Actually await things

* nats: mdsctl(nats), disable kne/natss

* Remove trigger.yaml

* Check env.NATS instead of env.SINK

* mdsctl: natss

* Switch from vanilla nats to nats-streaming. This enables us to sychronously handle subscriptions.

* stan ftw

* add STAN_CLUSTER_ID env var

* WIP

* WIP

* WIP

* WIP

* Re-add event-server wrapper for mds-event-processor

* Revert some prior changes, structure events with CE

* Add credentials support

* stan.creds

* Add STAN_CREDS env var

* Some changes...

* stan.creds mount

* cleanup

* Stop using mds-event-server because it causes problems, working end-to-end in cluster

* Patch

* infer image:tags from remote registry

* +gcloud

* Re-add getRawData()

* Re-add mds-event-server, switch to using nats-streaming 0.3.0 client

* Clean up dependencies

* Update dependencies

* Ack failed messages

* helm(nats,stan)

* stan/cleanup

* +nats-box

* +nats-box, pin cluster-id

* stan cluster id

* add [nats|stan]x which are single-pod no-auth nats-io/k8s deploys

* helm'ify (nats,stan)x

* Cluster handled pod routing

* +stan=statefulset

* +stans:0.16.2

* u/d

* Event-server refactoring to improve readability

* Add getNats() to get a persistent nats client and save it if it falls over

* Add re-connect logic

* Turns out the nats client will attempt to reconnect for us, groovy.

* Enable reconnects

* Misc cleanup

* disable istio-injection in nats deployments

* prune kne

* cleanup

* stan: disable istio

* mdsctl: patch nats helm so that it's operations are distinct from init,cluster

* (un)install:stan fix

* cleanup natsbox conf

* install {tools}/helm:2.14.1 if not preent in the env

* bump stan disk allocation

* allow for more-more-then-one (natsbox, curl, dns) deploys

* add ServiceEntry egress for nats, and DestinationRule to disable mTLS for the destination namespace

* switch default nats namespace to "nats" from "default", use correct nats endpoint for stan

* mdsctl: +(nats,stan)-local, rm(kne*); next: conf mds->nats.nats

* mds: add env NATS=nats.nats, set STAN_CLUSTER=stan; would like to remove env STAN, STAN_CREDENTIALS, SINK

* patch

* helm/mds/.../egress.yaml: fix typo

* patch: get image versions

* +kubectx, helm/mds/deployment conf nats ns

* cold-start install patch

* cleanup

* stan: set max-message,max-bytes=0 (unlimited)

* mdsctl: keep-cache support for yarn

* trip-proc cron job

* Cron restart policy fix

* cronjobs in the house

* sync mds-trip

* cleanup

* mds/templates: image w/ & w/o registry

* cleanup env

* Remove CE_NAME and STAN in favor of NATS

* Update STAN_CLUSTER to nats-streaming

* Switch to using env.NATS for streaming

* More switching to env.NATS

* provider-proc cron edits

* Await parseTripsEvents

* u/d readme(mdsctl)

* u/d mdsctl

* u/d mdsctl

* mdsctl: support provider=aws:imageTag (get latest tag by image name)

* mdsctl: u/d readme

* Optional processor fix

* mount mds-config configmap

* Remove db.startup, cache.startup, getConfig. They're not working properly at the moment

* Remove db.startup from mds-provider-processor

* +surveyor, rename stan-statefulset to nats-streaming-server

* helm/mds: disable (trip, provider) processors, as they are invokved via cron

* surveyor: rm creds

* helm/natsbox: rename to nats-box

* Force exit after function is done

* use namespace name as default TENANT_ID

* Fix bad variable injection

* allow empty tenantId for legacy installs (ladot), use namespace if key is missing from .Values

* helm/mds: clean-up proto dead-code

* not using knative anymore

* consistent naming

* cleanup resource names

* differentiate nats/stan config-map names

* s/example-nats/nats/

* switch cron to hourly, turn off migrations for agency

* Update mdsctl

* Update README.md

* Update mdsctl

* Update mdsctl

* remove dependency on ~/.bashrc

* mdsctl: remove persisting conf in ~/.bashrc

* minor refactor - put event-processor into APIs as a service deployment and put trip- and provider- processors into cronjobs.  retire old metrics-sheet specific cronjob

* pull out nats-surveyor to be applied to a subsequent branch

* Drop nullish coalescence operator in favor of logical OR for TENANT_ID

* Update TENANT_REGEXP

* update template to match yaml, remove spurious env vars

* helm/nats: patch stan conf (store typo)

* Switch processors -> cronjobs

* mdsctl: build/yarn-clean

* helm: prune nats-local

* Typo

* Env var defaults cleanup

* u/d readme re k8s conf

* Add comment detailing writeCloudEvent

Co-authored-by: James Todd <99516+jwtodd@users.noreply.github.com>
Co-authored-by: Alex Gottschalk <389982+invertigo@users.noreply.github.com>
Co-authored-by: Evan Adkins <53316916+evanxadkins@users.noreply.github.com>

readme/docker-desktop-config cleanup

…nt due to performance problems in production (#169)

* First-pass at okteto integration

* Add per-service okteto config

* Move config back to top level

* Update docs, fix missing name

* update docs

* Oops

* Update docs

* Update docs moar

* Docs updates