Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AMQP Transport: Unexpected exception being thrown when connectivity is unstable. #569

Closed
stefannilsson opened this issue Jun 10, 2019 · 8 comments · Fixed by #576
Closed
Assignees

Comments

@stefannilsson
Copy link

Context

  • OS and version used: Ubuntu Core 16 (snap environment, running in "devmode")
  • Node.js version: v8.15.0
  • npm version: 6.4.1
  • list of installed packages:
root@MACHINE1:/tmp# cat npm-list 
/root/snap/microservicebus-node/43
├─┬ @serialport/bindings@2.0.7
│ ├─┬ @serialport/binding-abstract@2.0.4
│ │ └── debug@4.1.1 extraneous
│ ├─┬ @serialport/parser-readline@2.0.2
│ │ └── @serialport/parser-delimiter@2.0.2
│ ├─┬ bindings@1.5.0
│ │ └── file-uri-to-path@1.0.0
│ ├── debug@4.1.1 extraneous
│ ├── nan@2.12.1
│ └─┬ prebuild-install@5.2.5
│   ├── detect-libc@1.0.3
│   ├── expand-template@2.0.3
│   ├── github-from-package@0.0.0
│   ├── minimist@1.2.0 extraneous
│   ├─┬ mkdirp@0.5.1
│   │ └── minimist@0.0.8
│   ├── napi-build-utils@1.0.1
│   ├─┬ node-abi@2.7.1
│   │ └── semver@5.6.0
│   ├── noop-logger@0.1.1
│   ├─┬ npmlog@4.1.2
│   │ ├─┬ are-we-there-yet@1.1.5
│   │ │ ├── delegates@1.0.0
│   │ │ └── readable-stream@2.0.6 deduped
│   │ ├── console-control-strings@1.1.0
│   │ ├─┬ gauge@2.7.4
│   │ │ ├── aproba@1.2.0
│   │ │ ├── console-control-strings@1.1.0 deduped
│   │ │ ├── has-unicode@2.0.1
│   │ │ ├── object-assign@4.1.1
│   │ │ ├── signal-exit@3.0.2
│   │ │ ├─┬ string-width@1.0.2
│   │ │ │ ├── code-point-at@1.1.0
│   │ │ │ ├─┬ is-fullwidth-code-point@1.0.0
│   │ │ │ │ └── number-is-nan@1.0.1
│   │ │ │ └── strip-ansi@3.0.1 deduped
│   │ │ ├─┬ strip-ansi@3.0.1
│   │ │ │ └── ansi-regex@2.1.1
│   │ │ └─┬ wide-align@1.1.3
│   │ │   └── string-width@1.0.2 deduped
│   │ └── set-blocking@2.0.0
│   ├── os-homedir@1.0.2
│   ├── pump@2.0.1 extraneous
│   ├─┬ rc@1.2.8
│   │ ├── deep-extend@0.6.0
│   │ ├── ini@1.3.5
│   │ ├── minimist@1.2.0 extraneous
│   │ └── strip-json-comments@2.0.1
│   ├─┬ simple-get@2.8.1
│   │ ├─┬ decompress-response@3.3.0
│   │ │ └── mimic-response@1.0.1
│   │ ├─┬ once@1.4.0
│   │ │ └── wrappy@1.0.2
│   │ └── simple-concat@1.0.0
│   ├─┬ tar-fs@1.16.3
│   │ ├── chownr@1.1.1
│   │ ├── mkdirp@0.5.1 deduped
│   │ ├── pump@1.0.3 extraneous
│   │ └─┬ tar-stream@1.6.2
│   │   ├─┬ bl@1.2.2
│   │   │ ├── readable-stream@2.3.6 extraneous
│   │   │ └── safe-buffer@5.1.2 deduped
│   │   ├─┬ buffer-alloc@1.2.0
│   │   │ ├── buffer-alloc-unsafe@1.1.0
│   │   │ └── buffer-fill@1.0.0
│   │   ├── end-of-stream@1.4.1 deduped
│   │   ├── fs-constants@1.0.0
│   │   ├── readable-stream@2.3.6 extraneous
│   │   ├── to-buffer@1.1.1
│   │   └── xtend@4.0.1 deduped
│   ├─┬ tunnel-agent@0.6.0
│   │ └── safe-buffer@5.1.2 deduped
│   └── which-pm-runs@1.0.0
├── @serialport/parser-byte-length@2.0.2
├── @serialport/parser-cctalk@2.0.2
├── @serialport/parser-ready@2.0.2
├── @serialport/parser-regex@2.0.2
├─┬ @serialport/stream@2.0.4
│ ├─┬ @serialport/binding-mock@2.0.4
│ │ ├── @serialport/binding-abstract@2.0.4 deduped
│ │ └── debug@4.1.1 extraneous
│ └── debug@4.1.1 extraneous
├─┬ azure-iot-amqp-base@2.2.4
│ ├── async@2.6.2 extraneous
│ ├── azure-iot-common@1.9.4 extraneous
│ ├── debug@3.2.6 extraneous
│ ├── lodash.merge@4.6.1
│ ├─┬ machina@4.0.2
│ │ └── lodash@4.17.11
│ ├─┬ rhea@0.3.11
│ │ └─┬ debug@2.6.9
│ │   └── ms@2.0.0
│ ├── uuid@3.3.2 extraneous
│ └── ws@6.2.1 extraneous
├─┬ azure-iot-device-amqp@1.9.9
│ ├── async@2.6.2 extraneous
│ ├── azure-iot-amqp-base@2.2.9 extraneous
│ ├─┬ azure-iot-common@1.9.9
│ │ └─┬ getos@3.1.1
│ │   └── async@2.6.1 extraneous
│ ├─┬ azure-iot-device@1.9.9
│ │ ├── azure-iot-common@1.9.9 deduped
│ │ ├── azure-iot-http-base@1.9.9 extraneous
│ │ ├─┬ azure-storage@2.10.2
│ │ │ ├── browserify-mime@1.2.9
│ │ │ ├── extend@3.0.2 extraneous
│ │ │ ├─┬ json-edm-parser@0.1.2
│ │ │ │ └── jsonparse@1.2.0
│ │ │ ├─┬ md5.js@1.3.4
│ │ │ │ ├─┬ hash-base@3.0.4
│ │ │ │ │ ├── inherits@2.0.3 deduped
│ │ │ │ │ └── safe-buffer@5.1.2 deduped
│ │ │ │ └── inherits@2.0.3 deduped
│ │ │ ├─┬ readable-stream@2.0.6
│ │ │ │ ├── core-util-is@1.0.2
│ │ │ │ ├── inherits@2.0.3 deduped
│ │ │ │ ├── isarray@1.0.0
│ │ │ │ ├── process-nextick-args@1.0.7
│ │ │ │ ├── string_decoder@0.10.31
│ │ │ │ └── util-deprecate@1.0.2
│ │ │ ├── request@2.88.0 deduped
│ │ │ ├── underscore@1.8.3 deduped
│ │ │ ├── uuid@3.3.2 extraneous
│ │ │ ├── validator@9.4.1
│ │ │ ├─┬ xml2js@0.2.8
│ │ │ │ └── sax@0.5.8
│ │ │ └── xmlbuilder@9.0.7
│ │ ├── debug@4.1.1 extraneous
│ │ ├── lodash@4.17.11 deduped
│ │ ├── machina@4.0.2 deduped
│ │ └── traverse@0.6.6
│ ├── debug@4.1.1 extraneous
│ ├── machina@4.0.2 deduped
│ ├── rhea@1.0.7 extraneous
│ └── uuid@3.3.2 extraneous
├─┬ azure-iot-device-mqtt@1.9.4
│ ├── azure-iot-common@1.9.4 extraneous
│ ├── azure-iot-device@1.9.4 extraneous
│ ├─┬ azure-iot-mqtt-base@1.9.4
│ │ ├── azure-iot-common@1.9.4 extraneous
│ │ ├── debug@3.2.6 extraneous
│ │ ├── machina@4.0.2 deduped
│ │ └─┬ mqtt@2.18.8
│ │   ├─┬ commist@1.1.0
│ │   │ ├── leven@2.1.0
│ │   │ └── minimist@1.2.0 extraneous
│ │   ├─┬ concat-stream@1.6.2
│ │   │ ├── buffer-from@1.1.1
│ │   │ ├── inherits@2.0.3 deduped
│ │   │ ├── readable-stream@2.3.6 extraneous
│ │   │ └── typedarray@0.0.6
│ │   ├─┬ end-of-stream@1.4.1
│ │   │ └── once@1.4.0 deduped
│ │   ├─┬ es6-map@0.1.5
│ │   │ ├─┬ d@1.0.0
│ │   │ │ └── es5-ext@0.10.49 deduped
│ │   │ ├─┬ es5-ext@0.10.49
│ │   │ │ ├── es6-iterator@2.0.3 deduped
│ │   │ │ ├── es6-symbol@3.1.1 deduped
│ │   │ │ └── next-tick@1.0.0
│ │   │ ├─┬ es6-iterator@2.0.3
│ │   │ │ ├── d@1.0.0 deduped
│ │   │ │ ├── es5-ext@0.10.49 deduped
│ │   │ │ └── es6-symbol@3.1.1 deduped
│ │   │ ├─┬ es6-set@0.1.5
│ │   │ │ ├── d@1.0.0 deduped
│ │   │ │ ├── es5-ext@0.10.49 deduped
│ │   │ │ ├── es6-iterator@2.0.3 deduped
│ │   │ │ ├── es6-symbol@3.1.1 deduped
│ │   │ │ └── event-emitter@0.3.5 deduped
│ │   │ ├─┬ es6-symbol@3.1.1
│ │   │ │ ├── d@1.0.0 deduped
│ │   │ │ └── es5-ext@0.10.49 deduped
│ │   │ └─┬ event-emitter@0.3.5
│ │   │   ├── d@1.0.0 deduped
│ │   │   └── es5-ext@0.10.49 deduped
│ │   ├─┬ help-me@1.1.0
│ │   │ ├─┬ callback-stream@1.1.0
│ │   │ │ ├── inherits@2.0.3 deduped
│ │   │ │ └── readable-stream@2.0.6 deduped
│ │   │ ├─┬ glob-stream@6.1.0
│ │   │ │ ├── extend@3.0.1
│ │   │ │ ├── glob@7.1.2 deduped
│ │   │ │ ├─┬ glob-parent@3.1.0
│ │   │ │ │ ├─┬ is-glob@3.1.0
│ │   │ │ │ │ └── is-extglob@2.1.1
│ │   │ │ │ └── path-dirname@1.0.2
│ │   │ │ ├── is-negated-glob@1.0.0
│ │   │ │ ├─┬ ordered-read-streams@1.0.1
│ │   │ │ │ └── readable-stream@2.0.6 deduped
│ │   │ │ ├─┬ pumpify@1.5.1
│ │   │ │ │ ├── duplexify@3.7.1 deduped
│ │   │ │ │ ├── inherits@2.0.3 deduped
│ │   │ │ │ └── pump@2.0.1 extraneous
│ │   │ │ ├── readable-stream@2.3.6 extraneous
│ │   │ │ ├── remove-trailing-separator@1.1.0
│ │   │ │ ├─┬ to-absolute-glob@2.0.2
│ │   │ │ │ ├── is-absolute@1.0.0 extraneous
│ │   │ │ │ └── is-negated-glob@1.0.0 deduped
│ │   │ │ └─┬ unique-stream@2.3.1
│ │   │ │   ├── json-stable-stringify-without-jsonify@1.0.1
│ │   │ │   └─┬ through2-filter@3.0.0
│ │   │ │     ├── through2@2.0.5 deduped
│ │   │ │     └── xtend@4.0.1 deduped
│ │   │ ├── through2@2.0.5 deduped
│ │   │ └── xtend@4.0.1 deduped
│ │   ├── inherits@2.0.3
│ │   ├── minimist@1.2.0 extraneous
│ │   ├─┬ mqtt-packet@5.6.0
│ │   │ ├── bl@1.2.2 deduped
│ │   │ ├── inherits@2.0.3 deduped
│ │   │ ├── process-nextick-args@2.0.0 extraneous
│ │   │ └── safe-buffer@5.1.2 deduped
│ │   ├─┬ pump@3.0.0
│ │   │ ├── end-of-stream@1.4.1 deduped
│ │   │ └── once@1.4.0 deduped
│ │   ├── readable-stream@2.3.6 extraneous
│ │   ├── reinterval@1.1.0
│ │   ├─┬ split2@2.2.0
│ │   │ └── through2@2.0.5 deduped
│ │   ├─┬ websocket-stream@5.4.0
│ │   │ ├─┬ duplexify@3.7.1
│ │   │ │ ├── end-of-stream@1.4.1 deduped
│ │   │ │ ├── inherits@2.0.3 deduped
│ │   │ │ ├── readable-stream@2.0.6 deduped
│ │   │ │ └── stream-shift@1.0.0
│ │   │ ├── inherits@2.0.3 deduped
│ │   │ ├── readable-stream@2.3.6 extraneous
│ │   │ ├── safe-buffer@5.1.2 deduped
│ │   │ ├─┬ ws@3.3.3
│ │   │ │ ├── async-limiter@1.0.0
│ │   │ │ ├── safe-buffer@5.1.2 deduped
│ │   │ │ └── ultron@1.1.1
│ │   │ └── xtend@4.0.1 deduped
│ │   └── xtend@4.0.1
│ ├── debug@3.2.6 extraneous
│ ├── machina@4.0.2 deduped
│ └── uuid@3.3.2 extraneous
├─┬ diskusage@0.2.4
│ └── nan@2.12.1 deduped
├─┬ microservicebus-core@2.0.65
│ ├── app-module-path@2.2.0
│ ├── async@1.4.2
│ ├─┬ chai@4.1.2
│ │ ├── assertion-error@1.1.0
│ │ ├── check-error@1.0.2
│ │ ├─┬ deep-eql@3.0.1
│ │ │ └── type-detect@4.0.8 deduped
│ │ ├── get-func-name@2.0.0
│ │ ├── pathval@1.1.0
│ │ └── type-detect@4.0.8
│ ├── colors@1.1.2
│ ├─┬ cron@1.6.0
│ │ └── moment-timezone@0.5.14 deduped
│ ├── exists-sync@0.0.3
│ ├── extend@3.0.2 extraneous
│ ├─┬ getmac@1.2.1
│ │ └─┬ extract-opts@3.3.1
│ │   ├─┬ eachr@3.2.0
│ │   │ ├── editions@1.3.4 deduped
│ │   │ └── typechecker@4.7.0 deduped
│ │   ├── editions@1.3.4
│ │   └─┬ typechecker@4.7.0
│ │     └── editions@2.1.3 extraneous
│ ├── graceful-fs@4.1.5
│ ├── linq@3.0.5
│ ├─┬ mocha@5.1.1
│ │ ├── browser-stdout@1.3.1
│ │ ├── commander@2.11.0 extraneous
│ │ ├── debug@3.1.0 extraneous
│ │ ├── diff@3.5.0
│ │ ├── escape-string-regexp@1.0.5
│ │ ├─┬ glob@7.1.2
│ │ │ ├── fs.realpath@1.0.0
│ │ │ ├─┬ inflight@1.0.6
│ │ │ │ ├── once@1.4.0 deduped
│ │ │ │ └── wrappy@1.0.2 deduped
│ │ │ ├── inherits@2.0.3 deduped
│ │ │ ├── minimatch@3.0.4 deduped
│ │ │ ├── once@1.4.0 deduped
│ │ │ └── path-is-absolute@1.0.1
│ │ ├── growl@1.10.3
│ │ ├── he@1.1.1
│ │ ├─┬ minimatch@3.0.4
│ │ │ └─┬ brace-expansion@1.1.11
│ │ │   ├── balanced-match@1.0.0
│ │ │   └── concat-map@0.0.1
│ │ ├── mkdirp@0.5.1 deduped
│ │ └─┬ supports-color@4.4.0
│ │   └── has-flag@2.0.0
│ ├── moment@2.20.0
│ ├─┬ moment-timezone@0.5.14
│ │ └── moment@2.20.0 deduped
│ ├─┬ network@0.4.0
│ │ ├── async@1.5.2 extraneous
│ │ ├─┬ commander@2.9.0
│ │ │ └── graceful-readlink@1.0.1
│ │ ├─┬ needle@1.1.2
│ │ │ ├── debug@2.6.9 deduped
│ │ │ └─┬ iconv-lite@0.4.24
│ │ │   └── safer-buffer@2.1.2
│ │ └─┬ wmic@0.1.0
│ │   ├── async@2.6.2 extraneous
│ │   └── iconv-lite@0.4.24 deduped
│ ├─┬ node-persist@2.1.0
│ │ ├─┬ is-absolute@0.2.6
│ │ │ ├─┬ is-relative@0.2.1
│ │ │ │ └─┬ is-unc-path@0.1.2
│ │ │ │   └── unc-path-regex@0.1.2
│ │ │ └── is-windows@0.2.0
│ │ ├── mkdirp@0.5.1 deduped
│ │ └── q@1.1.2
│ ├─┬ npm@6.4.1
│ │ ├── abbrev@1.1.1 extraneous
│ │ ├── ansicolors@0.3.2 extraneous
│ │ ├── ansistyles@0.1.3 extraneous
│ │ ├── aproba@1.2.0 extraneous
│ │ ├── archy@1.0.0 extraneous
│ │ ├── bin-links@1.1.2 extraneous
│ │ ├── bluebird@3.5.1 extraneous
│ │ ├── byte-size@4.0.3 extraneous
│ │ ├── cacache@11.2.0 extraneous
│ │ ├── call-limit@1.1.0 extraneous
│ │ ├── chownr@1.0.1 extraneous
│ │ ├── ci-info@1.4.0 extraneous
│ │ ├── cli-columns@3.1.2 extraneous
│ │ ├── cli-table3@0.5.0 extraneous
│ │ ├── cmd-shim@2.0.2 extraneous
│ │ ├── columnify@1.5.4 extraneous
│ │ ├── config-chain@1.1.11 extraneous
│ │ ├── debuglog@1.0.1 extraneous
│ │ ├── detect-indent@5.0.0 extraneous
│ │ ├── detect-newline@2.1.0 extraneous
│ │ ├── dezalgo@1.0.3 extraneous
│ │ ├── editor@1.0.0 extraneous
│ │ ├── figgy-pudding@3.4.1 extraneous
│ │ ├── find-npm-prefix@1.0.2 extraneous
│ │ ├── fs-vacuum@1.2.10 extraneous
│ │ ├── fs-write-stream-atomic@1.0.10 extraneous
│ │ ├── gentle-fs@2.0.1 extraneous
│ │ ├── glob@7.1.2 extraneous
│ │ ├── graceful-fs@4.1.11 extraneous
│ │ ├── has-unicode@2.0.1 extraneous
│ │ ├── hosted-git-info@2.7.1 extraneous
│ │ ├── iferr@1.0.2 extraneous
│ │ ├── imurmurhash@0.1.4 extraneous
│ │ ├── inflight@1.0.6 extraneous
│ │ ├── inherits@2.0.3 extraneous
│ │ ├── ini@1.3.5 extraneous
│ │ ├── init-package-json@1.10.3 extraneous
│ │ ├── is-cidr@2.0.6 extraneous
│ │ ├── json-parse-better-errors@1.0.2 extraneous
│ │ ├── JSONStream@1.3.4 extraneous
│ │ ├── lazy-property@1.0.0 extraneous
│ │ ├── libcipm@2.0.2 extraneous
│ │ ├── libnpmhook@4.0.1 extraneous
│ │ ├── libnpx@10.2.0 extraneous
│ │ ├── lock-verify@2.0.2 extraneous
│ │ ├── lockfile@1.0.4 extraneous
│ │ ├── lodash._baseindexof@3.1.0 extraneous
│ │ ├── lodash._baseuniq@4.6.0 extraneous
│ │ ├── lodash._bindcallback@3.0.1 extraneous
│ │ ├── lodash._cacheindexof@3.0.2 extraneous
│ │ ├── lodash._createcache@3.1.2 extraneous
│ │ ├── lodash._getnative@3.9.1 extraneous
│ │ ├── lodash.clonedeep@4.5.0 extraneous
│ │ ├── lodash.restparam@3.6.1 extraneous
│ │ ├── lodash.union@4.6.0 extraneous
│ │ ├── lodash.uniq@4.5.0 extraneous
│ │ ├── lodash.without@4.4.0 extraneous
│ │ ├── lru-cache@4.1.3 extraneous
│ │ ├── meant@1.0.1 extraneous
│ │ ├── mississippi@3.0.0 extraneous
│ │ ├── mkdirp@0.5.1 extraneous
│ │ ├── move-concurrently@1.0.1 extraneous
│ │ ├── node-gyp@3.8.0 extraneous
│ │ ├── nopt@4.0.1 extraneous
│ │ ├── normalize-package-data@2.4.0 extraneous
│ │ ├── npm-audit-report@1.3.1 extraneous
│ │ ├── npm-cache-filename@1.0.2 extraneous
│ │ ├── npm-install-checks@3.0.0 extraneous
│ │ ├── npm-lifecycle@2.1.0 extraneous
│ │ ├── npm-package-arg@6.1.0 extraneous
│ │ ├── npm-packlist@1.1.11 extraneous
│ │ ├── npm-pick-manifest@2.1.0 extraneous
│ │ ├── npm-profile@3.0.2 extraneous
│ │ ├── npm-registry-client@8.6.0 extraneous
│ │ ├── npm-registry-fetch@1.1.0 extraneous
│ │ ├── npm-user-validate@1.0.0 extraneous
│ │ ├── npmlog@4.1.2 extraneous
│ │ ├── once@1.4.0 extraneous
│ │ ├── opener@1.5.0 extraneous
│ │ ├── osenv@0.1.5 extraneous
│ │ ├── pacote@8.1.6 extraneous
│ │ ├── path-is-inside@1.0.2 extraneous
│ │ ├── promise-inflight@1.0.1 extraneous
│ │ ├── qrcode-terminal@0.12.0 extraneous
│ │ ├── query-string@6.1.0 extraneous
│ │ ├── qw@1.0.1 extraneous
│ │ ├── read@1.0.7 extraneous
│ │ ├── read-cmd-shim@1.0.1 extraneous
│ │ ├── read-installed@4.0.3 extraneous
│ │ ├── read-package-json@2.0.13 extraneous
│ │ ├── read-package-tree@5.2.1 extraneous
│ │ ├── readable-stream@2.3.6 extraneous
│ │ ├── readdir-scoped-modules@1.0.2 extraneous
│ │ ├── request@2.88.0 extraneous
│ │ ├── retry@0.12.0 extraneous
│ │ ├── rimraf@2.6.2 extraneous
│ │ ├── safe-buffer@5.1.2 extraneous
│ │ ├── semver@5.5.0 extraneous
│ │ ├── sha@2.0.1 extraneous
│ │ ├── slide@1.1.6 extraneous
│ │ ├── sorted-object@2.0.1 extraneous
│ │ ├── sorted-union-stream@2.1.3 extraneous
│ │ ├── ssri@6.0.0 extraneous
│ │ ├── stringify-package@1.0.0 extraneous
│ │ ├── tar@4.4.6 extraneous
│ │ ├── text-table@0.2.0 extraneous
│ │ ├── tiny-relative-date@1.3.0 extraneous
│ │ ├── uid-number@0.0.6 extraneous
│ │ ├── umask@1.1.0 extraneous
│ │ ├── unique-filename@1.1.0 extraneous
│ │ ├── unpipe@1.0.0 extraneous
│ │ ├── update-notifier@2.5.0 extraneous
│ │ ├── uuid@3.3.2 extraneous
│ │ ├── validate-npm-package-license@3.0.4 extraneous
│ │ ├── validate-npm-package-name@3.0.0 extraneous
│ │ ├── which@1.3.1 extraneous
│ │ ├── worker-farm@1.6.0 extraneous
│ │ └── write-file-atomic@2.3.0 extraneous
│ ├── progress@1.1.8
│ ├─┬ request@2.88.0
│ │ ├── aws-sign2@0.7.0
│ │ ├── aws4@1.8.0
│ │ ├── caseless@0.12.0
│ │ ├─┬ combined-stream@1.0.7
│ │ │ └── delayed-stream@1.0.0
│ │ ├── extend@3.0.2 extraneous
│ │ ├── forever-agent@0.6.1
│ │ ├─┬ form-data@2.3.3
│ │ │ ├── asynckit@0.4.0
│ │ │ ├── combined-stream@1.0.7 deduped
│ │ │ └── mime-types@2.1.22 deduped
│ │ ├─┬ har-validator@5.1.3
│ │ │ ├─┬ ajv@6.10.0
│ │ │ │ ├── fast-deep-equal@2.0.1
│ │ │ │ ├── fast-json-stable-stringify@2.0.0
│ │ │ │ ├── json-schema-traverse@0.4.1
│ │ │ │ └─┬ uri-js@4.2.2
│ │ │ │   └── punycode@2.1.1
│ │ │ └── har-schema@2.0.0
│ │ ├─┬ http-signature@1.2.0
│ │ │ ├── assert-plus@1.0.0
│ │ │ ├─┬ jsprim@1.4.1
│ │ │ │ ├── assert-plus@1.0.0 deduped
│ │ │ │ ├── extsprintf@1.3.0
│ │ │ │ ├── json-schema@0.2.3
│ │ │ │ └─┬ verror@1.10.0
│ │ │ │   ├── assert-plus@1.0.0 deduped
│ │ │ │   ├── core-util-is@1.0.2 deduped
│ │ │ │   └── extsprintf@1.3.0 deduped
│ │ │ └─┬ sshpk@1.16.1
│ │ │   ├─┬ asn1@0.2.4
│ │ │   │ └── safer-buffer@2.1.2 deduped
│ │ │   ├── assert-plus@1.0.0 deduped
│ │ │   ├─┬ bcrypt-pbkdf@1.0.2
│ │ │   │ └── tweetnacl@0.14.5 deduped
│ │ │   ├─┬ dashdash@1.14.1
│ │ │   │ └── assert-plus@1.0.0 deduped
│ │ │   ├─┬ ecc-jsbn@0.1.2
│ │ │   │ ├── jsbn@0.1.1 deduped
│ │ │   │ └── safer-buffer@2.1.2 deduped
│ │ │   ├─┬ getpass@0.1.7
│ │ │   │ └── assert-plus@1.0.0 deduped
│ │ │   ├── jsbn@0.1.1
│ │ │   ├── safer-buffer@2.1.2 deduped
│ │ │   └── tweetnacl@0.14.5
│ │ ├── is-typedarray@1.0.0
│ │ ├── isstream@0.1.2
│ │ ├── json-stringify-safe@5.0.1
│ │ ├─┬ mime-types@2.1.22
│ │ │ └── mime-db@1.38.0
│ │ ├── oauth-sign@0.9.0
│ │ ├── performance-now@2.1.0
│ │ ├── qs@6.5.2
│ │ ├── safe-buffer@5.1.2 deduped
│ │ ├─┬ tough-cookie@2.4.3
│ │ │ ├── psl@1.1.31
│ │ │ └── punycode@1.4.1 extraneous
│ │ ├── tunnel-agent@0.6.0 deduped
│ │ └── uuid@3.3.2 extraneous
│ ├── require-reload@0.2.2
│ ├─┬ retry-request@4.0.0
│ │ └─┬ through2@2.0.5
│ │   ├── readable-stream@2.3.6 extraneous
│ │   └── xtend@4.0.1 deduped
│ ├─┬ should@13.2.1
│ │ ├─┬ should-equal@2.0.0
│ │ │ └── should-type@1.4.0 deduped
│ │ ├─┬ should-format@3.0.3
│ │ │ ├── should-type@1.4.0 deduped
│ │ │ └── should-type-adaptors@1.1.0 deduped
│ │ ├── should-type@1.4.0
│ │ ├─┬ should-type-adaptors@1.1.0
│ │ │ ├── should-type@1.4.0 deduped
│ │ │ └── should-util@1.0.0 deduped
│ │ └── should-util@1.0.0
│ ├── underscore@1.8.3
│ ├── uuid@2.0.3
│ └─┬ websocket@1.0.26
│   ├── debug@2.6.9 deduped
│   ├── nan@2.12.1 deduped
│   ├─┬ typedarray-to-buffer@3.1.5
│   │ └── is-typedarray@1.0.0 deduped
│   └── yaeti@0.0.6
└─┬ serialport@6.2.2
  ├── @serialport/parser-byte-length@1.0.5 extraneous
  ├── @serialport/parser-cctalk@1.0.5 extraneous
  ├── @serialport/parser-delimiter@1.0.5 extraneous
  ├── @serialport/parser-readline@1.0.5 extraneous
  ├── @serialport/parser-ready@1.0.5 extraneous
  ├── @serialport/parser-regex@1.0.5 extraneous
  ├── bindings@1.3.0 extraneous
  ├── commander@2.20.0 extraneous
  ├── debug@3.2.6 extraneous
  ├── nan@2.12.1 deduped
  ├── prebuild-install@4.0.0 extraneous
  ├── promirepl@1.0.1
  ├─┬ prompt-list@3.2.0
  │ ├─┬ ansi-cyan@0.1.1
  │ │ └── ansi-wrap@0.1.0
  │ ├─┬ ansi-dim@0.1.1
  │ │ └── ansi-wrap@0.1.0 deduped
  │ └─┬ prompt-radio@1.2.1
  │   ├── debug@2.6.9 deduped
  │   └─┬ prompt-checkbox@2.2.0
  │     ├── ansi-cyan@0.1.1 deduped
  │     ├── debug@2.6.9 deduped
  │     └─┬ prompt-base@4.1.0
  │       ├── component-emitter@1.2.1
  │       ├── debug@3.2.6 extraneous
  │       ├── koalas@1.0.2
  │       ├─┬ log-utils@0.2.1
  │       │ ├─┬ ansi-colors@0.2.0
  │       │ │ ├─┬ ansi-bgblack@0.1.1
  │       │ │ │ └── ansi-wrap@0.1.0 deduped
  │       │ │ ├─┬ ansi-bgblue@0.1.1
  │       │ │ │ └── ansi-wrap@0.1.0 deduped
  │       │ │ ├─┬ ansi-bgcyan@0.1.1
  │       │ │ │ └── ansi-wrap@0.1.0 deduped
  │       │ │ ├─┬ ansi-bggreen@0.1.1
  │       │ │ │ └── ansi-wrap@0.1.0 deduped
  │       │ │ ├─┬ ansi-bgmagenta@0.1.1
  │       │ │ │ └── ansi-wrap@0.1.0 deduped
  │       │ │ ├─┬ ansi-bgred@0.1.1
  │       │ │ │ └── ansi-wrap@0.1.0 deduped
  │       │ │ ├─┬ ansi-bgwhite@0.1.1
  │       │ │ │ └── ansi-wrap@0.1.0 deduped
  │       │ │ ├─┬ ansi-bgyellow@0.1.1
  │       │ │ │ └── ansi-wrap@0.1.0 deduped
  │       │ │ ├─┬ ansi-black@0.1.1
  │       │ │ │ └── ansi-wrap@0.1.0 deduped
  │       │ │ ├─┬ ansi-blue@0.1.1
  │       │ │ │ └── ansi-wrap@0.1.0 deduped
  │       │ │ ├─┬ ansi-bold@0.1.1
  │       │ │ │ └── ansi-wrap@0.1.0 deduped
  │       │ │ ├── ansi-cyan@0.1.1 deduped
  │       │ │ ├── ansi-dim@0.1.1 deduped
  │       │ │ ├─┬ ansi-gray@0.1.1
  │       │ │ │ └── ansi-wrap@0.1.0 deduped
  │       │ │ ├─┬ ansi-green@0.1.1
  │       │ │ │ └── ansi-wrap@0.1.0 deduped
  │       │ │ ├─┬ ansi-grey@0.1.1
  │       │ │ │ └── ansi-wrap@0.1.0 deduped
  │       │ │ ├─┬ ansi-hidden@0.1.1
  │       │ │ │ └── ansi-wrap@0.1.0 deduped
  │       │ │ ├─┬ ansi-inverse@0.1.1
  │       │ │ │ └── ansi-wrap@0.1.0 deduped
  │       │ │ ├─┬ ansi-italic@0.1.1
  │       │ │ │ └── ansi-wrap@0.1.0 deduped
  │       │ │ ├─┬ ansi-magenta@0.1.1
  │       │ │ │ └── ansi-wrap@0.1.0 deduped
  │       │ │ ├─┬ ansi-red@0.1.1
  │       │ │ │ └── ansi-wrap@0.1.0 deduped
  │       │ │ ├─┬ ansi-reset@0.1.1
  │       │ │ │ └── ansi-wrap@0.1.0 deduped
  │       │ │ ├─┬ ansi-strikethrough@0.1.1
  │       │ │ │ └── ansi-wrap@0.1.0 deduped
  │       │ │ ├─┬ ansi-underline@0.1.1
  │       │ │ │ └── ansi-wrap@0.1.0 deduped
  │       │ │ ├─┬ ansi-white@0.1.1
  │       │ │ │ └── ansi-wrap@0.1.0 deduped
  │       │ │ ├─┬ ansi-yellow@0.1.1
  │       │ │ │ └── ansi-wrap@0.1.0 deduped
  │       │ │ └─┬ lazy-cache@2.0.2
  │       │ │   └─┬ set-getter@0.1.0
  │       │ │     └─┬ to-object-path@0.3.0
  │       │ │       └── kind-of@3.2.2 deduped
  │       │ ├── error-symbol@0.1.0
  │       │ ├── info-symbol@0.1.0
  │       │ ├─┬ log-ok@0.1.1
  │       │ │ ├── ansi-green@0.1.1 deduped
  │       │ │ └── success-symbol@0.1.0 deduped
  │       │ ├── success-symbol@0.1.0
  │       │ ├── time-stamp@1.1.0
  │       │ └── warning-symbol@0.1.0
  │       ├─┬ prompt-actions@3.0.2
  │       │ └── debug@2.6.9 deduped
  │       ├─┬ prompt-question@5.0.2
  │       │ ├─┬ clone-deep@1.0.0
  │       │ │ ├─┬ for-own@1.0.0
  │       │ │ │ └── for-in@1.0.2
  │       │ │ ├─┬ is-plain-object@2.0.4
  │       │ │ │ └── isobject@3.0.1 deduped
  │       │ │ ├── kind-of@5.1.0 extraneous
  │       │ │ └─┬ shallow-clone@1.0.0
  │       │ │   ├── is-extendable@0.1.1 deduped
  │       │ │   ├── kind-of@5.1.0 extraneous
  │       │ │   └─┬ mixin-object@2.0.1
  │       │ │     ├── for-in@0.1.8 extraneous
  │       │ │     └── is-extendable@0.1.1 deduped
  │       │ ├── debug@3.2.6 extraneous
  │       │ ├─┬ define-property@1.0.0
  │       │ │ └─┬ is-descriptor@1.0.2
  │       │ │   ├─┬ is-accessor-descriptor@1.0.0
  │       │ │   │ └── kind-of@6.0.2 extraneous
  │       │ │   ├─┬ is-data-descriptor@1.0.0
  │       │ │   │ └── kind-of@6.0.2 extraneous
  │       │ │   └── kind-of@6.0.2 extraneous
  │       │ ├── isobject@3.0.1
  │       │ ├── kind-of@5.1.0 extraneous
  │       │ ├── koalas@1.0.2 deduped
  │       │ └─┬ prompt-choices@4.1.0
  │       │   ├── arr-flatten@1.1.0 deduped
  │       │   ├─┬ arr-swap@1.0.1
  │       │   │ └── is-number@3.0.0 extraneous
  │       │   ├─┬ choices-separator@2.0.0
  │       │   │ ├── ansi-dim@0.1.1 deduped
  │       │   │ ├── debug@2.6.9 deduped
  │       │   │ └── strip-color@0.1.0 deduped
  │       │   ├── clone-deep@4.0.1 extraneous
  │       │   ├─┬ collection-visit@1.0.0
  │       │   │ ├─┬ map-visit@1.0.0
  │       │   │ │ └── object-visit@1.0.1 deduped
  │       │   │ └─┬ object-visit@1.0.1
  │       │   │   └── isobject@3.0.1 deduped
  │       │   ├── define-property@2.0.2 extraneous
  │       │   ├── is-number@6.0.0
  │       │   ├── kind-of@6.0.2 extraneous
  │       │   ├── koalas@1.0.2 deduped
  │       │   ├── log-utils@0.2.1 deduped
  │       │   ├── pointer-symbol@1.0.0
  │       │   ├─┬ radio-symbol@2.0.0
  │       │   │ ├── ansi-gray@0.1.1 deduped
  │       │   │ ├── ansi-green@0.1.1 deduped
  │       │   │ └── is-windows@1.0.2 extraneous
  │       │   ├─┬ set-value@3.0.0
  │       │   │ └── is-plain-object@2.0.4 deduped
  │       │   ├── strip-color@0.1.0 deduped
  │       │   ├─┬ terminal-paginator@2.0.2
  │       │   │ ├── debug@2.6.9 deduped
  │       │   │ ├── extend-shallow@2.0.1 deduped
  │       │   │ └── log-utils@0.2.1 deduped
  │       │   └─┬ toggle-array@1.0.1
  │       │     └── isobject@3.0.1 deduped
  │       ├─┬ readline-ui@2.2.3
  │       │ ├── component-emitter@1.2.1 deduped
  │       │ ├── debug@2.6.9 deduped
  │       │ ├── readline-utils@2.2.3 deduped
  │       │ └── string-width@2.1.1 extraneous
  │       ├─┬ readline-utils@2.2.3
  │       │ ├── arr-flatten@1.1.0
  │       │ ├─┬ extend-shallow@2.0.1
  │       │ │ └── is-extendable@0.1.1
  │       │ ├── is-buffer@1.1.6
  │       │ ├── is-number@3.0.0 extraneous
  │       │ ├── is-windows@1.0.2 extraneous
  │       │ ├── koalas@1.0.2 deduped
  │       │ ├── mute-stream@0.0.7
  │       │ ├── strip-color@0.1.0
  │       │ └─┬ window-size@1.1.1
  │       │   ├── define-property@1.0.0 deduped
  │       │   └── is-number@3.0.0 extraneous
  │       └─┬ static-extend@0.1.2
  │         ├── define-property@0.2.5 extraneous
  │         └─┬ object-copy@0.1.0
  │           ├── copy-descriptor@0.1.1
  │           ├── define-property@0.2.5 extraneous
  │           └─┬ kind-of@3.2.2
  │             └── is-buffer@1.1.6 deduped
  └── safe-buffer@5.1.2

Description of the issue:

We have a node in production installed in a location where connectivity is pretty bad.
The application, primarily sending messages (every second) via azure iot sdk (amqp), have been running & working fine for several days but after seeing the error below our application stopped behaving properly and our connecting handler did get into a faulty state due to the exception being thrown.

We're running our own persistence handler and handle connects/disconnects ourselves via subscribing to connected/disconnected/error events.
We're using NoRetry RetryPolicy.

We have a very hard time replicating the error.

Console log of the issue:

Jun  5 12:00:13 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:13.740Z rhea:events [connection-21] Received disposition for outgoing transfers
Jun  5 12:00:13 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:13.741Z rhea:events [connection-21] Link got event: accepted
Jun  5 12:00:13 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:13.741Z azure-iot-amqp-base:SenderLink in sender attached state - accepted event for rheaSender_1ab54b33-e49a-4a4f-a6e4-761da2c651b8
Jun  5 12:00:13 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:13.742Z rhea:events [connection-21] Link got event: settled
Jun  5 12:00:13 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:13.742Z rhea:events [connection-21] Session got event: settled
Jun  5 12:00:13 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:13.742Z rhea:events [connection-21] Connection got event: settled
Jun  5 12:00:13 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:13.742Z rhea:events [b9a304e5-3f28-9d48-a581-6bb72f173e5c] Container got event: settled
Jun  5 12:00:14 MACHINE1 my-application.my-application[5309]: App: DEBUG: [MyApplication.MyService]=>Data submitted: [MASKED]
Jun  5 12:00:14 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:14.313Z azure-iot-device-amqp:Amqp using existing d2c link
Jun  5 12:00:14 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:14.314Z azure-iot-amqp-base:SenderLink placing a message in the unsent message queue.
Jun  5 12:00:14 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:14.314Z azure-iot-amqp-base:SenderLink unsent message queue length is: 1
Jun  5 12:00:14 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:14.315Z rhea:message Encoding section 1 of 4: Typed { type: TypeDesc { name: 'List0', typecode: 69, width: 0, category: 1, create: { [Function] typecode: 69 } }, value: [], descriptor: { [Number: 112] type: TypeDesc { name: 'SmallUlong', typecode: 83, width: 1, category: 1, read: [Function: 
Jun  5 12:00:14 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:14.316Z rhea:message Encoding section 2 of 4: Typed { type: TypeDesc { name: 'List32', typecode: 208, width: 4, category: 3, create: { [Function] typecode: 208 } }, value: [ <2 empty items>, Typed { type: [Object], value: '/devices/[MASKED]/messages/events' } ], descriptor: { [Number: 115]
Jun  5 12:00:14 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:14.317Z rhea:message Encoding section 3 of 4: Typed { type: TypeDesc { name: 'Map32', typecode: 209, width: 4, category: 3, create: { [Function] typecode: 209 } }, value: [ Typed { type: [Object], value: 'id' }, Typed { type: [Object], value: null }, Typed { type: [Object], value: 'PreviousN
Jun  5 12:00:14 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:14.318Z rhea:message Encoding section 4 of 4: Typed { type: TypeDesc { name: 'Vbin8', typecode: 160, width: 1, category: 2, create: { [Function] typecode: 160 } }, value: <Buffer [MASKED]
Jun  5 12:00:14 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:14.318Z rhea:message encoded 200 bytes
Jun  5 12:00:14 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:14.318Z azure-iot-amqp-base:SenderLink message placed in dictionary for lookup later.
Jun  5 12:00:14 MACHINE1 my-application.my-application[5309]: App: DEBUG: [MyApplication.azureIoTEventHub1]=>Event submitted to Azure IoT Hub
Jun  5 12:00:14 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:14.320Z rhea:frames [connection-21]:0 -> transfer#14 {"handle":5,"delivery_id":20367,"delivery_tag":{"type":"Buffer","data":[50,48,51,53,56]}} <Buffer [MASKED]
Jun  5 12:00:14 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:14.321Z rhea:raw [connection-21] SENT: [MASKED]
Jun  5 12:00:14 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:14.620Z rhea:io [connection-21] read 27 bytes
Jun  5 12:00:14 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:14.621Z rhea:io [connection-21] got frame of size 27
Jun  5 12:00:14 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:14.621Z rhea:raw [connection-21] RECV: 27  [MASKED]
Jun  5 12:00:14 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:14.621Z rhea:frames [connection-21]:0 <- disposition#15 {"role":true,"first":20367,"settled":true,"state":[]}
Jun  5 12:00:14 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:14.622Z rhea:events [connection-21] Received disposition for outgoing transfers
Jun  5 12:00:14 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:14.622Z rhea:events [connection-21] Link got event: accepted
Jun  5 12:00:14 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:14.623Z azure-iot-amqp-base:SenderLink in sender attached state - accepted event for rheaSender_1ab54b33-e49a-4a4f-a6e4-761da2c651b8
Jun  5 12:00:14 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:14.623Z rhea:events [connection-21] Link got event: settled
Jun  5 12:00:14 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:14.624Z rhea:events [connection-21] Session got event: settled
Jun  5 12:00:14 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:14.624Z rhea:events [connection-21] Connection got event: settled
Jun  5 12:00:14 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:14.624Z rhea:events [b9a304e5-3f28-9d48-a581-6bb72f173e5c] Container got event: settled
Jun  5 12:00:15 MACHINE1 my-application.my-application[5309]: App: DEBUG: [MyApplication.MyService]=>Data submitted: [MASKED]
Jun  5 12:00:15 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:15.175Z azure-iot-device-amqp:Amqp using existing d2c link
Jun  5 12:00:15 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:15.175Z azure-iot-amqp-base:SenderLink placing a message in the unsent message queue.
Jun  5 12:00:15 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:15.176Z azure-iot-amqp-base:SenderLink unsent message queue length is: 1
Jun  5 12:00:15 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:15.177Z rhea:message Encoding section 1 of 4: Typed { type: TypeDesc { name: 'List0', typecode: 69, width: 0, category: 1, create: { [Function] typecode: 69 } }, value: [], descriptor: { [Number: 112] type: TypeDesc { name: 'SmallUlong', typecode: 83, width: 1, category: 1, read: [Function: 
Jun  5 12:00:15 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:15.178Z rhea:message Encoding section 2 of 4: Typed { type: TypeDesc { name: 'List32', typecode: 208, width: 4, category: 3, create: { [Function] typecode: 208 } }, value: [ <2 empty items>, Typed { type: [Object], value: '/devices/[MASKED]/messages/events' } ], descriptor: { [Number: 115]
Jun  5 12:00:15 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:15.180Z rhea:message Encoding section 3 of 4: Typed { type: TypeDesc { name: 'Map32', typecode: 209, width: 4, category: 3, create: { [Function] typecode: 209 } }, value: [ Typed { type: [Object], value: 'id' }, Typed { type: [Object], value: null }, Typed { type: [Object], value: 'PreviousN
Jun  5 12:00:15 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:15.181Z rhea:message Encoding section 4 of 4: Typed { type: TypeDesc { name: 'Vbin8', typecode: 160, width: 1, category: 2, create: { [Function] typecode: 160 } }, value: <Buffer [MASKED]
Jun  5 12:00:15 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:15.182Z rhea:message encoded 200 bytes
Jun  5 12:00:15 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:15.182Z azure-iot-amqp-base:SenderLink message placed in dictionary for lookup later.
Jun  5 12:00:15 MACHINE1 my-application.my-application[5309]: App: DEBUG: [MyApplication.azureIoTEventHub1]=>Event submitted to Azure IoT Hub
Jun  5 12:00:15 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:15.184Z rhea:frames [connection-21]:0 -> transfer#14 {"handle":5,"delivery_id":20368,"delivery_tag":{"type":"Buffer","data":[50,48,51,53,57]}} <Buffer [MASKED]
Jun  5 12:00:15 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:15.185Z rhea:raw [connection-21] SENT: [MASKED]
Jun  5 12:00:15 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:15.460Z rhea:io [connection-21] read 27 bytes
Jun  5 12:00:15 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:15.460Z rhea:io [connection-21] got frame of size 27
Jun  5 12:00:15 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:15.460Z rhea:raw [connection-21] RECV: 27  [MASKED]
Jun  5 12:00:15 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:15.461Z rhea:frames [connection-21]:0 <- disposition#15 {"role":true,"first":20368,"settled":true,"state":[]}
Jun  5 12:00:15 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:15.462Z rhea:events [connection-21] Received disposition for outgoing transfers
Jun  5 12:00:15 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:15.462Z rhea:events [connection-21] Link got event: accepted
Jun  5 12:00:15 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:15.463Z azure-iot-amqp-base:SenderLink in sender attached state - accepted event for rheaSender_1ab54b33-e49a-4a4f-a6e4-761da2c651b8
Jun  5 12:00:15 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:15.464Z rhea:events [connection-21] Link got event: settled
Jun  5 12:00:15 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:15.464Z rhea:events [connection-21] Session got event: settled
Jun  5 12:00:15 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:15.464Z rhea:events [connection-21] Connection got event: settled
Jun  5 12:00:15 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:15.465Z rhea:events [b9a304e5-3f28-9d48-a581-6bb72f173e5c] Container got event: settled
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: App: DEBUG: [MyApplication.MyService]=>Data submitted: [MASKED]
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.054Z azure-iot-device-amqp:Amqp using existing d2c link
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.054Z azure-iot-amqp-base:SenderLink placing a message in the unsent message queue.
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.054Z azure-iot-amqp-base:SenderLink unsent message queue length is: 1
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.055Z rhea:message Encoding section 1 of 4: Typed { type: TypeDesc { name: 'List0', typecode: 69, width: 0, category: 1, create: { [Function] typecode: 69 } }, value: [], descriptor: { [Number: 112] type: TypeDesc { name: 'SmallUlong', typecode: 83, width: 1, category: 1, read: [Function: 
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.055Z rhea:message Encoding section 2 of 4: Typed { type: TypeDesc { name: 'List32', typecode: 208, width: 4, category: 3, create: { [Function] typecode: 208 } }, value: [ <2 empty items>, Typed { type: [Object], value: '/devices/[MASKED]/messages/events' } ], descriptor: { [Number: 115]
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.055Z rhea:message Encoding section 3 of 4: Typed { type: TypeDesc { name: 'Map32', typecode: 209, width: 4, category: 3, create: { [Function] typecode: 209 } }, value: [ Typed { type: [Object], value: 'id' }, Typed { type: [Object], value: null }, Typed { type: [Object], value: 'PreviousN
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.056Z rhea:message Encoding section 4 of 4: Typed { type: TypeDesc { name: 'Vbin8', typecode: 160, width: 1, category: 2, create: { [Function] typecode: 160 } }, value: <Buffer [MASKED]
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.056Z rhea:message encoded 201 bytes
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.056Z azure-iot-amqp-base:SenderLink message placed in dictionary for lookup later.
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: App: DEBUG: [MyApplication.azureIoTEventHub1]=>Event submitted to Azure IoT Hub
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.057Z rhea:frames [connection-21]:0 -> transfer#14 {"handle":5,"delivery_id":20369,"delivery_tag":{"type":"Buffer","data":[50,48,51,54,48]}} <Buffer [MASKED]
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.057Z rhea:raw [connection-21] SENT: [MASKED]
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.380Z rhea:io [connection-21] read 64 bytes
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.380Z rhea:io [connection-21] got frame of size 64
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.380Z rhea:raw [connection-21] RECV: 64  [MASKED]
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.380Z rhea:frames [connection-21]:0 <- detach#16 {"handle":4,"closed":true,"error":{"condition":"amqp:internal-error","description":"Timeout: 00:01:00"}}
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.390Z rhea:events [connection-21] Link got event: receiver_error
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.421Z azure-iot-amqp-base:ReceiverLink in receiver attached state - error event for rheaReceiver_052de9ea-3c42-4da8-a84f-89782782de40 error is: (amqp error) amqp:internal-error
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.421Z rhea:events [connection-21] Link got event: receiver_close
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.422Z azure-iot-amqp-base:ReceiverLink in receiver attached state - close event for rheaReceiver_052de9ea-3c42-4da8-a84f-89782782de40 already indicated error is: (amqp error) amqp:internal-error
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.423Z azure-iot-amqp-base:Amqp azure-iot-amqp-base:error-indicated invoked (amqp error) amqp:internal-error
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.423Z azure-iot-amqp-base:Amqp connected -> disconnecting (action:connected.amqpError)
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.423Z azure-iot-amqp-base:Amqp Entering disconnecting state with disconnectCallback: null error of: (amqp error) amqp:internal-error
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.424Z azure-iot-amqp-base:Amqp cleanly detaching link
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.424Z azure-iot-amqp-base:CBS while attached - detach for CBS links [object Object] [object Object]
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.425Z azure-iot-amqp-base:CBS while detaching for link
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.426Z azure-iot-amqp-base:SenderLink while attached - detach for receiver link $cbs callback: function () {
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         if (fn === null) throw new Error("Callback was already called.");
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         var callFn = fn;
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         fn = null;
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         callFn.apply(this, arguments);
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:     } error: error is falsy
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.426Z azure-iot-amqp-base:SenderLink attached -> detaching (action:attached.detach)
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.427Z azure-iot-amqp-base:SenderLink Detaching of rhea sender link $cbs
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.427Z azure-iot-amqp-base:CBS while detaching for link
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.428Z azure-iot-amqp-base:ReceiverLink while attached - detach for receiver link $cbs callback: function () {
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         if (fn === null) throw new Error("Callback was already called.");
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         var callFn = fn;
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         fn = null;
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         callFn.apply(this, arguments);
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:     } error: error is falsy
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.428Z azure-iot-amqp-base:ReceiverLink attached -> detaching (action:attached.detach)
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.429Z azure-iot-amqp-base:ReceiverLink Detaching of rhea receiver link $cbs
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.431Z rhea:frames [connection-21]:0 -> detach#16 {"closed":true}
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.432Z rhea:raw [connection-21] SENT: [MASKED]
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.433Z rhea:frames [connection-21]:0 -> detach#16 {"handle":1,"closed":true}
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.434Z rhea:raw [connection-21] SENT: [MASKED]
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.436Z rhea:frames [connection-21]:0 -> detach#16 {"handle":4,"closed":true}
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.436Z rhea:raw [connection-21] SENT: [MASKED]
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.438Z rhea:io [connection-21] read 64 bytes
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.439Z rhea:io [connection-21] got frame of size 64
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.439Z rhea:raw [connection-21] RECV: 64  [MASKED]
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.439Z rhea:frames [connection-21]:0 <- detach#16 {"handle":3,"closed":true,"error":{"condition":"amqp:internal-error","description":"Timeout: 00:01:00"}}
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.440Z rhea:events [connection-21] Link got event: sender_error
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.440Z azure-iot-amqp-base:SenderLink handling error event: (amqp error) amqp:internal-error
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.441Z azure-iot-amqp-base:SenderLink in sender attached state - error event for rheaSender_c7efe8c4-ad1d-49da-a8ac-a63de481a3bb error is: (amqp error) amqp:internal-error
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.441Z rhea:events [connection-21] Link got event: sender_close
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.442Z azure-iot-amqp-base:SenderLink in sender attached state - close event for rheaSender_c7efe8c4-ad1d-49da-a8ac-a63de481a3bb already indicated error is: (amqp error) amqp:internal-error
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.442Z azure-iot-amqp-base:Amqp azure-iot-amqp-base:error-indicated invoked (amqp error) amqp:internal-error
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.442Z azure-iot-amqp-base:Amqp ignoring error event while disconnecting: (amqp error) amqp:internal-error
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.444Z rhea:frames [connection-21]:0 -> detach#16 {"handle":3,"closed":true}
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.444Z rhea:raw [connection-21] SENT: [MASKED]
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.445Z rhea:io [connection-21] read 27 bytes
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.445Z rhea:io [connection-21] got frame of size 27
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.445Z rhea:raw [connection-21] RECV: 27  [MASKED]
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.445Z rhea:frames [connection-21]:0 <- disposition#15 {"role":true,"first":20369,"settled":true,"state":[]}
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.446Z rhea:events [connection-21] Received disposition for outgoing transfers
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.446Z rhea:events [connection-21] Link got event: accepted
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.446Z azure-iot-amqp-base:SenderLink in sender attached state - accepted event for rheaSender_1ab54b33-e49a-4a4f-a6e4-761da2c651b8
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.446Z rhea:events [connection-21] Link got event: settled
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.446Z rhea:events [connection-21] Session got event: settled
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.447Z rhea:events [connection-21] Connection got event: settled
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.447Z rhea:events [b9a304e5-3f28-9d48-a581-6bb72f173e5c] Container got event: settled
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.702Z rhea:io [connection-21] read 17 bytes
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.702Z rhea:io [connection-21] got frame of size 17
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.702Z rhea:raw [connection-21] RECV: 17  [MASKED]
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.702Z rhea:frames [connection-21]:0 <- detach#16 {"closed":true}
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.703Z rhea:events [connection-21] Link got event: sender_close
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.704Z azure-iot-amqp-base:SenderLink in sender detaching state - close event for rheaSender_70aa1cdc-f2f8-448c-b0dd-a4785912c4cb already indicated error is: error is falsy
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.704Z azure-iot-amqp-base:SenderLink detaching -> detached (action:detaching.senderCloseEvent)
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.704Z azure-iot-amqp-base:SenderLink link detached: $cbs
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.704Z azure-iot-amqp-base:SenderLink unsent message queue length: 0
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: App: DEBUG: [MyApplication.MyService]=>Data submitted: [MASKED]
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.932Z azure-iot-device-amqp:Amqp using existing d2c link
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.932Z azure-iot-amqp-base:SenderLink placing a message in the unsent message queue.
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.932Z azure-iot-amqp-base:SenderLink unsent message queue length is: 1
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.932Z rhea:message Encoding section 1 of 4: Typed { type: TypeDesc { name: 'List0', typecode: 69, width: 0, category: 1, create: { [Function] typecode: 69 } }, value: [], descriptor: { [Number: 112] type: TypeDesc { name: 'SmallUlong', typecode: 83, width: 1, category: 1, read: [Function: 
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.933Z rhea:message Encoding section 2 of 4: Typed { type: TypeDesc { name: 'List32', typecode: 208, width: 4, category: 3, create: { [Function] typecode: 208 } }, value: [ <2 empty items>, Typed { type: [Object], value: '/devices/[MASKED]/messages/events' } ], descriptor: { [Number: 115]
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.935Z rhea:message Encoding section 3 of 4: Typed { type: TypeDesc { name: 'Map32', typecode: 209, width: 4, category: 3, create: { [Function] typecode: 209 } }, value: [ Typed { type: [Object], value: 'id' }, Typed { type: [Object], value: null }, Typed { type: [Object], value: 'PreviousN
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.935Z rhea:message Encoding section 4 of 4: Typed { type: TypeDesc { name: 'Vbin8', typecode: 160, width: 1, category: 2, create: { [Function] typecode: 160 } }, value: <Buffer [MASKED]
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.936Z rhea:message encoded 201 bytes
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.936Z azure-iot-amqp-base:SenderLink message placed in dictionary for lookup later.
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: App: DEBUG: [MyApplication.azureIoTEventHub1]=>Event submitted to Azure IoT Hub
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.938Z rhea:frames [connection-21]:0 -> transfer#14 {"handle":5,"delivery_id":20370,"delivery_tag":{"type":"Buffer","data":[50,48,51,54,49]}} <Buffer [MASKED]
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.938Z rhea:raw [connection-21] SENT: [MASKED]
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.960Z rhea:io [connection-21] read 18 bytes
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.960Z rhea:io [connection-21] got frame of size 18
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.960Z rhea:raw [connection-21] RECV: 18  [MASKED]
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.961Z rhea:frames [connection-21]:0 <- detach#16 {"handle":1,"closed":true}
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.961Z rhea:events [connection-21] Link got event: receiver_close
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.962Z azure-iot-amqp-base:ReceiverLink in receiver detaching state - close event for rheaReceiver_312ad991-c823-427d-ab4d-e09a82da3618 already indicated error is: error is falsy
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.962Z azure-iot-amqp-base:ReceiverLink detaching -> detached (action:detaching.receiverCloseEvent)
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.963Z azure-iot-amqp-base:Amqp cleanly detaching link
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.963Z azure-iot-amqp-base:SenderLink while attached - detach for receiver link /devices/[MASKED]/twin callback: function () {
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         if (fn === null) throw new Error("Callback was already called.");
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         var callFn = fn;
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         fn = null;
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         callFn.apply(this, arguments);
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:     } error: (amqp error) amqp:internal-error
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.964Z azure-iot-amqp-base:SenderLink attached -> detaching (action:attached.detach)
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.964Z azure-iot-amqp-base:SenderLink Detaching of rhea sender link /devices/[MASKED]/twin
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.964Z azure-iot-amqp-base:SenderLink detaching -> detached (action:attached.detach)
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.964Z azure-iot-amqp-base:SenderLink link detached: /devices/[MASKED]/twin
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.964Z azure-iot-amqp-base:SenderLink unsent message queue length: 0
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.965Z azure-iot-amqp-base:Amqp cleanly detaching link
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.965Z azure-iot-amqp-base:SenderLink while attached - detach for receiver link /devices/[MASKED]/messages/events callback: function () {
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         if (fn === null) throw new Error("Callback was already called.");
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         var callFn = fn;
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         fn = null;
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         callFn.apply(this, arguments);
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:     } error: (amqp error) amqp:internal-error
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.964Z azure-iot-amqp-base:SenderLink attached -> detaching (action:attached.detach)
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.964Z azure-iot-amqp-base:SenderLink Detaching of rhea sender link /devices/[MASKED]/twin
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.964Z azure-iot-amqp-base:SenderLink detaching -> detached (action:attached.detach)
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.964Z azure-iot-amqp-base:SenderLink link detached: /devices/[MASKED]/twin
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.964Z azure-iot-amqp-base:SenderLink unsent message queue length: 0
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.965Z azure-iot-amqp-base:Amqp cleanly detaching link
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.965Z azure-iot-amqp-base:SenderLink while attached - detach for receiver link /devices/[MASKED]/messages/events callback: function () {
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         if (fn === null) throw new Error("Callback was already called.");
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         var callFn = fn;
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         fn = null;
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         callFn.apply(this, arguments);
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:     } error: (amqp error) amqp:internal-error
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.965Z azure-iot-amqp-base:SenderLink attached -> detaching (action:attached.detach)
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.965Z azure-iot-amqp-base:SenderLink Detaching of rhea sender link /devices/[MASKED]/messages/events
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.965Z azure-iot-amqp-base:Amqp cleanly detaching link
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.966Z azure-iot-amqp-base:ReceiverLink while attached - detach for receiver link /devices/[MASKED]/messages/devicebound callback: function () {
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         if (fn === null) throw new Error("Callback was already called.");
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         var callFn = fn;
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         fn = null;
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         callFn.apply(this, arguments);
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:     } error: (amqp error) amqp:internal-error
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.966Z azure-iot-amqp-base:ReceiverLink attached -> detaching (action:attached.detach)
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.966Z azure-iot-amqp-base:ReceiverLink Detaching of rhea receiver link /devices/[MASKED]/messages/devicebound
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.966Z azure-iot-amqp-base:Amqp cleanly detaching link
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.966Z azure-iot-amqp-base:ReceiverLink while attached - detach for receiver link /devices/[MASKED]/twin callback: function () {
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         if (fn === null) throw new Error("Callback was already called.");
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         var callFn = fn;
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         fn = null;
Jun  5 12:00:16 MACHINE1 my-application.my-application[5309]:         callFn.apply(this, arguments);
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]:     } error: (amqp error) amqp:internal-error
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.967Z azure-iot-amqp-base:ReceiverLink attached -> detaching (action:attached.detach)
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.967Z azure-iot-amqp-base:ReceiverLink Detaching of rhea receiver link /devices/[MASKED]/twin
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.967Z azure-iot-amqp-base:ReceiverLink detaching -> detached (action:attached.detach)
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.967Z rhea:frames [connection-21]:0 -> detach#16 {"handle":2,"closed":true}
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.968Z rhea:raw [connection-21] SENT: [MASKED]
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.968Z rhea:frames [connection-21]:0 -> detach#16 {"handle":5,"closed":true}
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.968Z rhea:raw [connection-21] SENT: [MASKED]
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.969Z rhea:frames [connection-21]:0 -> end#17 {}
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:16.969Z rhea:raw [connection-21] SENT: [MASKED]
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.279Z rhea:io [connection-21] read 27 bytes
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.279Z rhea:io [connection-21] got frame of size 27
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.279Z rhea:raw [connection-21] RECV: 27  [MASKED]
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.279Z rhea:frames [connection-21]:0 <- disposition#15 {"role":true,"first":20370,"settled":true,"state":[]}
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.279Z rhea:events [connection-21] Received disposition for outgoing transfers
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.280Z rhea:events [connection-21] Link got event: accepted
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.283Z azure-iot-amqp-base:SenderLink in sender detaching state - accepted event for rheaSender_1ab54b33-e49a-4a4f-a6e4-761da2c651b8
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.283Z rhea:events [connection-21] Link got event: settled
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.284Z rhea:events [connection-21] Session got event: settled
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.284Z rhea:events [connection-21] Connection got event: settled
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.284Z rhea:events [b9a304e5-3f28-9d48-a581-6bb72f173e5c] Container got event: settled
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.560Z rhea:io [connection-21] read 18 bytes
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.560Z rhea:io [connection-21] got frame of size 18
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.560Z rhea:raw [connection-21] RECV: 18  [MASKED]
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.561Z rhea:frames [connection-21]:0 <- detach#16 {"handle":2,"closed":true}
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.561Z rhea:events [connection-21] Link got event: receiver_close
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.562Z azure-iot-amqp-base:ReceiverLink in receiver detaching state - close event for rheaReceiver_a746b298-4ea2-4208-9d1c-fa8df177762f already indicated error is: (amqp error) amqp:internal-error
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.562Z azure-iot-amqp-base:ReceiverLink detaching -> detached (action:detaching.receiverCloseEvent)
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.580Z rhea:io [connection-21] read 18 bytes
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.580Z rhea:io [connection-21] got frame of size 18
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.580Z rhea:raw [connection-21] RECV: 18  [MASKED]
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.581Z rhea:frames [connection-21]:0 <- detach#16 {"handle":5,"closed":true}
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.581Z rhea:events [connection-21] Link got event: sender_close
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.581Z azure-iot-amqp-base:SenderLink in sender detaching state - close event for rheaSender_1ab54b33-e49a-4a4f-a6e4-761da2c651b8 already indicated error is: (amqp error) amqp:internal-error
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.582Z azure-iot-amqp-base:SenderLink detaching -> detached (action:detaching.senderCloseEvent)
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.582Z azure-iot-amqp-base:SenderLink link detached: /devices/[MASKED]/messages/events
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.582Z azure-iot-amqp-base:SenderLink unsent message queue length: 0
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.582Z rhea:io [connection-21] read 15 bytes
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.582Z rhea:io [connection-21] got frame of size 15
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.583Z rhea:raw [connection-21] RECV: 15  [MASKED]
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.583Z rhea:frames [connection-21]:0 <- end#17 {}
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.584Z rhea:events [connection-21] Session got event: session_close
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.584Z azure-iot-amqp-base:Amqp session close event handler
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.585Z azure-iot-amqp-base:Amqp entering disconnect function of disconnecting state
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.585Z azure-iot-amqp-base:Amqp with a disconnecting state err: (amqp error) amqp:internal-error
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.585Z azure-iot-amqp-base:Amqp disconnect in disconnecting state is about send a close to the peer.
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.587Z rhea:frames [connection-21]:0 -> close#18 {}
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.588Z rhea:raw [connection-21] SENT: [MASKED]
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: App: DEBUG: [MyApplication.MyService]=>Data submitted: [MASKED]
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.811Z azure-iot-device-amqp:Amqp using existing d2c link
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.814Z azure-iot-amqp-base:SenderLink placing a message in the unsent message queue.
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.818Z azure-iot-amqp-base:SenderLink detached -> attaching (action:detached.attach)
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.818Z azure-iot-amqp-base:SenderLink attaching sender name: rheaSender_c366f16d-ae38-49dd-a6ee-3ce4c340371c with address: /devices/[MASKED]/messages/events
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: App: DEBUG: [MyApplication.azureIoTEventHub1]=>Event submitted to Azure IoT Hub
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.860Z rhea:io [connection-21] read 15 bytes
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.861Z rhea:io [connection-21] got frame of size 15
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.861Z rhea:raw [connection-21] RECV: 15  [MASKED]
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.861Z rhea:frames [connection-21]:0 <- close#18 {}
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.862Z rhea:events [connection-21] Connection got event: connection_close
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.862Z azure-iot-amqp-base:Amqp connection close event handler
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.863Z azure-iot-amqp-base:Amqp disconnecting -> disconnected (action:disconnecting.connection_close)
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.863Z azure-iot-amqp-base:Amqp calling upper layer disconnect handler
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.863Z azure-iot-amqp-base:Amqp error passed to disconnect handler is: (amqp error) amqp:internal-error
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.863Z azure-iot-device-amqp:Amqp disconnected event handler: [object Object]
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.864Z azure-iot-device-amqp:Amqp authenticated -> disconnecting (authenticated.amqpConnectionClosed)
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.864Z azure-iot-device-amqp:Amqp force-detaching device methods links
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.866Z azure-iot-amqp-base:ReceiverLink while detached - detach for receiver link /devices/[MASKED]/twin
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.866Z azure-iot-device-amqp:Amqp device twin links detached
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.867Z azure-iot-amqp-base:SenderLink Force detaching while attaching of rhea sender link /devices/[MASKED]/messages/events
Jun  5 12:00:18 MACHINE1 my-application.my-application[5309]: App: Uncaught exception: TypeError: attachingCallback is not a function
Jun  5 12:00:18 MACHINE1 my-application.my-application[5309]: App: Stack: TypeError: attachingCallback is not a function
Jun  5 12:00:18 MACHINE1 my-application.my-application[5309]:     at constructor.forceDetach (/root/snap/my-application/43/node_modules/azure-iot-device-amqp/node_modules/azure-iot-amqp-base/lib/sender_link.js:217:25)
Jun  5 12:00:18 MACHINE1 my-application.my-application[5309]:     at constructor.handle (/root/snap/my-application/43/node_modules/machina/lib/machina.js:613:25)
Jun  5 12:00:18 MACHINE1 my-application.my-application[5309]:     at constructor.Fsm.(anonymous function) [as handle] (/root/snap/my-application/43/node_modules/machina/lib/machina.js:466:63)
Jun  5 12:00:18 MACHINE1 my-application.my-application[5309]:     at SenderLink.forceDetach (/root/snap/my-application/43/node_modules/azure-iot-device-amqp/node_modules/azure-iot-amqp-base/lib/sender_link.js:413:19)
Jun  5 12:00:18 MACHINE1 my-application.my-application[5309]:     at /root/snap/my-application/43/node_modules/azure-iot-device-amqp/lib/amqp.js:476:54
Jun  5 12:00:18 MACHINE1 my-application.my-application[5309]:     at /root/snap/my-application/43/node_modules/azure-iot-device-amqp/node_modules/async/dist/async.js:3880:24
Jun  5 12:00:18 MACHINE1 my-application.my-application[5309]:     at replenish (/root/snap/my-application/43/node_modules/azure-iot-device-amqp/node_modules/async/dist/async.js:1011:17)
Jun  5 12:00:18 MACHINE1 my-application.my-application[5309]:     at iterateeCallback (/root/snap/my-application/43/node_modules/azure-iot-device-amqp/node_modules/async/dist/async.js:995:17)
Jun  5 12:00:18 MACHINE1 my-application.my-application[5309]:     at /root/snap/my-application/43/node_modules/azure-iot-device-amqp/node_modules/async/dist/async.js:969:16
Jun  5 12:00:18 MACHINE1 my-application.my-application[5309]:     at /root/snap/my-application/43/node_modules/azure-iot-device-amqp/node_modules/async/dist/async.js:3885:13

[No communication with Azure IoT SDK/Hub after this point]
@wmmihaa
Copy link
Contributor

wmmihaa commented Jun 14, 2019

@anthonyvercolano Stefan works on my team, so this likely relates to previous issues. We see it less often, but we do still see the same behavior.

@pierreca
Copy link
Contributor

This is a bug in our code.
This happens while a disconnection from the service is being processed:

Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.585Z azure-iot-amqp-base:Amqp with a disconnecting state err: (amqp error) amqp:internal-error
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.585Z azure-iot-amqp-base:Amqp disconnect in disconnecting state is about send a close to the peer.
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.587Z rhea:frames [connection-21]:0 -> close#18 {}
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.588Z rhea:raw [connection-21] SENT: [MASKED]

At this point, the application hasn't been notified of the disconnection yet, and it enqueues a message:

Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: App: DEBUG: [MyApplication.MyService]=>Data submitted: [MASKED]

Given there is still a sender link, a message is enqueued, but the link is detached so the SDK tries to attach it:

Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.814Z azure-iot-amqp-base:SenderLink placing a message in the unsent message queue.
Jun  5 12:00:17 MACHINE1 my-application.my-application[5309]: 2019-06-05T12:00:17.818Z azure-iot-amqp-base:SenderLink detached -> attaching (action:detached.attach)

At this point, the SDK puts the message in the queue and transitions to the "attaching" without passing a callback when attaching is finished (it assumes that it'll either succeed and go to "attached" or fail and go to "detached" and in both cases the enqueued message callback would be processed:
https://github.com/Azure/azure-iot-sdk-node/blob/master/common/transport/amqp/src/sender_link.ts#L193

At this point, the code that processes the disconnection catches up with the fact that there is an attaching link that needs to be "forceDetached" and the problem is that the "forceDetach" handler assumes that if we're in in the attaching state, there will be a callback... and tries to call it:
https://github.com/Azure/azure-iot-sdk-node/blob/master/common/transport/amqp/src/sender_link.ts#L278

except that like i said.. because attach was triggered by a message being enqueued, there is no callback, and therefore the code crashes with a TypeError

I'm not sure what the right fix is yet but this is definitely on us and will get fixed. additional updates coming soon.

@wmmihaa
Copy link
Contributor

wmmihaa commented Jun 26, 2019

Thanks you @pierreca
Let us know if we can help out investigating the issue.

@az-iot-builder-01
Copy link
Collaborator

@stefannilsson, thank you for your contribution to our open-sourced project! Please help us improve by filling out this 2-minute customer satisfaction survey

@pierreca pierreca self-assigned this Jun 28, 2019
@pierreca
Copy link
Contributor

reopening until it's released in a package.

@pierreca pierreca reopened this Jun 28, 2019
@stefannilsson
Copy link
Author

Any updates on release?

@YoDaMa
Copy link
Contributor

YoDaMa commented Jul 15, 2019

@stefannilsson we are closing in on resolving a bug (not related to this one), and once that is done will put out a new release.

@YoDaMa
Copy link
Contributor

YoDaMa commented Jul 17, 2019

Release 2019-07-17 includes this bugfix. @stefannilsson

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
6 participants