Skip to content
This repository has been archived by the owner on Dec 11, 2019. It is now read-only.

[snips-asr][Android][lang-en] Entity injection does not work for english language #114

Closed
mark922 opened this issue Apr 5, 2019 · 13 comments
Closed

[snips-asr][Android][lang-en] Entity injection does not work for english language #114

mark922 opened this issue Apr 5, 2019 · 13 comments
Assignees
@fredszaq @cpoisson @Garvys
Labels
sub: asr Related to speech recognition type: bug Not working as expected
Milestone
Snips Flow - Next

Comments

@mark922
Copy link

mark922 commented Apr 5, 2019 •
edited by cpoisson
Loading

What's the issue?
Add dynamic vocabulary on android platform.

How to reproduce
HashMap<String, List<String>> values = new HashMap<>(); values.put("city_name", Arrays.asList("London", "Paris", "Istanbul")); InjectionOperation op = new InjectionOperation(AddFromVanilla, values); client.requestInjection(new InjectionRequestMessage( singletonList(op), Collections.<String, List<String>>emptyMap(), null, null));

Expected behavior
It is not recognizing the newly added words like London, Istanbul etc...

Version and Environment
Platform: Android
Version: ai.snips:snips-platform-android:0.62.3@aar

Logs

04-06 01:37:08.382 28798-28798/in.example.voiceremotedemo D/Surface: Surface::allocateBuffers(this=0x98b54800)
04-06 01:37:08.401 28798-28914/in.example.voiceremotedemo D/GraphicBuffer: register, handle(0x95bfe5c0) (w:244 h:95 s:256 f:0x1 u:b00)
04-06 01:37:10.336 28798-28914/in.example.voiceremotedemo D/Surface: Surface::disconnect(this=0x98b54800,api=1)
04-06 01:37:10.337 28798-28914/in.example.voiceremotedemo D/GraphicBuffer: unregister, handle(0x88cc3a80) (w:244 h:95 s:256 f:0x1 u:b00)
04-06 01:37:10.339 28798-28798/in.example.voiceremotedemo D/View: [Warning] assignParent to null: this = android.widget.LinearLayout{ac46870 V.E...... ......ID 0,0-244,95}
04-06 01:37:18.302 28798-28798/in.example.voiceremotedemo D/ViewRootImpl[Toast]: hardware acceleration = true , fakeHwAccelerated = false, sRendererDisabled = false, forceHwAccelerated = false, sSystemRendererDisabled = false
04-06 01:37:18.303 28798-28798/in.example.voiceremotedemo W/voiceremotedemo: type=1400 audit(0.0:11152): avc: denied { read } for name="u:object_r:graphics_config_prop:s0" dev="tmpfs" ino=7249 scontext=u:r:untrusted_app:s0:c512,c768 tcontext=u:object_r:graphics_config_prop:s0 tclass=file permissive=0
04-06 01:37:18.314 28798-28798/in.example.voiceremotedemo E/libc: Access denied finding property "ro.sf.lcd_density"
04-06 01:37:18.314 28798-28798/in.example.voiceremotedemo E/InputTransport: ro.sf.lcd_density must be defined as a build property
04-06 01:37:18.315 28798-28798/in.example.voiceremotedemo I/Toast: Show toast from OpPackageName:in.example.voiceremotedemo, PackageName:in.example.voiceremotedemo
04-06 01:37:18.343 28798-28914/in.example.voiceremotedemo D/Surface: Surface::connect(this=0x98b54800,api=1)
04-06 01:37:18.343 28798-28798/in.example.voiceremotedemo D/Surface: Surface::allocateBuffers(this=0x98b54800)
@mark922 mark922 added the type: bug Not working as expected label Apr 5, 2019
@cpoisson cpoisson added the sub: asr Related to speech recognition label Apr 8, 2019
@cpoisson cpoisson assigned Garvys, fredszaq and cpoisson and unassigned fredszaq and cpoisson Apr 8, 2019
@cpoisson cpoisson added platform type: support Support issue ( should not exist in this project ;) labels Apr 8, 2019
@fredszaq
Copy link

fredszaq commented Apr 8, 2019

Hi!

Could you please post the logs of the process in.example.voiceremotedemo:snipsProcessingService ? it should contain more useful information

@mark922
Copy link
Author

mark922 commented Apr 8, 2019 

04-08 17:52:12.787 8636-8667/in.example.voiceremotedemo:snipsProcessingService D/tract_core::analyser: Starting step for #253 wavenet_2/mul_20 (Mul::Binary)
    Starting step for #254 wavenet_2/dilation_layer_20-dilation_rate_1-1x1_conv_skip-conv1d/conv1d/Conv2D (MatMulUnaryImplASimpleB)
    Starting step for #255 wavenet_2/strided_slice_44 (Identity)
    Starting step for #256 wavenet_2/dilation_layer_20-dilation_rate_1-1x1_conv_transform-conv1d/conv1d/Conv2D (MatMulUnaryImplASimpleB)
    Starting step for #257 wavenet_2/strided_slice_20 (Identity)
    Starting step for #258 wavenet_2/add_20 (Add::Binary)
    Starting step for #259 wavenet_2/dilation_layer_21-dilation_rate_2-filter-conv1d/conv1d/Conv2D#0 (Delay)
    Starting step for #260 wavenet_2/dilation_layer_21-dilation_rate_2-filter-conv1d/conv1d/Conv2D-1 (Im2col)
     Refined wavenet_2/dilation_layer_21-dilation_rate_2-filter-conv1d/conv1d/Conv2D-1 input #0 to Tensor, F32, shape=[384]
    Starting step for #261 wavenet_2/dilation_layer_21-dilation_rate_2-filter-conv1d/conv1d/Conv2D (ConvGemm)
    Starting step for #262 wavenet_2/dilation_layer_21-dilation_rate_2-filter-conv1d/Tanh (Tanh)
    Starting step for #263 wavenet_2/dilation_layer_21-dilation_rate_2-gate-conv1d/conv1d/Conv2D (ConvGemm)
    Starting step for #264 wavenet_2/dilation_layer_21-dilation_rate_2-gate-conv1d/Sigmoid (Sigmoid)
04-08 17:52:12.788 8636-8667/in.example.voiceremotedemo:snipsProcessingService D/tract_core::analyser: Starting step for #265 wavenet_2/mul_21 (Mul::Binary)
    Starting step for #266 wavenet_2/dilation_layer_21-dilation_rate_2-1x1_conv_skip-conv1d/conv1d/Conv2D (MatMulUnaryImplASimpleB)
    Starting step for #267 wavenet_2/strided_slice_45 (Identity)
    Starting step for #268 wavenet_2/dilation_layer_21-dilation_rate_2-1x1_conv_transform-conv1d/conv1d/Conv2D (MatMulUnaryImplASimpleB)
    Starting step for #269 wavenet_2/strided_slice_21 (Identity)
    Starting step for #270 wavenet_2/add_21 (Add::Binary)
    Starting step for #271 wavenet_2/dilation_layer_22-dilation_rate_4-filter-conv1d/conv1d/Conv2D#0 (Delay)
    Starting step for #272 wavenet_2/dilation_layer_22-dilation_rate_4-filter-conv1d/conv1d/Conv2D-1 (Im2col)
     Refined wavenet_2/dilation_layer_22-dilation_rate_4-filter-conv1d/conv1d/Conv2D-1 input #0 to Tensor, F32, shape=[384]
    Starting step for #273 wavenet_2/dilation_layer_22-dilation_rate_4-filter-conv1d/conv1d/Conv2D (ConvGemm)
    Starting step for #274 wavenet_2/dilation_layer_22-dilation_rate_4-filter-conv1d/Tanh (Tanh)
    Starting step for #275 wavenet_2/dilation_layer_22-dilation_rate_4-gate-conv1d/conv1d/Conv2D (ConvGemm)
    Starting step for #276 wavenet_2/dilation_layer_22-dilation_rate_4-gate-conv1d/Sigmoid (Sigmoid)
    Starting step for #277 wavenet_2/mul_22 (Mul::Binary)
    Starting step for #278 wavenet_2/dilation_layer_22-dilation_rate_4-1x1_conv_skip-conv1d/conv1d/Conv2D (MatMulUnaryImplASimpleB)
    Starting step for #279 wavenet_2/strided_slice_46 (Identity)
    Starting step for #280 wavenet_2/dilation_layer_22-dilation_rate_4-1x1_conv_transform-conv1d/conv1d/Conv2D (MatMulUnaryImplASimpleB)
    Starting step for #281 wavenet_2/strided_slice_22 (Identity)
    Starting step for #282 wavenet_2/add_22 (Add::Binary)
    Starting step for #283 wavenet_2/dilation_layer_23-dilation_rate_8-filter-conv1d/conv1d/Conv2D#0 (Delay)
    Starting step for #284 wavenet_2/dilation_layer_23-dilation_rate_8-filter-conv1d/conv1d/Conv2D-1 (Im2col)
04-08 17:52:12.789 8636-8667/in.example.voiceremotedemo:snipsProcessingService D/tract_core::analyser:  Refined wavenet_2/dilation_layer_23-dilation_rate_8-filter-conv1d/conv1d/Conv2D-1 input #0 to Tensor, F32, shape=[384]
    Starting step for #285 wavenet_2/dilation_layer_23-dilation_rate_8-filter-conv1d/conv1d/Conv2D (ConvGemm)
    Starting step for #286 wavenet_2/dilation_layer_23-dilation_rate_8-filter-conv1d/Tanh (Tanh)
    Starting step for #287 wavenet_2/dilation_layer_23-dilation_rate_8-gate-conv1d/conv1d/Conv2D (ConvGemm)
    Starting step for #288 wavenet_2/dilation_layer_23-dilation_rate_8-gate-conv1d/Sigmoid (Sigmoid)
    Starting step for #289 wavenet_2/mul_23 (Mul::Binary)
    Starting step for #290 wavenet_2/dilation_layer_23-dilation_rate_8-1x1_conv_skip-conv1d/conv1d/Conv2D (MatMulUnaryImplASimpleB)
    Starting step for #291 wavenet_2/strided_slice_47 (Identity)
    Starting step for #292 wavenet_2/AddN (AddN)
04-08 17:52:12.790 8636-8667/in.example.voiceremotedemo:snipsProcessingService D/tract_core::analyser: Starting step for #293 wavenet_2/Relu (Relu)
    Starting step for #294 wavenet_2/post_proc_1-1x1_conv-conv1d/conv1d/Conv2D (MatMulUnaryImplASimpleB)
    Starting step for #295 wavenet_2/post_proc_1-1x1_conv-conv1d/Relu (Relu)
    Starting step for #296 wavenet_2/post_proc_2-1x1_conv-conv1d/conv1d/Conv2D (MatMulUnaryImplASimpleB)
    Starting step for #297 output_node (RmDims)
04-08 17:52:12.859 8636-8667/in.example.voiceremotedemo:snipsProcessingService I/snips_megazord: Starting Hotword
04-08 17:52:12.859 8636-8667/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Subscribing on Hotword/IdentifiableToggleableToggleOn<T>
    Subscribing on Hotword/IdentifiableToggleableToggleOff<T>
04-08 17:52:12.859 8636-8667/in.example.voiceremotedemo:snipsProcessingService D/snips_hotword_lib: attempt to start detector for default and hey_snips
04-08 17:52:12.859 8636-8681/in.example.voiceremotedemo:snipsProcessingService I/snips_hotword_lib::au..: Audio thread for default started
04-08 17:52:12.860 8636-8682/in.example.voiceremotedemo:snipsProcessingService I/snips_hotword_lib::au..: Net and VAD thread for site default started (vad inhibitor: false, vad messages: false
04-08 17:52:12.869 8636-8667/in.example.voiceremotedemo:snipsProcessingService I/snips_hotword_lib: Detector "detector.hey_snips.default", sensitivity: 0.5, threshold 0.787
04-08 17:52:12.869 8636-8667/in.example.voiceremotedemo:snipsProcessingService I/snips_megazord: Starting ASR
04-08 17:52:12.869 8636-8667/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Subscribing on Asr/AsrStartListening
04-08 17:52:12.869 8636-8683/in.example.voiceremotedemo:snipsProcessingService I/snips_hotword_lib: detector.hey_snips.default thread started
04-08 17:52:12.869 8636-8667/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Subscribing on Asr/AsrStopListening
    Subscribing on Asr/AsrReload
    Subscribing on Asr/ToggleableToggleOn<T>
    Subscribing on Asr/ToggleableToggleOff<T>
04-08 17:52:12.869 8636-8667/in.example.voiceremotedemo:snipsProcessingService I/snips_megazord: Starting NLU
04-08 17:52:12.869 8636-8667/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Subscribing on Nlu/NluQuery
    Subscribing on Nlu/NluPartialQuery
    Subscribing on Nlu/ComponentVersionRequest<T>
    Subscribing on Nlu/NluReload
04-08 17:52:12.869 8636-8667/in.example.voiceremotedemo:snipsProcessingService I/snips_megazord: Starting Dialogue
04-08 17:52:12.869 8636-8667/in.example.voiceremotedemo:snipsProcessingService I/snips_dialogue_hermes: Loading the configuration file
04-08 17:52:12.869 8636-8685/in.example.voiceremotedemo:snipsProcessingService D/snips_nlu_hermes: nlu thread started
04-08 17:52:12.869 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_asr_hermes: Asr main thread started
04-08 17:52:12.869 8636-8685/in.example.voiceremotedemo:snipsProcessingService D/snips_injection_lib::..: computing injections dirname from reference dir "/data/user/0/in.example.voiceremotedemo/files/snips/assistant"
04-08 17:52:12.869 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_injection_lib::..: computing injections dirname from reference dir "/data/user/0/in.example.voiceremotedemo/files/snips/assistant"
04-08 17:52:12.869 8636-8685/in.example.voiceremotedemo:snipsProcessingService I/snips_nlu_hermes: loading nlu engine "/data/user/0/in.example.voiceremotedemo/files/snips/assistant/nlu_engine"
04-08 17:52:12.869 8636-8684/in.example.voiceremotedemo:snipsProcessingService I/snips_asr_hermes: Using model from "/data/user/0/in.example.voiceremotedemo/files/snips/assistant/custom_asr"
04-08 17:52:12.869 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_kaldi::logs: setup log handler
04-08 17:52:12.870 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_kaldi::decode::..: Loading dynamic ASR model
04-08 17:52:12.873 8636-8667/in.example.voiceremotedemo:snipsProcessingService I/snips_dialogue_lib::c..: Loading language en 
04-08 17:52:12.878 8636-8685/in.example.voiceremotedemo:snipsProcessingService D/snips_nlu_hermes: nlu thread ended
04-08 17:52:12.878 8636-8685/in.example.voiceremotedemo:snipsProcessingService E/snips_nlu_hermes: nlu thread ended with error: Unable to read file '/data/user/0/in.example.voiceremotedemo/files/snips/assistant/nlu_engine/nlu_engine.json'
     -> caused by: Expected model version 0.17.0 but found 0.19.0
04-08 17:52:12.878 8636-8667/in.example.voiceremotedemo:snipsProcessingService I/snips_dialogue_hermes: Starting...
04-08 17:52:12.878 8636-8667/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Subscribing on Hotword/HotwordDetected
    Subscribing on AudioServer/AudioServerPlayFinished
    Subscribing on Asr/AsrTextCaptured
    Subscribing on Asr/AsrPartialTextCaptured
    Subscribing on Asr/ComponentError<T>
    Subscribing on Nlu/NluSlotParsed
    Subscribing on Nlu/NluIntentParsed
    Subscribing on Nlu/NluIntentNotRecognized
    Subscribing on Nlu/ComponentError<T>
    Subscribing on Tts/TtsSayFinished
    Subscribing on Tts/ComponentError<T>
    Subscribing on Sound/IdentifiableToggleableToggleOn<T>
    Subscribing on Sound/IdentifiableToggleableToggleOff<T>
    Subscribing on Dialogue/ToggleableToggleOn<T>
    Subscribing on Dialogue/ToggleableToggleOff<T>
    Subscribing on Dialogue/DialogueStartSession
    Subscribing on Dialogue/DialogueContinueSession
    Subscribing on Dialogue/DialogueEndSession
    Subscribing on Dialogue/ComponentVersionRequest<T>
04-08 17:52:12.879 8636-8686/in.example.voiceremotedemo:snipsProcessingService D/snips_dialogue_hermes..: Dialogue manager ping on its own thread started
04-08 17:52:12.879 8636-8667/in.example.voiceremotedemo:snipsProcessingService I/snips_megazord: Starting TTS
04-08 17:52:12.879 8636-8688/in.example.voiceremotedemo:snipsProcessingService D/snips_dialogue_hermes..: Dialogue manager executor on its own thread started
04-08 17:52:12.879 8636-8667/in.example.voiceremotedemo:snipsProcessingService I/snips_megazord: Starting Audio-Server
04-08 17:52:12.879 8636-8689/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Subscribing on Tts/TtsSay
04-08 17:52:12.879 8636-8667/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Subscribing on Hotword/HotwordDetected
04-08 17:52:12.880 8636-8667/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Subscribing on Asr/AsrTextCaptured
    Subscribing on Asr/AsrPartialTextCaptured
04-08 17:52:12.880 8636-8690/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Subscribing on AudioServer/AudioServerPlayBytes
04-08 17:52:12.880 8636-8667/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Subscribing on Dialogue/DialogueIntent
    Subscribing on Dialogue/DialogueIntentNotRecognized
04-08 17:52:12.881 8636-8667/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Subscribing on Dialogue/DialogueSessionStarted
    Subscribing on Dialogue/DialogueSessionQueued
    Subscribing on Dialogue/DialogueSessionEnded
04-08 17:52:12.881 8636-8690/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Subscribing on AudioServer/IdentifiableToggleableToggleOn<T>
    Subscribing on AudioServer/IdentifiableToggleableToggleOff<T>
    Subscribing on AudioServer/AudioServerReplayRequest
04-08 17:52:12.881 8636-8667/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Subscribing on Asr/AsrStartListening
    Subscribing on Asr/AsrStopListening
04-08 17:52:12.881 8636-8667/in.example.voiceremotedemo:snipsProcessingService I/snips_megazord: Starting injection
04-08 17:52:12.882 8636-8667/in.example.voiceremotedemo:snipsProcessingService I/snips_injection_hermes: Launch with assistant "/data/user/0/in.example.voiceremotedemo/files/snips/assistant" and user dir "/data/user/0/in.example.voiceremotedemo/files/_snips"
04-08 17:52:12.882 8636-8667/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Subscribing on Injection/InjectionPerform
    Subscribing on Injection/InjectionStatusRequest
    Subscribing on Injection/ComponentVersionRequest<T>
04-08 17:52:12.883 8636-8687/in.example.voiceremotedemo:snipsProcessingService D/snips_dialogue_hermes..: Dialogue manager coordinator on its own thread started
04-08 17:52:12.883 8636-8691/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Subscribing on VoiceActivity/VoiceActivityVadUp
04-08 17:52:12.889 8636-8691/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Subscribing on VoiceActivity/VoiceActivityVadDown
    Subscribing on Hotword/IdentifiableToggleableToggleOff<T>
    Subscribing on Hotword/IdentifiableToggleableToggleOn<T>
    Subscribing on Hotword/HotwordDetected
    Subscribing on Sound/IdentifiableToggleableToggleOff<T>
    Subscribing on Sound/IdentifiableToggleableToggleOn<T>
    Subscribing on Asr/ToggleableToggleOff<T>
    Subscribing on Asr/ToggleableToggleOn<T>
    Subscribing on Asr/AsrTextCaptured
    Subscribing on Asr/AsrPartialTextCaptured
    Subscribing on Asr/AsrStartListening
    Subscribing on Asr/AsrStopListening
    Subscribing on Asr/AsrReload
    Subscribing on Tts/TtsSay
    Subscribing on Tts/TtsSayFinished
    Subscribing on Injection/InjectionPerform
    Subscribing on Injection/InjectionStatusRequest
    Subscribing on Injection/InjectionStatus
    Subscribing on Nlu/NluSlotParsed
    Subscribing on Nlu/NluIntentParsed
    Subscribing on Nlu/NluIntentNotRecognized
    Subscribing on Nlu/NluReload
    Subscribing on Nlu/NluQuery
    Subscribing on Nlu/NluPartialQuery
    Subscribing on AudioServer/AudioServerPlayFinished
    Subscribing on AudioServer/AudioServerPlayBytes
    Subscribing on Dialogue/ToggleableToggleOff<T>
    Subscribing on Dialogue/ToggleableToggleOn<T>
    Subscribing on Dialogue/DialogueSessionQueued
    Subscribing on Dialogue/DialogueSessionStarted
    Subscribing on Dialogue/DialogueIntent
    Subscribing on Dialogue/DialogueSessionEnded
    Subscribing on Dialogue/DialogueStartSession
    Subscribing on Dialogue/DialogueContinueSession
    Subscribing on Dialogue/DialogueEndSession
04-08 17:52:12.892 8636-8693/in.example.voiceremotedemo:snipsProcessingService D/snips_injection_hermes: snips-injection started
04-08 17:52:12.914 8636-8684/in.example.voiceremotedemo:snipsProcessingService I/snips_kaldi::decode::..: Loading model v2
04-08 17:52:13.104 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_kaldi::logs: Removing 0 orphan components.
04-08 17:52:13.105 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_kaldi::logs: left_fst_filename : /data/user/0/in.example.voiceremotedemo/files/snips/assistant/custom_asr/l.snips
    right_fst_filename : /data/user/0/in.example.voiceremotedemo/files/snips/assistant/custom_asr/r.snips
04-08 17:52:13.183 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_kaldi::logs: ASR model fully loaded
04-08 17:52:13.183 8636-8684/in.example.voiceremotedemo:snipsProcessingService I/snips_asr_hermes: Preparing decoder
04-08 17:52:13.183 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_kaldi::decode::..: Decoder started with decoder config DecoderConfig { beam_size: 12.0, max_active: 2500, min_active: 200, lattice_beam_size: 4.0, acoustic_scale: 0.83, use_final_probs: true, mbr_config: Some(MbrConfig { unk_threshold: 0.3, unk_proba: 0.5 }) } and endpointing rules EndpointingConfiguration { container: {"rule4": EndpointingRule { must_contain_nonsilence: true, min_trailing_silence: 0.5, max_relative_cost: 2.5, min_utterance_length: 0.0 }, "rule2": EndpointingRule { must_contain_nonsilence: true, min_trailing_silence: 0.7, max_relative_cost: 5.5, min_utterance_length: 0.0 }, "rule5": EndpointingRule { must_contain_nonsilence: false, min_trailing_silence: 0.0, max_relative_cost: 10000000000.0, min_utterance_length: 10.0 }, "rule3": EndpointingRule { must_contain_nonsilence: true, min_trailing_silence: 1.0, max_relative_cost: 8.0, min_utterance_length: 0.0 }, "rule1": EndpointingRule { must_contain_nonsilence: false, min_trailing_silence: 4.0, max_relative_cost: 10000000000.0, min_utterance_length: 0.0 }} }
04-08 17:52:13.282 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_kaldi::logs: Spent 0.055048 seconds in looped compilation.
04-08 17:52:13.282 8636-8684/in.example.voiceremotedemo:snipsProcessingService I/snips_asr_hermes: Idle
04-08 17:52:19.814 8636-8683/in.example.voiceremotedemo:snipsProcessingService I/snips_hotword_hermes: Hotword detected: site_id:default model:hey_snips (11ms ago)
04-08 17:52:19.814 8636-8683/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Publishing Hotword/HotwordDetected {
        id: "default_hotword",
        message: HotwordDetectedMessage {
            site_id: "default",
            model_id: "hey_snips",
            model_version: Some(
                "workflow-hey_snips_subww_feedback_10seeds-2018_12_04T12_13_05_evaluated_model_0002"
            ),
            model_type: Some(
                Universal
            ),
            current_sensitivity: Some(
                0.5
            ),
            detection_signal_ms: Some(
                1554726139803
            ),
            end_signal_ms: Some(
                1554726139803
            )
        }
    }
04-08 17:52:19.816 8636-8687/in.example.voiceremotedemo:snipsProcessingService I/snips_dialogue_lib::c..: Site [default]: reset site -> turn off ASR and turn off Hotword
    Session [c83d45f8-4da1-47c1-a19c-495d8536cc26]: The session has been created because the site "default" is free
04-08 17:52:19.816 8636-8688/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Publishing Asr/AsrStopListening {
        site: SiteMessage {
            site_id: "default",
            session_id: Some(
                "c83d45f8-4da1-47c1-a19c-495d8536cc26"
            )
        }
    }
    Publishing Hotword/IdentifiableToggleableToggleOff {
        site: SiteMessage {
            site_id: "default",
            session_id: Some(
                "c83d45f8-4da1-47c1-a19c-495d8536cc26"
            )
        },
        component: Hotword
    }
    Publishing Dialogue/DialogueSessionStarted {
        status: SessionStartedMessage {
            session_id: "c83d45f8-4da1-47c1-a19c-495d8536cc26",
            custom_data: None,
            site_id: "default",
            reactivated_from_session_id: None
        }
    }
04-08 17:52:19.817 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_asr_hermes: ignore stop request, already idle
04-08 17:52:19.818 8636-8683/in.example.voiceremotedemo:snipsProcessingService D/snips_hotword_lib::un..: Clear network state
04-08 17:52:19.818 8636-8681/in.example.voiceremotedemo:snipsProcessingService D/snips_hotword_lib::fe..: Clear feature states
04-08 17:52:19.818 8636-8681/in.example.voiceremotedemo:snipsProcessingService I/snips_hotword_lib::au..: Audio thread for site default stopped.
04-08 17:52:19.819 8636-8688/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Publishing Asr/AsrStartListening {
        start: AsrStartListeningMessage {
            site_id: "default",
            session_id: Some(
                "c83d45f8-4da1-47c1-a19c-495d8536cc26"
            ),
            start_signal_ms: Some(
                1554726139803
            )
        }
    }
04-08 17:52:19.820 8636-8683/in.example.voiceremotedemo:snipsProcessingService D/snips_hotword_lib::un..: Clear post processor
04-08 17:52:19.821 8636-8684/in.example.voiceremotedemo:snipsProcessingService I/snips_asr_hermes: Listening
04-08 17:52:19.821 8636-8684/in.example.voiceremotedemo:snipsProcessingService I/snips_asr_lib::asr: T0       entered AsrRunner::run
04-08 17:52:19.821 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_asr_lib::asr:          sample rate is 16000
04-08 17:52:19.821 8636-8684/in.example.voiceremotedemo:snipsProcessingService I/snips_asr_lib::asr: T0+0.000 capture started
04-08 17:52:22.363 8636-8684/in.example.voiceremotedemo:snipsProcessingService I/snips_asr_lib::asr: T0+2.542 endpoint detected (rule:2) frame:62 samples:39680 signal_time:2.48 rtf:0.151
04-08 17:52:22.371 8636-8704/in.example.voiceremotedemo:snipsProcessingService I/snips_asr_lib::asr: Source thread stop on push: "Disconnected(..)"
04-08 17:52:22.371 8636-8684/in.example.voiceremotedemo:snipsProcessingService I/snips_asr_lib::asr: T0+2.550 capture ended
04-08 17:52:22.376 8636-8684/in.example.voiceremotedemo:snipsProcessingService I/snips_asr_lib::asr: T0+2.556 decoder finalized
04-08 17:52:22.376 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_kaldi::logs: Sausage decoding : 0.3 0.5
04-08 17:52:22.379 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_kaldi::decode::..: Postprocessing 'paracetamol'
    PostProcessor s/`INTENT`42f038a2-c1cb-48a6-83ad-8530280503b3`START (.*?) `INTENT`42f038a2-c1cb-48a6-83ad-8530280503b3`END/$1/ : paracetamol -> paracetamol
    PostProcessor s/`INTENT`42f038a2-c1cb-48a6-83ad-8530280503b3`START // : paracetamol -> paracetamol
    PostProcessor s/`INTENT`71cb7905-98c7-4460-bce0-3c761dac92cc`START (.*?) `INTENT`71cb7905-98c7-4460-bce0-3c761dac92cc`END/$1/ : paracetamol -> paracetamol
    PostProcessor s/`INTENT`71cb7905-98c7-4460-bce0-3c761dac92cc`START // : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`f58bb617-1c77-4f15-b725-f6f121fe495e`START (.*?) `ENTITY`f58bb617-1c77-4f15-b725-f6f121fe495e`END/$1/ : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`f58bb617-1c77-4f15-b725-f6f121fe495e`START // : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`5aa4798e-1b25-43ee-bea7-9e01c7c41261`START (.*?) `ENTITY`5aa4798e-1b25-43ee-bea7-9e01c7c41261`END/$1/ : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`5aa4798e-1b25-43ee-bea7-9e01c7c41261`START // : paracetamol -> paracetamol
04-08 17:52:22.380 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_kaldi::decode::..: PostProcessor s/`ENTITY`1001cf9d-bf2b-4398-9943-0338128ae54a`START (.*?) `ENTITY`1001cf9d-bf2b-4398-9943-0338128ae54a`END/$1/ : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`1001cf9d-bf2b-4398-9943-0338128ae54a`START // : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`87de7275-23c6-4d5a-a1a0-63ee9265afd0`START (.*?) `ENTITY`87de7275-23c6-4d5a-a1a0-63ee9265afd0`END/$1/ : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`87de7275-23c6-4d5a-a1a0-63ee9265afd0`START // : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`a7028d9b-6ed5-409f-a3f7-752b65c9b97d`START (.*?) `ENTITY`a7028d9b-6ed5-409f-a3f7-752b65c9b97d`END/$1/ : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`a7028d9b-6ed5-409f-a3f7-752b65c9b97d`START // : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`b3a37cf5-7391-46b1-aa4e-5833c79e5ea8`START (.*?) `ENTITY`b3a37cf5-7391-46b1-aa4e-5833c79e5ea8`END/$1/ : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`b3a37cf5-7391-46b1-aa4e-5833c79e5ea8`START // : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`b3a37cf5-7391-46b1-aa4e-5833c79e5ea8`START .[^`]*? `ENTITY`b3a37cf5-7391-46b1-aa4e-5833c79e5ea8`BYPASSING `ENTITY`b3a37cf5-7391-46b1-aa4e-5833c79e5ea8`END/unknownword/ : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`69bb6566-7929-4a55-ae31-a625104a6588`START (.*?) `ENTITY`69bb6566-7929-4a55-ae31-a625104a6588`END/$1/ : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`69bb6566-7929-4a55-ae31-a625104a6588`START // : paracetamol -> paracetamol
04-08 17:52:22.380 8636-8684/in.example.voiceremotedemo:snipsProcessingService I/snips_asr_lib::asr: T0+2.559 lookup and post-processing done
    decoded: [Recognition { decoded_string: "paracetamol", likelihood: 0.6934959, tokens: Some([Token { value: "paracetamol", confidence: 0.6934959, time: (0.17607783, 2.31), range: 0..11 }]) }]
04-08 17:52:22.380 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Publishing Asr/AsrTextCaptured {
        text_captured: TextCapturedMessage {
            text: "paracetamol",
            likelihood: 0.6934959,
            tokens: Some(
                [
                    AsrToken {
                        value: "paracetamol",
                        confidence: 0.6934959,
                        range_start: 0,
                        range_end: 11,
                        time: AsrDecodingDuration {
                            start: 0.17607783,
                            end: 2.31
                        }
                    }
                ]
            ),
            seconds: 2.0,
            site_id: "default",
            session_id: Some(
                "c83d45f8-4da1-47c1-a19c-495d8536cc26"
            )
        }
    }
04-08 17:52:22.380 8636-8684/in.example.voiceremotedemo:snipsProcessingService I/snips_asr_hermes: Cleanup
    Preparing decoder
04-08 17:52:22.380 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_kaldi::decode::..: Decoder started with decoder config DecoderConfig { beam_size: 12.0, max_active: 2500, min_active: 200, lattice_beam_size: 4.0, acoustic_scale: 0.83, use_final_probs: true, mbr_config: Some(MbrConfig { unk_threshold: 0.3, unk_proba: 0.5 }) } and endpointing rules EndpointingConfiguration { container: {"rule4": EndpointingRule { must_contain_nonsilence: true, min_trailing_silence: 0.5, max_relative_cost: 2.5, min_utterance_length: 0.0 }, "rule2": EndpointingRule { must_contain_nonsilence: true, min_trailing_silence: 0.7, max_relative_cost: 5.5, min_utterance_length: 0.0 }, "rule5": EndpointingRule { must_contain_nonsilence: false, min_trailing_silence: 0.0, max_relative_cost: 10000000000.0, min_utterance_length: 10.0 }, "rule3": EndpointingRule { must_contain_nonsilence: true, min_trailing_silence: 1.0, max_relative_cost: 8.0, min_utterance_length: 0.0 }, "rule1": EndpointingRule { must_contain_nonsilence: false, min_trailing_silence: 4.0, max_relative_cost: 10000000000.0, min_utterance_length: 0.0 }} }
04-08 17:52:22.381 8636-8688/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Publishing Asr/AsrStopListening {
        site: SiteMessage {
            site_id: "default",
            session_id: Some(
                "c83d45f8-4da1-47c1-a19c-495d8536cc26"
            )
        }
    }
04-08 17:52:22.393 8636-8688/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Publishing Nlu/NluQuery {
        query: NluQueryMessage {
            input: "paracetamol",
            asr_tokens: Some(
                [
                    AsrToken {
                        value: "paracetamol",
                        confidence: 0.6934959,
                        range_start: 0,
                        range_end: 11,
                        time: AsrDecodingDuration {
                            start: 0.17607783,
                            end: 2.31
                        }
                    }
                ]
            ),
            intent_filter: None,
            id: Some(
                "7b4a8742-e59a-4eaf-88df-d88a32944832"
            ),
            session_id: Some(
                "c83d45f8-4da1-47c1-a19c-495d8536cc26"
            )
        }
    }
04-08 17:52:22.419 8636-8690/in.example.voiceremotedemo:snipsProcessingService W/snips_broadcast_chann..: could not send data to audio subscriber, removing it: "SendError(..)"
04-08 17:52:22.486 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_kaldi::logs: Spent 0.0553119 seconds in looped compilation.
04-08 17:52:22.486 8636-8684/in.example.voiceremotedemo:snipsProcessingService I/snips_asr_hermes: Idle
04-08 17:52:22.486 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_asr_hermes: ignore stop request, already idle
04-08 17:52:37.885 8636-8688/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Publishing Dialogue/DialogueSessionEnded {
        status: SessionEndedMessage {
            session_id: "c83d45f8-4da1-47c1-a19c-495d8536cc26",
            custom_data: None,
            termination: Timeout,
            site_id: "default"
        }
    }
04-08 17:52:37.885 8636-8687/in.example.voiceremotedemo:snipsProcessingService I/snips_dialogue_lib::c..: Session [c83d45f8-4da1-47c1-a19c-495d8536cc26]: closing session which was active: Timeout
    Site [default]: reset site -> turn off ASR and turn on Hotword
04-08 17:52:37.885 8636-8688/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Publishing Asr/AsrStopListening {
        site: SiteMessage {
            site_id: "default",
            session_id: None
        }
    }
    Publishing Hotword/IdentifiableToggleableToggleOn {
        site: SiteMessage {
            site_id: "default",
            session_id: None
        },
        component: Hotword
    }
04-08 17:52:37.886 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_asr_hermes: ignore stop request, already idle
04-08 17:52:37.890 8636-8681/in.example.voiceremotedemo:snipsProcessingService I/snips_hotword_lib::au..: Audio thread for site default started.
04-08 17:52:47.852 8636-8636/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Publishing Dialogue/DialogueStartSession {
        start_session: StartSessionMessage {
            init: Action {
                text: None,
                intent_filter: None,
                can_be_enqueued: false,
                send_intent_not_recognized: false
            },
            custom_data: None,
            site_id: None
        }
    }
04-08 17:52:47.853 8636-8687/in.example.voiceremotedemo:snipsProcessingService I/snips_dialogue_lib::c..: Site [default]: reset site -> turn off ASR and turn off Hotword
    Session [65b7206e-d07a-48f6-bd82-647835c26450]: The session has been created because the site "default" is free
04-08 17:52:47.853 8636-8688/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Publishing Asr/AsrStopListening {
        site: SiteMessage {
            site_id: "default",
            session_id: Some(
                "65b7206e-d07a-48f6-bd82-647835c26450"
            )
        }
    }
    Publishing Hotword/IdentifiableToggleableToggleOff {
        site: SiteMessage {
            site_id: "default",
            session_id: Some(
                "65b7206e-d07a-48f6-bd82-647835c26450"
            )
        },
        component: Hotword
    }
    Publishing Dialogue/DialogueSessionStarted {
        status: SessionStartedMessage {
            session_id: "65b7206e-d07a-48f6-bd82-647835c26450",
            custom_data: None,
            site_id: "default",
            reactivated_from_session_id: None
        }
    }
04-08 17:52:47.854 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_asr_hermes: ignore stop request, already idle
04-08 17:52:47.854 8636-8688/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Publishing Asr/AsrStartListening {
        start: AsrStartListeningMessage {
            site_id: "default",
            session_id: Some(
                "65b7206e-d07a-48f6-bd82-647835c26450"
            ),
            start_signal_ms: None
        }
    }
04-08 17:52:47.856 8636-8684/in.example.voiceremotedemo:snipsProcessingService I/snips_asr_hermes: Listening
04-08 17:52:47.856 8636-8684/in.example.voiceremotedemo:snipsProcessingService I/snips_asr_lib::asr: T0       entered AsrRunner::run
04-08 17:52:47.856 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_asr_lib::asr:          sample rate is 16000
04-08 17:52:47.856 8636-8684/in.example.voiceremotedemo:snipsProcessingService I/snips_asr_lib::asr: T0+0.000 capture started
04-08 17:52:47.858 8636-8683/in.example.voiceremotedemo:snipsProcessingService D/snips_hotword_lib::un..: Clear network state
04-08 17:52:47.858 8636-8681/in.example.voiceremotedemo:snipsProcessingService D/snips_hotword_lib::fe..: Clear feature states
04-08 17:52:47.858 8636-8681/in.example.voiceremotedemo:snipsProcessingService I/snips_hotword_lib::au..: Audio thread for site default stopped.
04-08 17:52:47.858 8636-8683/in.example.voiceremotedemo:snipsProcessingService D/snips_hotword_lib::un..: Clear post processor
04-08 17:52:50.792 8636-8684/in.example.voiceremotedemo:snipsProcessingService I/snips_asr_lib::asr: T0+2.936 endpoint detected (rule:2) frame:73 samples:46720 signal_time:2.92 rtf:0.128
04-08 17:52:50.812 8636-8809/in.example.voiceremotedemo:snipsProcessingService I/snips_asr_lib::asr: Source thread stop on push: "Disconnected(..)"
04-08 17:52:50.812 8636-8684/in.example.voiceremotedemo:snipsProcessingService I/snips_asr_lib::asr: T0+2.956 capture ended
04-08 17:52:50.818 8636-8684/in.example.voiceremotedemo:snipsProcessingService I/snips_asr_lib::asr: T0+2.962 decoder finalized
04-08 17:52:50.818 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_kaldi::logs: Sausage decoding : 0.3 0.5
04-08 17:52:50.820 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_kaldi::decode::..: Postprocessing 'paracetamol'
    PostProcessor s/`INTENT`42f038a2-c1cb-48a6-83ad-8530280503b3`START (.*?) `INTENT`42f038a2-c1cb-48a6-83ad-8530280503b3`END/$1/ : paracetamol -> paracetamol
    PostProcessor s/`INTENT`42f038a2-c1cb-48a6-83ad-8530280503b3`START // : paracetamol -> paracetamol
    PostProcessor s/`INTENT`71cb7905-98c7-4460-bce0-3c761dac92cc`START (.*?) `INTENT`71cb7905-98c7-4460-bce0-3c761dac92cc`END/$1/ : paracetamol -> paracetamol
    PostProcessor s/`INTENT`71cb7905-98c7-4460-bce0-3c761dac92cc`START // : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`f58bb617-1c77-4f15-b725-f6f121fe495e`START (.*?) `ENTITY`f58bb617-1c77-4f15-b725-f6f121fe495e`END/$1/ : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`f58bb617-1c77-4f15-b725-f6f121fe495e`START // : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`5aa4798e-1b25-43ee-bea7-9e01c7c41261`START (.*?) `ENTITY`5aa4798e-1b25-43ee-bea7-9e01c7c41261`END/$1/ : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`5aa4798e-1b25-43ee-bea7-9e01c7c41261`START // : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`1001cf9d-bf2b-4398-9943-0338128ae54a`START (.*?) `ENTITY`1001cf9d-bf2b-4398-9943-0338128ae54a`END/$1/ : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`1001cf9d-bf2b-4398-9943-0338128ae54a`START // : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`87de7275-23c6-4d5a-a1a0-63ee9265afd0`START (.*?) `ENTITY`87de7275-23c6-4d5a-a1a0-63ee9265afd0`END/$1/ : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`87de7275-23c6-4d5a-a1a0-63ee9265afd0`START // : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`a7028d9b-6ed5-409f-a3f7-752b65c9b97d`START (.*?) `ENTITY`a7028d9b-6ed5-409f-a3f7-752b65c9b97d`END/$1/ : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`a7028d9b-6ed5-409f-a3f7-752b65c9b97d`START // : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`b3a37cf5-7391-46b1-aa4e-5833c79e5ea8`START (.*?) `ENTITY`b3a37cf5-7391-46b1-aa4e-5833c79e5ea8`END/$1/ : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`b3a37cf5-7391-46b1-aa4e-5833c79e5ea8`START // : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`b3a37cf5-7391-46b1-aa4e-5833c79e5ea8`START .[^`]*? `ENTITY`b3a37cf5-7391-46b1-aa4e-5833c79e5ea8`BYPASSING `ENTITY`b3a37cf5-7391-46b1-aa4e-5833c79e5ea8`END/unknownword/ : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`69bb6566-7929-4a55-ae31-a625104a6588`START (.*?) `ENTITY`69bb6566-7929-4a55-ae31-a625104a6588`END/$1/ : paracetamol -> paracetamol
    PostProcessor s/`ENTITY`69bb6566-7929-4a55-ae31-a625104a6588`START // : paracetamol -> paracetamol
04-08 17:52:50.820 8636-8684/in.example.voiceremotedemo:snipsProcessingService I/snips_asr_lib::asr: T0+2.964 lookup and post-processing done
    decoded: [Recognition { decoded_string: "paracetamol", likelihood: 1.0, tokens: Some([Token { value: "paracetamol", confidence: 1.0, time: (0.0, 2.73), range: 0..11 }]) }]
04-08 17:52:50.820 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Publishing Asr/AsrTextCaptured {
        text_captured: TextCapturedMessage {
            text: "paracetamol",
            likelihood: 1.0,
            tokens: Some(
                [
                    AsrToken {
                        value: "paracetamol",
                        confidence: 1.0,
                        range_start: 0,
                        range_end: 11,
                        time: AsrDecodingDuration {
                            start: 0.0,
                            end: 2.73
                        }
                    }
                ]
            ),
            seconds: 2.0,
            site_id: "default",
            session_id: Some(
                "65b7206e-d07a-48f6-bd82-647835c26450"
            )
        }
    }
04-08 17:52:50.820 8636-8684/in.example.voiceremotedemo:snipsProcessingService I/snips_asr_hermes: Cleanup
    Preparing decoder
04-08 17:52:50.820 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_kaldi::decode::..: Decoder started with decoder config DecoderConfig { beam_size: 12.0, max_active: 2500, min_active: 200, lattice_beam_size: 4.0, acoustic_scale: 0.83, use_final_probs: true, mbr_config: Some(MbrConfig { unk_threshold: 0.3, unk_proba: 0.5 }) } and endpointing rules EndpointingConfiguration { container: {"rule4": EndpointingRule { must_contain_nonsilence: true, min_trailing_silence: 0.5, max_relative_cost: 2.5, min_utterance_length: 0.0 }, "rule2": EndpointingRule { must_contain_nonsilence: true, min_trailing_silence: 0.7, max_relative_cost: 5.5, min_utterance_length: 0.0 }, "rule5": EndpointingRule { must_contain_nonsilence: false, min_trailing_silence: 0.0, max_relative_cost: 10000000000.0, min_utterance_length: 10.0 }, "rule3": EndpointingRule { must_contain_nonsilence: true, min_trailing_silence: 1.0, max_relative_cost: 8.0, min_utterance_length: 0.0 }, "rule1": EndpointingRule { must_contain_nonsilence: false, min_trailing_silence: 4.0, max_relative_cost: 10000000000.0, min_utterance_length: 0.0 }} }
04-08 17:52:50.821 8636-8688/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Publishing Asr/AsrStopListening {
        site: SiteMessage {
            site_id: "default",
            session_id: Some(
                "65b7206e-d07a-48f6-bd82-647835c26450"
            )
        }
    }
04-08 17:52:50.822 8636-8688/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Publishing Nlu/NluQuery {
        query: NluQueryMessage {
            input: "paracetamol",
            asr_tokens: Some(
                [
                    AsrToken {
                        value: "paracetamol",
                        confidence: 1.0,
                        range_start: 0,
                        range_end: 11,
                        time: AsrDecodingDuration {
                            start: 0.0,
                            end: 2.73
                        }
                    }
                ]
            ),
            intent_filter: None,
            id: Some(
                "99c4d2b3-3e3c-4766-8ab8-7d9e9c630029"
            ),
            session_id: Some(
                "65b7206e-d07a-48f6-bd82-647835c26450"
            )
        }
    }
04-08 17:52:50.841 8636-8690/in.example.voiceremotedemo:snipsProcessingService W/snips_broadcast_chann..: could not send data to audio subscriber, removing it: "SendError(..)"
04-08 17:52:50.922 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_kaldi::logs: Spent 0.0547302 seconds in looped compilation.
04-08 17:52:50.922 8636-8684/in.example.voiceremotedemo:snipsProcessingService I/snips_asr_hermes: Idle
04-08 17:52:50.922 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_asr_hermes: ignore stop request, already idle
04-08 17:53:05.888 8636-8687/in.example.voiceremotedemo:snipsProcessingService I/snips_dialogue_lib::c..: Session [65b7206e-d07a-48f6-bd82-647835c26450]: closing session which was active: Timeout
04-08 17:53:05.888 8636-8688/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Publishing Dialogue/DialogueSessionEnded {
        status: SessionEndedMessage {
            session_id: "65b7206e-d07a-48f6-bd82-647835c26450",
            custom_data: None,
            termination: Timeout,
            site_id: "default"
        }
    }
04-08 17:53:05.888 8636-8687/in.example.voiceremotedemo:snipsProcessingService I/snips_dialogue_lib::c..: Site [default]: reset site -> turn off ASR and turn on Hotword
04-08 17:53:05.888 8636-8688/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Publishing Asr/AsrStopListening {
        site: SiteMessage {
            site_id: "default",
            session_id: None
        }
    }
04-08 17:53:05.889 8636-8688/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Publishing Hotword/IdentifiableToggleableToggleOn {
        site: SiteMessage {
            site_id: "default",
            session_id: None
        },
        component: Hotword
    }
04-08 17:53:05.889 8636-8684/in.example.voiceremotedemo:snipsProcessingService D/snips_asr_hermes: ignore stop request, already idle
04-08 17:53:05.891 8636-8681/in.example.voiceremotedemo:snipsProcessingService I/snips_hotword_lib::au..: Audio thread for site default started.
04-08 17:53:48.303 8636-8636/in.example.voiceremotedemo:snipsProcessingService I/snips_megazord: pausing the megazord
04-08 17:53:48.303 8636-8636/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Publishing Hotword/IdentifiableToggleableToggleOff {
        site: SiteMessage {
            site_id: "default",
            session_id: None
        },
        component: Hotword
    }
    Publishing Dialogue/ToggleableToggleOff {
        component: Dialogue
    }
04-08 17:53:48.304 8636-8687/in.example.voiceremotedemo:snipsProcessingService D/snips_dialogue_hermes..: Stop dialogue manager
04-08 17:53:48.307 8636-8681/in.example.voiceremotedemo:snipsProcessingService D/snips_hotword_lib::fe..: Clear feature states
04-08 17:53:48.307 8636-8681/in.example.voiceremotedemo:snipsProcessingService I/snips_hotword_lib::au..: Audio thread for site default stopped.
04-08 17:53:48.311 8636-8683/in.example.voiceremotedemo:snipsProcessingService D/snips_hotword_lib::un..: Clear network state
    Clear post processor
04-08 17:54:42.552 8636-8636/in.example.voiceremotedemo:snipsProcessingService I/snips_megazord: unpausing the megazord
04-08 17:54:42.552 8636-8636/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Publishing Hotword/IdentifiableToggleableToggleOn {
        site: SiteMessage {
            site_id: "default",
            session_id: None
        },
        component: Hotword
    }
04-08 17:54:42.553 8636-8636/in.example.voiceremotedemo:snipsProcessingService D/hermes_inprocess: Publishing Dialogue/ToggleableToggleOn {
        component: Dialogue
    }
04-08 17:54:42.553 8636-8687/in.example.voiceremotedemo:snipsProcessingService D/snips_dialogue_hermes..: Reactivate dialogue manager
04-08 17:54:42.561 8636-8681/in.example.voiceremotedemo:snipsProcessingService I/snips_hotword_lib::au..: Audio thread for site default started.

@mark922
Copy link
Author

mark922 commented Apr 8, 2019

@fredszaq Let me know if you need anything else.

@fredszaq
Copy link

Expected model version 0.17.0 but found 0.19.0, you need to update your assistant

@fredszaq
Copy link

My bad, this message is misleading and the code that produces it also (PR to change that snipsco/snips-nlu-rs#133)

It seems it is you version of the platform that is off, are you sure you're running 0.62.3 ?

@mark922
Copy link
Author

mark922 commented Apr 10, 2019

Yeah I just checked it again. I am using this version in gradle file:
implementation('ai.snips:snips-platform-android:0.62.3@aar') { transitive = true }

@mark922
Copy link
Author

mark922 commented Apr 10, 2019

If it is of any use, here is the latest log of in.example.voiceremotedemo:snipsProcessingService. log.txt

@fredszaq
Copy link

hum, the read: unexpected EOF! in the end is caused by a configuration problem on our end (some part of the code is outputing debug logs were it should not and overflows the logcat, There is a fix for that in the next version. This is a problem as the logcat is overflown before anything useful in our case is output... I guess this will have to wait for the new version to be released so that we have usable logs debug this...

@mark922
Copy link
Author

mark922 commented Apr 10, 2019

Okay. Any expected timeline for the next release ?

@mark922
Copy link
Author

mark922 commented May 1, 2019

Any updates on this issue?

@cpoisson cpoisson removed the type: support Support issue ( should not exist in this project ;) label May 28, 2019
@cpoisson cpoisson added this to the Snips Flow - Next milestone May 28, 2019
@fredszaq
Copy link

fredszaq commented May 28, 2019 •
edited
Loading

@mark922 release 1.2.1 (0.63.2) contains the log fix, could you give it a try ?

@mark922
Copy link
Author

mark922 commented May 28, 2019

Sure. Will give it a go in a day or two and get back to you.

@cpoisson cpoisson removed the platform label Aug 2, 2019
@cpoisson
Copy link
Contributor

Tested ok my side. I'm closing this one.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@fredszaq fredszaq

@cpoisson cpoisson

@Garvys Garvys

Labels
sub: asr Related to speech recognition type: bug Not working as expected
Projects
None yet
Milestone
Snips Flow - Next
Development

No branches or pull requests
4 participants
@fredszaq @cpoisson @mark922 @Garvys