Dask Backend: some logs are missing in the UI

[sanderegg]

Is there an existing issue for this?

• I have searched the existing issues

Which deploy/s?

development (master)

Current Behavior

The logs of isolve-mpi seem to be sometimes missing.
These are logs from running 2 isolve-mpis. The e2e test looks for the text "Running MPI version 3.1 on 2 processes." which can only be found in log (4).log. Also one can see that there are missing logs in both files.
logs (4).log
logs (3).log

Expected Behavior

The logs are always the same and are complete

Steps To Reproduce

1. Go to osparc.io
2. open isolve-mpi template
3. create another isolve-mpi with the same version
4. observe the logs

Anything else?

No response

[GitHK]

Today I can still verify this is happening in master.

[sanderegg]

this seems to show that the logs are lost somewhere between the worker and the client:
https://github.com/ITISFoundation/osparc-simcore/actions/runs/4989799968/jobs/8934343936?pr=4242

as in these tests there is no rabbitmq, nor director-v2 involved.

[sanderegg]

issue disappeared.