Lager is stuck

[ophirzk]

Hi,

Hi,

RabbitMQ got stuck after a few hours. After some digging, it looks like it was stuck because of lager. I traced it and got the stack trace which I added below. lager:do_log_impl doesn't return and it looks like gen_event:notify() is stuck: lager.erl

Any chance you have an idea what was going on here, have you seen it before?
Appreciate your insights here.

RabbitMQ version 3.8.16
Erlang: 23.2
OS: Windows

Here I tried to print "aaa" to the logs:

18:35:26:521621 (<11678.17484.10>) spawned <14514.95.0> {erts_internal,dist_spawn_init,[{erpc,execute_call,4}]}
18:35:26:521623 (<11678.17484.10>) call lager:log/5
18:35:26:521624 (<11678.17484.10>) call lager:dispatch_log/7
18:35:26:521625 (<11678.17484.10>) call lager:do_log/10
18:35:26:521626 (<11678.17484.10>) call lager:do_log_impl/10
18:35:26:521627 (<11678.17484.10>) call lager:'-do_log/10-fun-0-'/3
18:35:26:521628 (<11678.17484.10>) call lager:safe_format_chop/3
18:35:26:521629 (<11678.17484.10>) call lager:safe_format/4
18:35:26:521630 (<11678.17484.10>) returned from lager:safe_format/4 -> "aaa"
18:35:26:521631 (<11678.17484.10>) returned from lager:safe_format_chop/3 -> "aaa"
18:35:26:521632 (<11678.17484.10>) returned from lager:'-do_log/10-fun-0-'/3 -> "aaa"
18:35:27:646509 (<11678.17485.10>) spawned <11678.390.0> {mnesia_controller,dump_and_reply,[<11678.390.0>,{dump_log,time_threshold,undefined,dump_log}]}
18:35:27:646510 (<11678.17485.10>) getting_linked <11678.390.0>
18:35:27:646512 (<11678.17485.10>) unlink <11678.390.0>
18:35:27:646513 (<11678.17485.10>) exit normal
18:35:27:646514 (<11678.17485.10>) out_exited 0