root@sonic:~# show version SONiC Software Version: SONiC.HEAD.59-e12d2e8b Distribution: Debian 9.12 Kernel: 4.9.0-11-2-amd64 Build commit: e12d2e8b Build date: Wed Apr 29 09:52:06 UTC 2020 Built by: johnar@jenkins-worker-7 Platform: x86_64-dellemc_s5232f_c3538-r0 HwSKU: DellEMC-S5232f-C32 ASIC: broadcom Serial Number: CN01WJVTCES0094A0012 Uptime: 22:52:47 up 7 min, 1 user, load average: 3.55, 1.53, 0.67 Docker images: REPOSITORY TAG IMAGE ID SIZE docker-syncd-brcm HEAD.59-e12d2e8b a180efcab00b 430MB docker-syncd-brcm latest a180efcab00b 430MB docker-platform-monitor HEAD.59-e12d2e8b 386aa55a8508 335MB docker-platform-monitor latest 386aa55a8508 335MB docker-router-advertiser HEAD.59-e12d2e8b 9f4854585ee3 283MB docker-router-advertiser latest 9f4854585ee3 283MB docker-fpm-frr HEAD.59-e12d2e8b 3670c851b173 328MB docker-fpm-frr latest 3670c851b173 328MB docker-sflow HEAD.59-e12d2e8b 023ab4968814 308MB docker-sflow latest 023ab4968814 308MB docker-lldp-sv2 HEAD.59-e12d2e8b 042f7f751f7a 305MB docker-lldp-sv2 latest 042f7f751f7a 305MB docker-orchagent HEAD.59-e12d2e8b 87512310c295 326MB docker-orchagent latest 87512310c295 326MB docker-dhcp-relay HEAD.59-e12d2e8b 40456ac237c4 293MB docker-dhcp-relay latest 40456ac237c4 293MB docker-database HEAD.59-e12d2e8b 3aac1ffbac82 283MB docker-database latest 3aac1ffbac82 283MB docker-snmp-sv2 HEAD.59-e12d2e8b ca7db59dc9a2 340MB docker-snmp-sv2 latest ca7db59dc9a2 340MB docker-teamd HEAD.59-e12d2e8b 6bf05ac5a892 307MB docker-teamd latest 6bf05ac5a892 307MB docker-nat HEAD.59-e12d2e8b 57fe398c336f 309MB docker-nat latest 57fe398c336f 309MB docker-sonic-mgmt-framework HEAD.59-e12d2e8b 270430fb9afe 422MB docker-sonic-mgmt-framework latest 270430fb9afe 422MB docker-sonic-telemetry HEAD.59-e12d2e8b fd97b5bcd946 345MB docker-sonic-telemetry latest fd97b5bcd946 345MB root@sonic:~# root@sonic:~# cd /var/core root@sonic:/var/core# ls root@sonic:/var/core# config load_minigraph -y Executing stop of service swss... Executing stop of service lldp... Executing stop of service pmon... Executing stop of service bgp... Executing stop of service hostcfgd... Executing stop of service nat... Running command: /usr/local/bin/sonic-cfggen -H -m -j /etc/sonic/init_cfg.json --write-to-db Running command: pfcwd start_default Running command: config qos reload Running command: /usr/local/bin/sonic-cfggen -d -t /usr/share/sonic/device/x86_64-dellemc_s5232f_c3538-r0/DellEMC-S5232f-C32/buffers.json.j2 >/tmp/buffers.json Running command: /usr/local/bin/sonic-cfggen -d -t /usr/share/sonic/device/x86_64-dellemc_s5232f_c3538-r0/DellEMC-S5232f-C32/qos.json.j2 -y /etc/sonic/sonic_version.yml >/tmp/qos.json Running command: /usr/local/bin/sonic-cfggen -j /tmp/buffers.json --write-to-db Running command: /usr/local/bin/sonic-cfggen -j /tmp/qos.json --write-to-db Executing reset-failed of service bgp... Executing reset-failed of service dhcp_relay... Executing reset-failed of service hostcfgd... Executing reset-failed of service hostname-config... Executing reset-failed of service interfaces-config... Executing reset-failed of service lldp... Executing reset-failed of service ntp-config... Executing reset-failed of service pmon... Executing reset-failed of service radv... Executing reset-failed of service rsyslog-config... Executing reset-failed of service snmp... Executing reset-failed of service swss... Executing reset-failed of service syncd... Executing reset-failed of service teamd... Executing reset-failed of service nat... Executing restart of service hostname-config... Executing restart of service interfaces-config... Executing restart of service ntp-config... Executing restart of service rsyslog-config... Executing restart of service swss... Executing restart of service bgp... Executing restart of service pmon... Executing restart of service lldp... Executing restart of service hostcfgd... Executing restart of service nat... Executing restart of service sflow... Please note setting loaded from minigraph will be lost after system reboot. To preserve setting, run `config save`. root@sonic:/var/core# root@sonic:/var/core# ls root@sonic:/var/core# config save Existing file will be overwritten, continue? [y/N]: y Running command: /usr/local/bin/sonic-cfggen -d --print-data > /etc/sonic/config_db.json root@sonic:/var/core# root@sonic:~# reboot requested COLD shutdown /var/log: 3.9 GiB (4117458944 bytes) trimmed /boot: 30 GiB (32148221952 bytes) trimmed Wed Apr 29 22:53:19 UTC 2020 Reb11, 32, 15, 00068001, 19, 00068000, ... ... ... Debian GNU/Linux 9 sonic-s5232-01 ttyS0 sonic-s5232-01 login: admin Password: Last login: Wed Apr 29 22:49:32 UTC 2020 on ttyS0 Linux sonic-s5232-01 4.9.0-11-2-amd64 #1 SMP Debian 4.9.189-3+deb9u2 (2019-11-11) x86_64 You are on ____ ___ _ _ _ ____ / ___| / _ \| \ | (_)/ ___| \___ \| | | | \| | | | ___) | |_| | |\ | | |___ |____/ \___/|_| \_|_|\____| -- Software for Open Networking in the Cloud -- Unauthorized access and/or use are prohibited. All access and/or use are subject to monitoring. Help: http://azure.github.io/SONiC/ admin@sonic-s5232-01:~$ sudo -i root@sonic-s5232-01:~# cd /var/core root@sonic-s5232-01:/var/core# ls syncd.1588200788.28.core.gz root@sonic-s5232-01:/var/core# root@sonic-s5232-01:/var/core# config reload -y Executing stop of service swss... Executing stop of service lldp... Executing stop of service pmon... Executing stop of service bgp... Executing stop of service hostcfgd... Executing stop of service nat... Running command: /usr/local/bin/sonic-cfggen -j /etc/sonic/init_cfg.json -j /etc/sonic/config_db.json --write-to-db Executing reset-failed of service bgp... Executing reset-failed of service dhcp_relay... Executing reset-failed of service hostcfgd... Executing reset-failed of service hostname-config... Executing reset-failed of service interfaces-config... Executing reset-failed of service lldp... Executing reset-failed of service ntp-config... Executing reset-failed of service pmon... Executing reset-failed of service radv... Executing reset-failed of service rsyslog-config... Executing reset-failed of service snmp... Executing reset-failed of service swss... Executing reset-failed of service syncd... Executing reset-failed of service teamd... Executing reset-failed of service nat... Executing restart of service hostname-config... Executing restart of service interfaces-config... Executing restart of service ntp-config... Executing restart of service rsyslog-config... Executing restart of service swss... Executing restart of service bgp... Executing restart of service pmon... Executing restart of service lldp... Executing restart of service hostcfgd... Executing restart of service nat... Executing restart of service sflow... root@sonic-s5232-01:/var/core# root@sonic-s5232-01:/var/core# ls syncd.1588200788.28.core.gz syncd.1588200962.28.core.gz root@sonic-s5232-01:/var/core# #### GDB TRACE root@sonic-s5232-01:~# docker exec -it syncd bash root@sonic-s5232-01:/# gdb /usr/bin/syncd syncd.1588200962.28.core GNU gdb (Debian 7.12-6) 7.12.0.20161007-git Copyright (C) 2016 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: . Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/bin/syncd...(no debugging symbols found)...done. [New LWP 28] [New LWP 38] [New LWP 31] [New LWP 32] [New LWP 33] [New LWP 61] [New LWP 40] [New LWP 48] [New LWP 46] [New LWP 51] [New LWP 55] [New LWP 52] [New LWP 72] [New LWP 58] [New LWP 75] [New LWP 60] [New LWP 57] [New LWP 56] [New LWP 45] [New LWP 41] [New LWP 88] [New LWP 37] [New LWP 73] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `/usr/bin/syncd --diag -u -p /etc/sai.d/sai.profile'. Program terminated with signal SIGABRT, Aborted. #0 0x00007f653e525fff in raise () from /lib/x86_64-linux-gnu/libc.so.6 [Current thread is 1 (Thread 0x7f6548364240 (LWP 28))] (gdb) (gdb) bt #0 0x00007f653e525fff in raise () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00007f653e52742a in abort () from /lib/x86_64-linux-gnu/libc.so.6 #2 0x00007f653e563c00 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #3 0x00007f653e569fc6 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #4 0x00007f653e56a80e in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #5 0x00007f6541806d2d in CHECK_FREE_CLEAR_SIZE () from /usr/lib/libsai.so.1 #6 0x00007f65418271a9 in _brcm_sai_indexed_data_free2 () from /usr/lib/libsai.so.1 #7 0x00007f65417e8d16 in _brcm_sai_free_hostif () from /usr/lib/libsai.so.1 #8 0x00007f654185194e in _brcm_sai_dm_fini () from /usr/lib/libsai.so.1 #9 0x00007f65417c53a3 in ?? () from /usr/lib/libsai.so.1 #10 0x000055ac4c69259a in ?? () #11 0x000055ac4c67f51e in ?? () #12 0x00007f653e5132e1 in __libc_start_main () from /lib/x86_64-linux-gnu/libc.so.6 #13 0x000055ac4c6804aa in ?? () (gdb)