Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

lib, zebra: Allow for interface deletion when kernel event happens #5009

Merged
merged 8 commits into from
Sep 30, 2019

Conversation

donaldsharp
Copy link
Member

When zebra gets a callback from the kernel that an interface has
actually been deleted and the end users has not configured
the interface, then allow for deletion of the interface from zebra.

This is especially important in a docker environment where containers
and their veth interfaces are treated as ephermeal. FRR can quickly
have an inordinate amount of interfaces sitting around that are
not in the kernel and we have no way to clean them up either.

My expectation is that this will cause a second order crashes
in upper level protocols, but I am not sure how to catch these
and fix them now ( suggestions welcome ). There are too many
use patterns and order based events that I cannot know for certain
that we are going to see any at all, until someone sees this problem
as a crash :( I do not recommend that this be put in the current
stabilization branch and allow this to soak in master for some time
first.

Testing:

sharpd@donna ~/frr4> sudo ip link add vethdj type veth peer name vethjd
sharpd@donna ~/frr4> sudo ip link add vethaa type veth peer name vethab
sharpd@donna ~/frr4> sudo vtysh -c "show int brief"
Interface Status VRF Addresses


dummy1 down default
enp0s3 up default 10.0.2.15/24
enp0s8 up default 192.168.209.2/24
enp0s9 up default 192.168.210.2/24
enp0s10 up default 192.168.212.4/24
lo up default 10.22.89.38/32
vethaa down default
vethab down default
vethdj down default
vethjd down default
virbr0 up default 192.168.122.1/24
virbr0-nic down default

sharpd@donna ~/frr4> sudo ip link set vethaa up
sharpd@donna ~/frr4> sudo ip link set vethab up
sharpd@donna ~/frr4> sudo ip link del vethdj
sharpd@donna ~/frr4> sudo vtysh -c "show int brief"
Interface Status VRF Addresses


dummy1 down default
enp0s3 up default 10.0.2.15/24
enp0s8 up default 192.168.209.2/24
enp0s9 up default 192.168.210.2/24
enp0s10 up default 192.168.212.4/24
lo up default 10.22.89.38/32
vethaa up default
vethab up default
virbr0 up default 192.168.122.1/24
virbr0-nic down default

sharpd@donna ~/frr4> sudo ip link del vethaa
sharpd@donna ~/frr4> sudo vtysh -c "show int brief"
Interface Status VRF Addresses


dummy1 down default
enp0s3 up default 10.0.2.15/24
enp0s8 up default 192.168.209.2/24
enp0s9 up default 192.168.210.2/24
enp0s10 up default 192.168.212.4/24
lo up default 10.22.89.38/32
virbr0 up default 192.168.122.1/24
virbr0-nic down default

sharpd@donna ~/frr4> sudo ip link add vethaa type veth peer name vethab
sharpd@donna ~/frr4> sudo vtysh -c "show int brief"
Interface Status VRF Addresses


dummy1 down default
enp0s3 up default 10.0.2.15/24
enp0s8 up default 192.168.209.2/24
enp0s9 up default 192.168.210.2/24
enp0s10 up default 192.168.212.4/24
lo up default 10.22.89.38/32
vethaa down default
vethab down default
virbr0 up default 192.168.122.1/24
virbr0-nic down default

sharpd@donna ~/frr4> sudo vtysh -c "show run"
Building configuration...

Current configuration:
!
frr version 7.2-dev
frr defaults datacenter
hostname donna.cumulusnetworks.com
log stdout
no ipv6 forwarding
!
ip route 192.168.3.0/24 192.168.209.1
ip route 192.168.4.0/24 blackhole
ip route 192.168.5.0/24 192.168.209.1
ip route 192.168.6.0/24 192.168.209.1
ip route 192.168.7.0/24 99.99.99.99 nexthop-vrf EVA
ip route 192.168.8.0/24 192.168.209.1
ip route 4.5.6.7/32 12.13.14.15
!
interface dummy1
ip address 12.13.14.15/32
!
interface vethaa
description FROO
!
line vty
!
end
sharpd@donna ~/frr4> sudo ip link del vethaa
sharpd@donna ~/frr4> sudo vtysh -c "show int brief"
Interface Status VRF Addresses


dummy1 down default
enp0s3 up default 10.0.2.15/24
enp0s8 up default 192.168.209.2/24
enp0s9 up default 192.168.210.2/24
enp0s10 up default 192.168.212.4/24
lo up default 10.22.89.38/32
vethaa down default
virbr0 up default 192.168.122.1/24
virbr0-nic down default

sharpd@donna ~/frr4> sudo vtysh -c "show run"
Building configuration...

Current configuration:
!
frr version 7.2-dev
frr defaults datacenter
hostname donna.cumulusnetworks.com
log stdout
no ipv6 forwarding
!
ip route 192.168.3.0/24 192.168.209.1
ip route 192.168.4.0/24 blackhole
ip route 192.168.5.0/24 192.168.209.1
ip route 192.168.6.0/24 192.168.209.1
ip route 192.168.7.0/24 99.99.99.99 nexthop-vrf EVA
ip route 192.168.8.0/24 192.168.209.1
ip route 4.5.6.7/32 12.13.14.15
!
interface dummy1
ip address 12.13.14.15/32
!
interface vethaa
description FROO
!
line vty
!
end

Signed-off-by: Donald Sharp sharpd@cumulusnetworks.com

@LabN-CI
Copy link
Collaborator

LabN-CI commented Sep 18, 2019

💚 Basic BGPD CI results: SUCCESS, 0 tests failed

Results table
_ _
Result SUCCESS git merge/5009 c9d4e5f
Date 09/18/2019
Start 14:05:22
Finish 14:27:09
Run-Time 21:47
Total 1815
Pass 1815
Fail 0
Valgrind-Errors 0
Valgrind-Loss 0
Details vncregress-2019-09-18-14:05:22.txt
Log autoscript-2019-09-18-14:06:11.log.bz2
Memory 417 410 360

For details, please contact louberger

@NetDEF-CI
Copy link
Collaborator

Continuous Integration Result: FAILED

See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8954/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Failed

Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-8954/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

*** defaultIntf: warning: r1 has no interfaces

r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 29225]
[New LWP 29226]
[New LWP 29227]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
[Current thread is 1 (Thread 0x7f87192c77c0 (LWP 29225))]
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f87184e7801 in __GI_abort () at abort.c:79
#2  0x00007f8718f14c24 in _zlog_assert_failed () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  0x00007f8718eed729 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#4  0x00007f8718f16b93 in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x000055d8b69c82ab in netlink_link_change ()
#6  0x000055d8b69cfd24 in netlink_parse_info ()
#7  0x000055d8b69d04e5 in ?? ()
#8  0x00007f8718f41ba6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f8718f12198 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x000055d8b69c384e in main ()
2019-09-18 19:31:34,083 ERROR: assert failed at "test_pim/test_memory_leak": 
r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 29225]
[New LWP 29226]
[New LWP 29227]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
[Current thread is 1 (Thread 0x7f87192c77c0 (LWP 29225))]
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f87184e7801 in __GI_abort () at abort.c:79
#2  0x00007f8718f14c24 in _zlog_assert_failed () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  0x00007f8718eed729 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#4  0x00007f8718f16b93 in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x000055d8b69c82ab in netlink_link_change ()
#6  0x000055d8b69cfd24 in netlink_parse_info ()
#7  0x000055d8b69d04e5 in ?? ()
#8  0x00007f8718f41ba6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f8718f12198 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x000055d8b69c384e in main ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8954/artifact/TOPOU1804/ErrorLog/log_topotests.txt

Topotest tests on Ubuntu 16.04 i386: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-8954/test

Topology Tests failed for Topotest tests on Ubuntu 16.04 i386:

RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
*** defaultIntf: warning: r1 has no interfaces
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument

r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 15060]
[New LWP 15073]
[New LWP 15062]
[New LWP 15061]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f14d05 in ?? ()
[Current thread is 1 (Thread 0xb78647c0 (LWP 15060))]
#0  0xb7f14d05 in ?? ()
#1  <signal handler called>
#2  musable (mem=0x118) at malloc.c:4589
#3  __malloc_usable_size (m=0x118) at malloc.c:4603
#4  0xb7e7b545 in qfree () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0x0049a6c0 in netlink_link_change ()
#6  0x004a20f7 in ?? ()
#7  0x004a29a7 in netlink_parse_info ()
#8  0x004a313a in ?? ()
#9  0xb7ea87a9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#10 0xb7e76be1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#11 0x00495a3f in main ()
2019-09-18 12:30:36,340 ERROR: assert failed at "test_pim/test_memory_leak": 
r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 15060]
[New LWP 15073]
[New LWP 15062]
[New LWP 15061]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f14d05 in ?? ()
[Current thread is 1 (Thread 0xb78647c0 (LWP 15060))]
#0  0xb7f14d05 in ?? ()
#1  <signal handler called>
#2  musable (mem=0x118) at malloc.c:4589
#3  __malloc_usable_size (m=0x118) at malloc.c:4603
#4  0xb7e7b545 in qfree () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0x0049a6c0 in netlink_link_change ()
#6  0x004a20f7 in ?? ()
#7  0x004a29a7 in netlink_parse_info ()
#8  0x004a313a in ?? ()
#9  0xb7ea87a9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#10 0xb7e76be1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#11 0x00495a3f in main ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8954/artifact/TOPOI386/ErrorLog/log_topotests.txt

Successful on other platforms
  • Static analyzer (clang)
  • IPv6 protocols on Ubuntu 14.04
  • Ubuntu 16.04 deb pkg check
  • Fedora 29 rpm pkg check
  • Ubuntu 12.04 deb pkg check
  • IPv4 ldp protocol on Ubuntu 16.04
  • Ubuntu 14.04 deb pkg check
  • Addresssanitizer topotest
  • Debian 8 deb pkg check
  • Debian 9 deb pkg check
  • Topology tests on Ubuntu 16.04 amd64
  • IPv4 protocols on Ubuntu 14.04
  • CentOS 7 rpm pkg check
  • Debian 10 deb pkg check

Topology Tests memory analysis: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8954/artifact/TOPOU1804/MemoryLeaks/
Topology Tests memory analysis: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8954/artifact/TOPOI386/MemoryLeaks/

Warnings Generated during build:

Checkout code: Successful with additional warnings
Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-8954/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

*** defaultIntf: warning: r1 has no interfaces

r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 29225]
[New LWP 29226]
[New LWP 29227]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
[Current thread is 1 (Thread 0x7f87192c77c0 (LWP 29225))]
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f87184e7801 in __GI_abort () at abort.c:79
#2  0x00007f8718f14c24 in _zlog_assert_failed () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  0x00007f8718eed729 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#4  0x00007f8718f16b93 in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x000055d8b69c82ab in netlink_link_change ()
#6  0x000055d8b69cfd24 in netlink_parse_info ()
#7  0x000055d8b69d04e5 in ?? ()
#8  0x00007f8718f41ba6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f8718f12198 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x000055d8b69c384e in main ()
2019-09-18 19:31:34,083 ERROR: assert failed at "test_pim/test_memory_leak": 
r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 29225]
[New LWP 29226]
[New LWP 29227]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
[Current thread is 1 (Thread 0x7f87192c77c0 (LWP 29225))]
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f87184e7801 in __GI_abort () at abort.c:79
#2  0x00007f8718f14c24 in _zlog_assert_failed () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  0x00007f8718eed729 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#4  0x00007f8718f16b93 in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x000055d8b69c82ab in netlink_link_change ()
#6  0x000055d8b69cfd24 in netlink_parse_info ()
#7  0x000055d8b69d04e5 in ?? ()
#8  0x00007f8718f41ba6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f8718f12198 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x000055d8b69c384e in main ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8954/artifact/TOPOU1804/ErrorLog/log_topotests.txt

Topotest tests on Ubuntu 16.04 i386: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-8954/test

Topology Tests failed for Topotest tests on Ubuntu 16.04 i386:

RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
*** defaultIntf: warning: r1 has no interfaces
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument

r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 15060]
[New LWP 15073]
[New LWP 15062]
[New LWP 15061]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f14d05 in ?? ()
[Current thread is 1 (Thread 0xb78647c0 (LWP 15060))]
#0  0xb7f14d05 in ?? ()
#1  <signal handler called>
#2  musable (mem=0x118) at malloc.c:4589
#3  __malloc_usable_size (m=0x118) at malloc.c:4603
#4  0xb7e7b545 in qfree () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0x0049a6c0 in netlink_link_change ()
#6  0x004a20f7 in ?? ()
#7  0x004a29a7 in netlink_parse_info ()
#8  0x004a313a in ?? ()
#9  0xb7ea87a9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#10 0xb7e76be1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#11 0x00495a3f in main ()
2019-09-18 12:30:36,340 ERROR: assert failed at "test_pim/test_memory_leak": 
r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 15060]
[New LWP 15073]
[New LWP 15062]
[New LWP 15061]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f14d05 in ?? ()
[Current thread is 1 (Thread 0xb78647c0 (LWP 15060))]
#0  0xb7f14d05 in ?? ()
#1  <signal handler called>
#2  musable (mem=0x118) at malloc.c:4589
#3  __malloc_usable_size (m=0x118) at malloc.c:4603
#4  0xb7e7b545 in qfree () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0x0049a6c0 in netlink_link_change ()
#6  0x004a20f7 in ?? ()
#7  0x004a29a7 in netlink_parse_info ()
#8  0x004a313a in ?? ()
#9  0xb7ea87a9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#10 0xb7e76be1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#11 0x00495a3f in main ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8954/artifact/TOPOI386/ErrorLog/log_topotests.txt

Report for if.c | 5 issues
===============================================
< WARNING: strncat() is error-prone; please use strlcat() if possible#864: FILE: /tmp/f1-15567/if.c:864:
---
> WARNING: strncat() is error-prone; please use strlcat() if possible#864: FILE: /tmp/f2-15567/if.c:864:
305c305
< #941: FILE: /tmp/f1-15567/if.c:941:

CLANG Static Analyzer Summary

  • Github Pull Request 5009, comparing to Git base SHA 0a0d4f9

No Changes in Static Analysis warnings compared to base

1 Static Analyzer issues remaining.

See details at
https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8954/artifact/shared/static_analysis/index.html

@LabN-CI
Copy link
Collaborator

LabN-CI commented Sep 19, 2019

💚 Basic BGPD CI results: SUCCESS, 0 tests failed

Results table
_ _
Result SUCCESS git merge/5009 c4ff9fa
Date 09/18/2019
Start 20:07:39
Finish 20:29:13
Run-Time 21:34
Total 1815
Pass 1815
Fail 0
Valgrind-Errors 0
Valgrind-Loss 0
Details vncregress-2019-09-18-20:07:39.txt
Log autoscript-2019-09-18-20:08:27.log.bz2
Memory 436 426 359

For details, please contact louberger

@NetDEF-CI
Copy link
Collaborator

Continuous Integration Result: SUCCESSFUL

Congratulations, this patch passed basic tests

Tested-by: NetDEF / OpenSourceRouting.org CI System

CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8959/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Warnings Generated during build:

Checkout code: Successful with additional warnings
Report for if.c | 7 issues
===============================================
< WARNING: missing space after struct definition
< #61: FILE: /tmp/f1-14725/if.c:61:
< WARNING: strncat() is error-prone; please use strlcat() if possible#871: FILE: /tmp/f1-14725/if.c:871:
---
> WARNING: strncat() is error-prone; please use strlcat() if possible#864: FILE: /tmp/f2-14725/if.c:864:
309c305
< #948: FILE: /tmp/f1-14725/if.c:948:

CLANG Static Analyzer Summary

  • Github Pull Request 5009, comparing to Git base SHA 0a0d4f9

No Changes in Static Analysis warnings compared to base

1 Static Analyzer issues remaining.

See details at
https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8959/artifact/shared/static_analysis/index.html

@LabN-CI
Copy link
Collaborator

LabN-CI commented Sep 19, 2019

💚 Basic BGPD CI results: SUCCESS, 0 tests failed

Results table
_ _
Result SUCCESS git merge/5009 cbe89e9
Date 09/19/2019
Start 00:40:54
Finish 01:02:31
Run-Time 21:37
Total 1815
Pass 1815
Fail 0
Valgrind-Errors 0
Valgrind-Loss 0
Details vncregress-2019-09-19-00:40:54.txt
Log autoscript-2019-09-19-00:41:43.log.bz2
Memory 429 428 360

For details, please contact louberger

@LabN-CI
Copy link
Collaborator

LabN-CI commented Sep 19, 2019

💚 Basic BGPD CI results: SUCCESS, 0 tests failed

Results table
_ _
Result SUCCESS git merge/5009 f7d0d20
Date 09/19/2019
Start 10:05:56
Finish 10:27:41
Run-Time 21:45
Total 1815
Pass 1815
Fail 0
Valgrind-Errors 0
Valgrind-Loss 0
Details vncregress-2019-09-19-10:05:56.txt
Log autoscript-2019-09-19-10:06:47.log.bz2
Memory 422 421 360

For details, please contact louberger

@LabN-CI
Copy link
Collaborator

LabN-CI commented Sep 19, 2019

💚 Basic BGPD CI results: SUCCESS, 0 tests failed

Results table
_ _
Result SUCCESS git merge/5009 734ea1d
Date 09/19/2019
Start 10:30:54
Finish 10:52:27
Run-Time 21:33
Total 1815
Pass 1815
Fail 0
Valgrind-Errors 0
Valgrind-Loss 0
Details vncregress-2019-09-19-10:30:54.txt
Log autoscript-2019-09-19-10:31:43.log.bz2
Memory 423 420 360

For details, please contact louberger

@LabN-CI
Copy link
Collaborator

LabN-CI commented Sep 19, 2019

💚 Basic BGPD CI results: SUCCESS, 0 tests failed

Results table
_ _
Result SUCCESS git merge/5009 796bb3c
Date 09/19/2019
Start 10:55:54
Finish 11:17:37
Run-Time 21:43
Total 1815
Pass 1815
Fail 0
Valgrind-Errors 0
Valgrind-Loss 0
Details vncregress-2019-09-19-10:55:54.txt
Log autoscript-2019-09-19-10:56:47.log.bz2
Memory 411 434 360

For details, please contact louberger

@NetDEF-CI
Copy link
Collaborator

Continuous Integration Result: FAILED

See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8960/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Failed

Fedora 29 rpm pkg check: Failed (click for details) Fedora 29 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8960/artifact/F29RPMCHECK/ErrorLog/log_package_start.txt Fedora 29 rpm pkg check: No useful log found
Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-8960/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

*** defaultIntf: warning: r1 has no interfaces
r1: Daemon eigrpd not running

r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16932]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f0cc3f3f801 in __GI_abort () at abort.c:79
#2  0x00007f0cc47819af in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000056180c4f12d9 in ?? ()
#5  0x00007f0cc47a1fec in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f0cc478efd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f0cc475f548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000056180c4e9782 in main ()

r2: Daemon eigrpd not running

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16972]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fb4621bd801 in __GI_abort () at abort.c:79
#2  0x00007fb4629ff9af in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055f16c7162d9 in ?? ()
#5  0x00007fb462a1ffec in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fb462a0cfd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fb4629dd548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055f16c70e782 in main ()

r3: Daemon eigrpd not running

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 17013]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fe07a816801 in __GI_abort () at abort.c:79
#2  0x00007fe07b0589af in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000056117b1ba2d9 in ?? ()
#5  0x00007fe07b078fec in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fe07b065fd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fe07b036548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000056117b1b2782 in main ()

2019-09-19 14:41:13,969 ERROR: assert failed at "test_eigrp_topo1/test_converge_protocols": r1: Daemon eigrpd not running
r2: Daemon eigrpd not running
r3: Daemon eigrpd not running


r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16932]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f0cc3f3f801 in __GI_abort () at abort.c:79
#2  0x00007f0cc47819af in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000056180c4f12d9 in ?? ()
#5  0x00007f0cc47a1fec in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f0cc478efd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f0cc475f548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000056180c4e9782 in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16972]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fb4621bd801 in __GI_abort () at abort.c:79
#2  0x00007fb4629ff9af in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055f16c7162d9 in ?? ()
#5  0x00007fb462a1ffec in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fb462a0cfd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fb4629dd548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055f16c70e782 in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 17013]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fe07a816801 in __GI_abort () at abort.c:79
#2  0x00007fe07b0589af in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000056117b1ba2d9 in ?? ()
#5  0x00007fe07b078fec in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fe07b065fd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fe07b036548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000056117b1b2782 in main ()
2019-09-19 14:41:20,727 ERROR: assert failed at "test_eigrp_topo1/test_shutdown_check_stderr": 
r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16932]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f0cc3f3f801 in __GI_abort () at abort.c:79
#2  0x00007f0cc47819af in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000056180c4f12d9 in ?? ()
#5  0x00007f0cc47a1fec in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f0cc478efd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f0cc475f548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000056180c4e9782 in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16972]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fb4621bd801 in __GI_abort () at abort.c:79
#2  0x00007fb4629ff9af in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055f16c7162d9 in ?? ()
#5  0x00007fb462a1ffec in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fb462a0cfd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fb4629dd548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055f16c70e782 in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 17013]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fe07a816801 in __GI_abort () at abort.c:79
#2  0x00007fe07b0589af in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000056117b1ba2d9 in ?? ()
#5  0x00007fe07b078fec in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fe07b065fd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fe07b036548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000056117b1b2782 in main ()

r1: Daemon ospfd not running

r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 19766]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f8d070e2801 in __GI_abort () at abort.c:79
#2  0x00007f8d070d239a in __assert_fail_base (fmt=0x7f8d072597d8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7f8d07b72dda "0", file=file@entry=0x7f8d07b722a9 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f8d07b72998 "stream_getl") at assert.c:92
#3  0x00007f8d070d2412 in __GI___assert_fail (assertion=0x7f8d07b72dda "0", file=0x7f8d07b722a9 "lib/stream.c", line=487, function=0x7f8d07b72998 "stream_getl") at assert.c:101
#4  0x00007f8d07b34f7c in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f8d07b4f41c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000557536151f76 in ?? ()
#7  0x000055753615204d in ?? ()
#8  0x00007f8d07b4ff18 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f8d07b3cfd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f8d07b0d548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x000055753614b649 in main ()

2019-09-19 14:45:32,224 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": r1: Daemon ospfd not running


r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 19766]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f8d070e2801 in __GI_abort () at abort.c:79
#2  0x00007f8d070d239a in __assert_fail_base (fmt=0x7f8d072597d8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7f8d07b72dda "0", file=file@entry=0x7f8d07b722a9 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f8d07b72998 "stream_getl") at assert.c:92
#3  0x00007f8d070d2412 in __GI___assert_fail (assertion=0x7f8d07b72dda "0", file=0x7f8d07b722a9 "lib/stream.c", line=487, function=0x7f8d07b72998 "stream_getl") at assert.c:101
#4  0x00007f8d07b34f7c in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f8d07b4f41c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000557536151f76 in ?? ()
#7  0x000055753615204d in ?? ()
#8  0x00007f8d07b4ff18 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f8d07b3cfd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f8d07b0d548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x000055753614b649 in main ()
2019-09-19 14:45:33,061 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": 
r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 19766]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f8d070e2801 in __GI_abort () at abort.c:79
#2  0x00007f8d070d239a in __assert_fail_base (fmt=0x7f8d072597d8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7f8d07b72dda "0", file=file@entry=0x7f8d07b722a9 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f8d07b72998 "stream_getl") at assert.c:92
#3  0x00007f8d070d2412 in __GI___assert_fail (assertion=0x7f8d07b72dda "0", file=0x7f8d07b722a9 "lib/stream.c", line=487, function=0x7f8d07b72998 "stream_getl") at assert.c:101
#4  0x00007f8d07b34f7c in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f8d07b4f41c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000557536151f76 in ?? ()
#7  0x000055753615204d in ?? ()
#8  0x00007f8d07b4ff18 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f8d07b3cfd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f8d07b0d548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x000055753614b649 in main ()


r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 25943]
[New LWP 25944]
[New LWP 25945]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
[Current thread is 1 (Thread 0x7f90e46d67c0 (LWP 25943))]
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f90e38f5801 in __GI_abort () at abort.c:79
#2  0x00007f90e4322fd4 in _zlog_assert_failed () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  0x00007f90e42fb8f9 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#4  0x00007f90e4324f43 in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x000055ca892202fb in netlink_link_change ()
#6  0x000055ca89227d84 in netlink_parse_info ()
#7  0x000055ca89228545 in ?? ()
#8  0x00007f90e434ffd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f90e4320548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x000055ca8921b89e in main ()
2019-09-19 14:51:44,797 ERROR: assert failed at "test_pim/test_memory_leak": 
r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 25943]
[New LWP 25944]
[New LWP 25945]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
[Current thread is 1 (Thread 0x7f90e46d67c0 (LWP 25943))]
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f90e38f5801 in __GI_abort () at abort.c:79
#2  0x00007f90e4322fd4 in _zlog_assert_failed () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  0x00007f90e42fb8f9 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#4  0x00007f90e4324f43 in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x000055ca892202fb in netlink_link_change ()
#6  0x000055ca89227d84 in netlink_parse_info ()
#7  0x000055ca89228545 in ?? ()
#8  0x00007f90e434ffd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f90e4320548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x000055ca8921b89e in main ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8960/artifact/TOPOU1804/ErrorLog/log_topotests.txt

Topotest tests on Ubuntu 16.04 i386: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-8960/test

Topology Tests failed for Topotest tests on Ubuntu 16.04 i386:

RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
*** defaultIntf: warning: r1 has no interfaces
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
r1: Daemon eigrpd not running

r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16779]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7eded05 in ?? ()
#0  0xb7eded05 in ?? ()
#1  <signal handler called>
#2  0x00425c33 in ?? ()
#3  0xb7e390b1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7e84d16 in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e72ac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e40f11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x0041dc1a in main ()

r2: Daemon eigrpd not running

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16819]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f97d05 in ?? ()
#0  0xb7f97d05 in ?? ()
#1  <signal handler called>
#2  0x00505c33 in ?? ()
#3  0xb7ef20b1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7f3dd16 in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7f2bac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7ef9f11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004fdc1a in main ()

r3: Daemon eigrpd not running

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16859]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f57d05 in ?? ()
#0  0xb7f57d05 in ?? ()
#1  <signal handler called>
#2  0x00411c33 in ?? ()
#3  0xb7eb20b1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7efdd16 in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7eebac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7eb9f11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00409c1a in main ()

2019-09-19 16:40:26,202 ERROR: assert failed at "test_eigrp_topo1/test_converge_protocols": r1: Daemon eigrpd not running
r2: Daemon eigrpd not running
r3: Daemon eigrpd not running


r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16779]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7eded05 in ?? ()
#0  0xb7eded05 in ?? ()
#1  <signal handler called>
#2  0x00425c33 in ?? ()
#3  0xb7e390b1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7e84d16 in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e72ac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e40f11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x0041dc1a in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16819]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f97d05 in ?? ()
#0  0xb7f97d05 in ?? ()
#1  <signal handler called>
#2  0x00505c33 in ?? ()
#3  0xb7ef20b1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7f3dd16 in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7f2bac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7ef9f11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004fdc1a in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16859]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f57d05 in ?? ()
#0  0xb7f57d05 in ?? ()
#1  <signal handler called>
#2  0x00411c33 in ?? ()
#3  0xb7eb20b1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7efdd16 in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7eebac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7eb9f11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00409c1a in main ()
2019-09-19 16:40:32,612 ERROR: assert failed at "test_eigrp_topo1/test_shutdown_check_stderr": 
r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16779]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7eded05 in ?? ()
#0  0xb7eded05 in ?? ()
#1  <signal handler called>
#2  0x00425c33 in ?? ()
#3  0xb7e390b1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7e84d16 in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e72ac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e40f11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x0041dc1a in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16819]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f97d05 in ?? ()
#0  0xb7f97d05 in ?? ()
#1  <signal handler called>
#2  0x00505c33 in ?? ()
#3  0xb7ef20b1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7f3dd16 in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7f2bac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7ef9f11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004fdc1a in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16859]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f57d05 in ?? ()
#0  0xb7f57d05 in ?? ()
#1  <signal handler called>
#2  0x00411c33 in ?? ()
#3  0xb7eb20b1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7efdd16 in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7eebac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7eb9f11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00409c1a in main ()

r1: Daemon ospfd not running

r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 20252]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f58d05 in ?? ()
#0  0xb7f58d05 in ?? ()
#1  0xb7efe246 in zebra_interface_if_set_value () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0x00454d37 in ?? ()
#3  0xb7eb30e2 in if_up_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7efec5a in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7eecac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7ebaf11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x0044e2a5 in main ()

2019-09-19 16:44:32,300 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": r1: Daemon ospfd not running


r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 20252]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f58d05 in ?? ()
#0  0xb7f58d05 in ?? ()
#1  0xb7efe246 in zebra_interface_if_set_value () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0x00454d37 in ?? ()
#3  0xb7eb30e2 in if_up_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7efec5a in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7eecac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7ebaf11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x0044e2a5 in main ()
2019-09-19 16:44:32,923 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": 
r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 20252]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f58d05 in ?? ()
#0  0xb7f58d05 in ?? ()
#1  0xb7efe246 in zebra_interface_if_set_value () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0x00454d37 in ?? ()
#3  0xb7eb30e2 in if_up_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7efec5a in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7eecac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7ebaf11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x0044e2a5 in main ()

RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument

r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 27052]
[New LWP 27054]
[New LWP 27053]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f98d05 in ?? ()
[Current thread is 1 (Thread 0xb78e87c0 (LWP 27052))]
#0  0xb7f98d05 in ?? ()
#1  0xb7ed53cf in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0xb7eff895 in qfree () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#3  0x0042e700 in netlink_link_change ()
#4  0x00436137 in ?? ()
#5  0x004369e7 in netlink_parse_info ()
#6  0x0043717a in ?? ()
#7  0xb7f2cac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#8  0xb7efaf11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#9  0x00429a7f in main ()
2019-09-19 16:50:45,132 ERROR: assert failed at "test_pim/test_memory_leak": 
r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 27052]
[New LWP 27054]
[New LWP 27053]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f98d05 in ?? ()
[Current thread is 1 (Thread 0xb78e87c0 (LWP 27052))]
#0  0xb7f98d05 in ?? ()
#1  0xb7ed53cf in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0xb7eff895 in qfree () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#3  0x0042e700 in netlink_link_change ()
#4  0x00436137 in ?? ()
#5  0x004369e7 in netlink_parse_info ()
#6  0x0043717a in ?? ()
#7  0xb7f2cac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#8  0xb7efaf11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#9  0x00429a7f in main ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8960/artifact/TOPOI386/ErrorLog/log_topotests.txt

CentOS 7 rpm pkg check: Failed (click for details) CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8960/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found
Topology tests on Ubuntu 16.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1604-8960/test

Topology Tests failed for Topology tests on Ubuntu 16.04 amd64:

*** defaultIntf: warning: r1 has no interfaces
r1: Daemon eigrpd not running

r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 22486]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f6f75570428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f6f75570428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f6f7557202a in __GI_abort () at abort.c:89
#2  0x00007f6f75d94520 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055c87bc2bdf9 in ?? ()
#5  0x00007f6f75db4d3c in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f6f75da1c20 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f6f75d71f18 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055c87bc24212 in main ()

r2: Daemon eigrpd not running

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 22526]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007ff8e9aed428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007ff8e9aed428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007ff8e9aef02a in __GI_abort () at abort.c:89
#2  0x00007ff8ea311520 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055dbf0c1fdf9 in ?? ()
#5  0x00007ff8ea331d3c in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007ff8ea31ec20 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007ff8ea2eef18 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055dbf0c18212 in main ()

r3: Daemon eigrpd not running

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 22566]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f5650dea428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f5650dea428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f5650dec02a in __GI_abort () at abort.c:89
#2  0x00007f565160e520 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x00005641ac119df9 in ?? ()
#5  0x00007f565162ed3c in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f565161bc20 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f56515ebf18 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x00005641ac112212 in main ()

2019-09-19 07:40:46,879 ERROR: assert failed at "test_eigrp_topo1/test_converge_protocols": r1: Daemon eigrpd not running
r2: Daemon eigrpd not running
r3: Daemon eigrpd not running


r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 22486]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f6f75570428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f6f75570428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f6f7557202a in __GI_abort () at abort.c:89
#2  0x00007f6f75d94520 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055c87bc2bdf9 in ?? ()
#5  0x00007f6f75db4d3c in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f6f75da1c20 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f6f75d71f18 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055c87bc24212 in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 22526]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007ff8e9aed428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007ff8e9aed428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007ff8e9aef02a in __GI_abort () at abort.c:89
#2  0x00007ff8ea311520 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055dbf0c1fdf9 in ?? ()
#5  0x00007ff8ea331d3c in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007ff8ea31ec20 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007ff8ea2eef18 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055dbf0c18212 in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 22566]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f5650dea428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f5650dea428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f5650dec02a in __GI_abort () at abort.c:89
#2  0x00007f565160e520 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x00005641ac119df9 in ?? ()
#5  0x00007f565162ed3c in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f565161bc20 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f56515ebf18 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x00005641ac112212 in main ()
2019-09-19 07:40:53,490 ERROR: assert failed at "test_eigrp_topo1/test_shutdown_check_stderr": 
r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 22486]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f6f75570428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f6f75570428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f6f7557202a in __GI_abort () at abort.c:89
#2  0x00007f6f75d94520 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055c87bc2bdf9 in ?? ()
#5  0x00007f6f75db4d3c in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f6f75da1c20 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f6f75d71f18 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055c87bc24212 in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 22526]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007ff8e9aed428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007ff8e9aed428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007ff8e9aef02a in __GI_abort () at abort.c:89
#2  0x00007ff8ea311520 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055dbf0c1fdf9 in ?? ()
#5  0x00007ff8ea331d3c in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007ff8ea31ec20 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007ff8ea2eef18 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055dbf0c18212 in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 22566]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f5650dea428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f5650dea428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f5650dec02a in __GI_abort () at abort.c:89
#2  0x00007f565160e520 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x00005641ac119df9 in ?? ()
#5  0x00007f565162ed3c in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f565161bc20 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f56515ebf18 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x00005641ac112212 in main ()

r1: Daemon ospfd not running

r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 25888]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f5c6bc6c428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f5c6bc6c428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f5c6bc6e02a in __GI_abort () at abort.c:89
#2  0x00007f5c6bc64bd7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7f5c6c6de75a "0", file=file@entry=0x7f5c6c6ddc29 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f5c6c6de318 "stream_getl") at assert.c:92
#3  0x00007f5c6bc64c82 in __GI___assert_fail (assertion=0x7f5c6c6de75a "0", file=0x7f5c6c6ddc29 "lib/stream.c", line=487, function=0x7f5c6c6de318 "stream_getl") at assert.c:101
#4  0x00007f5c6c6a0bda in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f5c6c6bb11c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x000055b859c205c6 in ?? ()
#7  0x000055b859c2067d in ?? ()
#8  0x00007f5c6c6bbc68 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f5c6c6a8c20 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f5c6c678f18 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x000055b859c19ff9 in main ()

2019-09-19 07:45:08,215 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": r1: Daemon ospfd not running


r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 25888]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f5c6bc6c428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f5c6bc6c428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f5c6bc6e02a in __GI_abort () at abort.c:89
#2  0x00007f5c6bc64bd7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7f5c6c6de75a "0", file=file@entry=0x7f5c6c6ddc29 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f5c6c6de318 "stream_getl") at assert.c:92
#3  0x00007f5c6bc64c82 in __GI___assert_fail (assertion=0x7f5c6c6de75a "0", file=0x7f5c6c6ddc29 "lib/stream.c", line=487, function=0x7f5c6c6de318 "stream_getl") at assert.c:101
#4  0x00007f5c6c6a0bda in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f5c6c6bb11c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x000055b859c205c6 in ?? ()
#7  0x000055b859c2067d in ?? ()
#8  0x00007f5c6c6bbc68 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f5c6c6a8c20 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f5c6c678f18 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x000055b859c19ff9 in main ()
2019-09-19 07:45:08,978 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": 
r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 25888]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f5c6bc6c428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f5c6bc6c428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f5c6bc6e02a in __GI_abort () at abort.c:89
#2  0x00007f5c6bc64bd7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7f5c6c6de75a "0", file=file@entry=0x7f5c6c6ddc29 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f5c6c6de318 "stream_getl") at assert.c:92
#3  0x00007f5c6bc64c82 in __GI___assert_fail (assertion=0x7f5c6c6de75a "0", file=0x7f5c6c6ddc29 "lib/stream.c", line=487, function=0x7f5c6c6de318 "stream_getl") at assert.c:101
#4  0x00007f5c6c6a0bda in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f5c6c6bb11c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x000055b859c205c6 in ?? ()
#7  0x000055b859c2067d in ?? ()
#8  0x00007f5c6c6bbc68 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f5c6c6a8c20 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f5c6c678f18 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x000055b859c19ff9 in main ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8960/artifact/TOPOU1604/ErrorLog/log_topotests.txt

Successful on other platforms
  • Debian 9 deb pkg check
  • Ubuntu 12.04 deb pkg check
  • Static analyzer (clang)
  • Ubuntu 16.04 deb pkg check
  • IPv6 protocols on Ubuntu 14.04
  • Debian 10 deb pkg check
  • IPv4 ldp protocol on Ubuntu 16.04
  • Ubuntu 14.04 deb pkg check
  • Addresssanitizer topotest
  • Debian 8 deb pkg check
  • IPv4 protocols on Ubuntu 14.04

Topology Tests memory analysis: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8960/artifact/TOPOU1804/MemoryLeaks/
Topology Tests memory analysis: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8960/artifact/TOPOI386/MemoryLeaks/
Topology Tests memory analysis: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8960/artifact/TOPOU1604/MemoryLeaks/

Warnings Generated during build:

Checkout code: Successful with additional warnings
Fedora 29 rpm pkg check: Failed (click for details) Fedora 29 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8960/artifact/F29RPMCHECK/ErrorLog/log_package_start.txt Fedora 29 rpm pkg check: No useful log found
Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-8960/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

*** defaultIntf: warning: r1 has no interfaces
r1: Daemon eigrpd not running

r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16932]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f0cc3f3f801 in __GI_abort () at abort.c:79
#2  0x00007f0cc47819af in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000056180c4f12d9 in ?? ()
#5  0x00007f0cc47a1fec in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f0cc478efd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f0cc475f548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000056180c4e9782 in main ()

r2: Daemon eigrpd not running

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16972]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fb4621bd801 in __GI_abort () at abort.c:79
#2  0x00007fb4629ff9af in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055f16c7162d9 in ?? ()
#5  0x00007fb462a1ffec in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fb462a0cfd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fb4629dd548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055f16c70e782 in main ()

r3: Daemon eigrpd not running

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 17013]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fe07a816801 in __GI_abort () at abort.c:79
#2  0x00007fe07b0589af in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000056117b1ba2d9 in ?? ()
#5  0x00007fe07b078fec in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fe07b065fd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fe07b036548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000056117b1b2782 in main ()

2019-09-19 14:41:13,969 ERROR: assert failed at "test_eigrp_topo1/test_converge_protocols": r1: Daemon eigrpd not running
r2: Daemon eigrpd not running
r3: Daemon eigrpd not running


r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16932]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f0cc3f3f801 in __GI_abort () at abort.c:79
#2  0x00007f0cc47819af in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000056180c4f12d9 in ?? ()
#5  0x00007f0cc47a1fec in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f0cc478efd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f0cc475f548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000056180c4e9782 in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16972]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fb4621bd801 in __GI_abort () at abort.c:79
#2  0x00007fb4629ff9af in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055f16c7162d9 in ?? ()
#5  0x00007fb462a1ffec in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fb462a0cfd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fb4629dd548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055f16c70e782 in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 17013]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fe07a816801 in __GI_abort () at abort.c:79
#2  0x00007fe07b0589af in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000056117b1ba2d9 in ?? ()
#5  0x00007fe07b078fec in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fe07b065fd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fe07b036548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000056117b1b2782 in main ()
2019-09-19 14:41:20,727 ERROR: assert failed at "test_eigrp_topo1/test_shutdown_check_stderr": 
r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16932]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f0cc3f3f801 in __GI_abort () at abort.c:79
#2  0x00007f0cc47819af in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000056180c4f12d9 in ?? ()
#5  0x00007f0cc47a1fec in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f0cc478efd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f0cc475f548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000056180c4e9782 in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16972]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fb4621bd801 in __GI_abort () at abort.c:79
#2  0x00007fb4629ff9af in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055f16c7162d9 in ?? ()
#5  0x00007fb462a1ffec in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fb462a0cfd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fb4629dd548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055f16c70e782 in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 17013]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fe07a816801 in __GI_abort () at abort.c:79
#2  0x00007fe07b0589af in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000056117b1ba2d9 in ?? ()
#5  0x00007fe07b078fec in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fe07b065fd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fe07b036548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000056117b1b2782 in main ()

r1: Daemon ospfd not running

r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 19766]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f8d070e2801 in __GI_abort () at abort.c:79
#2  0x00007f8d070d239a in __assert_fail_base (fmt=0x7f8d072597d8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7f8d07b72dda "0", file=file@entry=0x7f8d07b722a9 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f8d07b72998 "stream_getl") at assert.c:92
#3  0x00007f8d070d2412 in __GI___assert_fail (assertion=0x7f8d07b72dda "0", file=0x7f8d07b722a9 "lib/stream.c", line=487, function=0x7f8d07b72998 "stream_getl") at assert.c:101
#4  0x00007f8d07b34f7c in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f8d07b4f41c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000557536151f76 in ?? ()
#7  0x000055753615204d in ?? ()
#8  0x00007f8d07b4ff18 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f8d07b3cfd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f8d07b0d548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x000055753614b649 in main ()

2019-09-19 14:45:32,224 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": r1: Daemon ospfd not running


r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 19766]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f8d070e2801 in __GI_abort () at abort.c:79
#2  0x00007f8d070d239a in __assert_fail_base (fmt=0x7f8d072597d8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7f8d07b72dda "0", file=file@entry=0x7f8d07b722a9 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f8d07b72998 "stream_getl") at assert.c:92
#3  0x00007f8d070d2412 in __GI___assert_fail (assertion=0x7f8d07b72dda "0", file=0x7f8d07b722a9 "lib/stream.c", line=487, function=0x7f8d07b72998 "stream_getl") at assert.c:101
#4  0x00007f8d07b34f7c in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f8d07b4f41c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000557536151f76 in ?? ()
#7  0x000055753615204d in ?? ()
#8  0x00007f8d07b4ff18 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f8d07b3cfd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f8d07b0d548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x000055753614b649 in main ()
2019-09-19 14:45:33,061 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": 
r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 19766]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f8d070e2801 in __GI_abort () at abort.c:79
#2  0x00007f8d070d239a in __assert_fail_base (fmt=0x7f8d072597d8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7f8d07b72dda "0", file=file@entry=0x7f8d07b722a9 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f8d07b72998 "stream_getl") at assert.c:92
#3  0x00007f8d070d2412 in __GI___assert_fail (assertion=0x7f8d07b72dda "0", file=0x7f8d07b722a9 "lib/stream.c", line=487, function=0x7f8d07b72998 "stream_getl") at assert.c:101
#4  0x00007f8d07b34f7c in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f8d07b4f41c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000557536151f76 in ?? ()
#7  0x000055753615204d in ?? ()
#8  0x00007f8d07b4ff18 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f8d07b3cfd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f8d07b0d548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x000055753614b649 in main ()


r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 25943]
[New LWP 25944]
[New LWP 25945]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
[Current thread is 1 (Thread 0x7f90e46d67c0 (LWP 25943))]
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f90e38f5801 in __GI_abort () at abort.c:79
#2  0x00007f90e4322fd4 in _zlog_assert_failed () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  0x00007f90e42fb8f9 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#4  0x00007f90e4324f43 in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x000055ca892202fb in netlink_link_change ()
#6  0x000055ca89227d84 in netlink_parse_info ()
#7  0x000055ca89228545 in ?? ()
#8  0x00007f90e434ffd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f90e4320548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x000055ca8921b89e in main ()
2019-09-19 14:51:44,797 ERROR: assert failed at "test_pim/test_memory_leak": 
r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 25943]
[New LWP 25944]
[New LWP 25945]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
[Current thread is 1 (Thread 0x7f90e46d67c0 (LWP 25943))]
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f90e38f5801 in __GI_abort () at abort.c:79
#2  0x00007f90e4322fd4 in _zlog_assert_failed () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  0x00007f90e42fb8f9 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#4  0x00007f90e4324f43 in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x000055ca892202fb in netlink_link_change ()
#6  0x000055ca89227d84 in netlink_parse_info ()
#7  0x000055ca89228545 in ?? ()
#8  0x00007f90e434ffd6 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f90e4320548 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x000055ca8921b89e in main ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8960/artifact/TOPOU1804/ErrorLog/log_topotests.txt

Topotest tests on Ubuntu 16.04 i386: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-8960/test

Topology Tests failed for Topotest tests on Ubuntu 16.04 i386:

RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
*** defaultIntf: warning: r1 has no interfaces
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
r1: Daemon eigrpd not running

r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16779]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7eded05 in ?? ()
#0  0xb7eded05 in ?? ()
#1  <signal handler called>
#2  0x00425c33 in ?? ()
#3  0xb7e390b1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7e84d16 in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e72ac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e40f11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x0041dc1a in main ()

r2: Daemon eigrpd not running

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16819]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f97d05 in ?? ()
#0  0xb7f97d05 in ?? ()
#1  <signal handler called>
#2  0x00505c33 in ?? ()
#3  0xb7ef20b1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7f3dd16 in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7f2bac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7ef9f11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004fdc1a in main ()

r3: Daemon eigrpd not running

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16859]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f57d05 in ?? ()
#0  0xb7f57d05 in ?? ()
#1  <signal handler called>
#2  0x00411c33 in ?? ()
#3  0xb7eb20b1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7efdd16 in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7eebac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7eb9f11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00409c1a in main ()

2019-09-19 16:40:26,202 ERROR: assert failed at "test_eigrp_topo1/test_converge_protocols": r1: Daemon eigrpd not running
r2: Daemon eigrpd not running
r3: Daemon eigrpd not running


r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16779]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7eded05 in ?? ()
#0  0xb7eded05 in ?? ()
#1  <signal handler called>
#2  0x00425c33 in ?? ()
#3  0xb7e390b1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7e84d16 in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e72ac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e40f11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x0041dc1a in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16819]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f97d05 in ?? ()
#0  0xb7f97d05 in ?? ()
#1  <signal handler called>
#2  0x00505c33 in ?? ()
#3  0xb7ef20b1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7f3dd16 in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7f2bac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7ef9f11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004fdc1a in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16859]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f57d05 in ?? ()
#0  0xb7f57d05 in ?? ()
#1  <signal handler called>
#2  0x00411c33 in ?? ()
#3  0xb7eb20b1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7efdd16 in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7eebac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7eb9f11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00409c1a in main ()
2019-09-19 16:40:32,612 ERROR: assert failed at "test_eigrp_topo1/test_shutdown_check_stderr": 
r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16779]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7eded05 in ?? ()
#0  0xb7eded05 in ?? ()
#1  <signal handler called>
#2  0x00425c33 in ?? ()
#3  0xb7e390b1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7e84d16 in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e72ac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e40f11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x0041dc1a in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16819]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f97d05 in ?? ()
#0  0xb7f97d05 in ?? ()
#1  <signal handler called>
#2  0x00505c33 in ?? ()
#3  0xb7ef20b1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7f3dd16 in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7f2bac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7ef9f11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004fdc1a in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 16859]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f57d05 in ?? ()
#0  0xb7f57d05 in ?? ()
#1  <signal handler called>
#2  0x00411c33 in ?? ()
#3  0xb7eb20b1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7efdd16 in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7eebac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7eb9f11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00409c1a in main ()

r1: Daemon ospfd not running

r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 20252]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f58d05 in ?? ()
#0  0xb7f58d05 in ?? ()
#1  0xb7efe246 in zebra_interface_if_set_value () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0x00454d37 in ?? ()
#3  0xb7eb30e2 in if_up_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7efec5a in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7eecac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7ebaf11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x0044e2a5 in main ()

2019-09-19 16:44:32,300 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": r1: Daemon ospfd not running


r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 20252]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f58d05 in ?? ()
#0  0xb7f58d05 in ?? ()
#1  0xb7efe246 in zebra_interface_if_set_value () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0x00454d37 in ?? ()
#3  0xb7eb30e2 in if_up_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7efec5a in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7eecac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7ebaf11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x0044e2a5 in main ()
2019-09-19 16:44:32,923 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": 
r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 20252]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f58d05 in ?? ()
#0  0xb7f58d05 in ?? ()
#1  0xb7efe246 in zebra_interface_if_set_value () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0x00454d37 in ?? ()
#3  0xb7eb30e2 in if_up_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7efec5a in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7eecac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7ebaf11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x0044e2a5 in main ()

RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument

r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 27052]
[New LWP 27054]
[New LWP 27053]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f98d05 in ?? ()
[Current thread is 1 (Thread 0xb78e87c0 (LWP 27052))]
#0  0xb7f98d05 in ?? ()
#1  0xb7ed53cf in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0xb7eff895 in qfree () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#3  0x0042e700 in netlink_link_change ()
#4  0x00436137 in ?? ()
#5  0x004369e7 in netlink_parse_info ()
#6  0x0043717a in ?? ()
#7  0xb7f2cac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#8  0xb7efaf11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#9  0x00429a7f in main ()
2019-09-19 16:50:45,132 ERROR: assert failed at "test_pim/test_memory_leak": 
r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 27052]
[New LWP 27054]
[New LWP 27053]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f98d05 in ?? ()
[Current thread is 1 (Thread 0xb78e87c0 (LWP 27052))]
#0  0xb7f98d05 in ?? ()
#1  0xb7ed53cf in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0xb7eff895 in qfree () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#3  0x0042e700 in netlink_link_change ()
#4  0x00436137 in ?? ()
#5  0x004369e7 in netlink_parse_info ()
#6  0x0043717a in ?? ()
#7  0xb7f2cac9 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#8  0xb7efaf11 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#9  0x00429a7f in main ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8960/artifact/TOPOI386/ErrorLog/log_topotests.txt

CentOS 7 rpm pkg check: Failed (click for details) CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8960/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found
Topology tests on Ubuntu 16.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1604-8960/test

Topology Tests failed for Topology tests on Ubuntu 16.04 amd64:

*** defaultIntf: warning: r1 has no interfaces
r1: Daemon eigrpd not running

r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 22486]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f6f75570428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f6f75570428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f6f7557202a in __GI_abort () at abort.c:89
#2  0x00007f6f75d94520 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055c87bc2bdf9 in ?? ()
#5  0x00007f6f75db4d3c in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f6f75da1c20 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f6f75d71f18 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055c87bc24212 in main ()

r2: Daemon eigrpd not running

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 22526]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007ff8e9aed428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007ff8e9aed428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007ff8e9aef02a in __GI_abort () at abort.c:89
#2  0x00007ff8ea311520 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055dbf0c1fdf9 in ?? ()
#5  0x00007ff8ea331d3c in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007ff8ea31ec20 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007ff8ea2eef18 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055dbf0c18212 in main ()

r3: Daemon eigrpd not running

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 22566]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f5650dea428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f5650dea428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f5650dec02a in __GI_abort () at abort.c:89
#2  0x00007f565160e520 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x00005641ac119df9 in ?? ()
#5  0x00007f565162ed3c in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f565161bc20 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f56515ebf18 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x00005641ac112212 in main ()

2019-09-19 07:40:46,879 ERROR: assert failed at "test_eigrp_topo1/test_converge_protocols": r1: Daemon eigrpd not running
r2: Daemon eigrpd not running
r3: Daemon eigrpd not running


r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 22486]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f6f75570428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f6f75570428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f6f7557202a in __GI_abort () at abort.c:89
#2  0x00007f6f75d94520 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055c87bc2bdf9 in ?? ()
#5  0x00007f6f75db4d3c in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f6f75da1c20 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f6f75d71f18 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055c87bc24212 in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 22526]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007ff8e9aed428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007ff8e9aed428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007ff8e9aef02a in __GI_abort () at abort.c:89
#2  0x00007ff8ea311520 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055dbf0c1fdf9 in ?? ()
#5  0x00007ff8ea331d3c in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007ff8ea31ec20 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007ff8ea2eef18 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055dbf0c18212 in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 22566]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f5650dea428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f5650dea428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f5650dec02a in __GI_abort () at abort.c:89
#2  0x00007f565160e520 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x00005641ac119df9 in ?? ()
#5  0x00007f565162ed3c in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f565161bc20 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f56515ebf18 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x00005641ac112212 in main ()
2019-09-19 07:40:53,490 ERROR: assert failed at "test_eigrp_topo1/test_shutdown_check_stderr": 
r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 22486]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f6f75570428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f6f75570428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f6f7557202a in __GI_abort () at abort.c:89
#2  0x00007f6f75d94520 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055c87bc2bdf9 in ?? ()
#5  0x00007f6f75db4d3c in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f6f75da1c20 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f6f75d71f18 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055c87bc24212 in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 22526]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007ff8e9aed428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007ff8e9aed428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007ff8e9aef02a in __GI_abort () at abort.c:89
#2  0x00007ff8ea311520 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055dbf0c1fdf9 in ?? ()
#5  0x00007ff8ea331d3c in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007ff8ea31ec20 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007ff8ea2eef18 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055dbf0c18212 in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 22566]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f5650dea428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f5650dea428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f5650dec02a in __GI_abort () at abort.c:89
#2  0x00007f565160e520 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x00005641ac119df9 in ?? ()
#5  0x00007f565162ed3c in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f565161bc20 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f56515ebf18 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x00005641ac112212 in main ()

r1: Daemon ospfd not running

r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 25888]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f5c6bc6c428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f5c6bc6c428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f5c6bc6e02a in __GI_abort () at abort.c:89
#2  0x00007f5c6bc64bd7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7f5c6c6de75a "0", file=file@entry=0x7f5c6c6ddc29 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f5c6c6de318 "stream_getl") at assert.c:92
#3  0x00007f5c6bc64c82 in __GI___assert_fail (assertion=0x7f5c6c6de75a "0", file=0x7f5c6c6ddc29 "lib/stream.c", line=487, function=0x7f5c6c6de318 "stream_getl") at assert.c:101
#4  0x00007f5c6c6a0bda in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f5c6c6bb11c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x000055b859c205c6 in ?? ()
#7  0x000055b859c2067d in ?? ()
#8  0x00007f5c6c6bbc68 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f5c6c6a8c20 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f5c6c678f18 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x000055b859c19ff9 in main ()

2019-09-19 07:45:08,215 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": r1: Daemon ospfd not running


r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 25888]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f5c6bc6c428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f5c6bc6c428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f5c6bc6e02a in __GI_abort () at abort.c:89
#2  0x00007f5c6bc64bd7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7f5c6c6de75a "0", file=file@entry=0x7f5c6c6ddc29 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f5c6c6de318 "stream_getl") at assert.c:92
#3  0x00007f5c6bc64c82 in __GI___assert_fail (assertion=0x7f5c6c6de75a "0", file=0x7f5c6c6ddc29 "lib/stream.c", line=487, function=0x7f5c6c6de318 "stream_getl") at assert.c:101
#4  0x00007f5c6c6a0bda in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f5c6c6bb11c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x000055b859c205c6 in ?? ()
#7  0x000055b859c2067d in ?? ()
#8  0x00007f5c6c6bbc68 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f5c6c6a8c20 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f5c6c678f18 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x000055b859c19ff9 in main ()
2019-09-19 07:45:08,978 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": 
r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 25888]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f5c6bc6c428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f5c6bc6c428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f5c6bc6e02a in __GI_abort () at abort.c:89
#2  0x00007f5c6bc64bd7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7f5c6c6de75a "0", file=file@entry=0x7f5c6c6ddc29 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f5c6c6de318 "stream_getl") at assert.c:92
#3  0x00007f5c6bc64c82 in __GI___assert_fail (assertion=0x7f5c6c6de75a "0", file=0x7f5c6c6ddc29 "lib/stream.c", line=487, function=0x7f5c6c6de318 "stream_getl") at assert.c:101
#4  0x00007f5c6c6a0bda in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f5c6c6bb11c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x000055b859c205c6 in ?? ()
#7  0x000055b859c2067d in ?? ()
#8  0x00007f5c6c6bbc68 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f5c6c6a8c20 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f5c6c678f18 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x000055b859c19ff9 in main ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8960/artifact/TOPOU1604/ErrorLog/log_topotests.txt

<stdin>:45: trailing whitespace.
    
warning: 1 line adds whitespace errors.
Report for eigrp_interface.c | 6 issues
===============================================
< WARNING: Missing a blank line after declarations
< #143: FILE: /tmp/f1-28490/eigrp_interface.c:143:
< WARNING: C99 // comments do not match recommendation
< #156: FILE: /tmp/f1-28490/eigrp_interface.c:156:
< WARNING: Block comments use a trailing */ on a separate line
< #166: FILE: /tmp/f1-28490/eigrp_interface.c:166:
Report for if.c | 7 issues
===============================================
< WARNING: missing space after struct definition
< #61: FILE: /tmp/f1-28490/if.c:61:
< WARNING: strncat() is error-prone; please use strlcat() if possible#886: FILE: /tmp/f1-28490/if.c:886:
---
> WARNING: strncat() is error-prone; please use strlcat() if possible#861: FILE: /tmp/f2-28490/if.c:861:
309c305
< #963: FILE: /tmp/f1-28490/if.c:963:
Report for ospf6_interface.c | 4 issues
===============================================
< WARNING: quoted string split across lines
< #1954: FILE: /tmp/f1-28490/ospf6_interface.c:1954:
< WARNING: quoted string split across lines
< #1968: FILE: /tmp/f1-28490/ospf6_interface.c:1968:
Report for ospf_interface.c | 10 issues
===============================================
< ERROR: "foo * bar" should be "foo *bar"
< #53: FILE: /tmp/f1-28490/ospf_interface.c:53:
< WARNING: Missing a blank line after declarations
< #1269: FILE: /tmp/f1-28490/ospf_interface.c:1269:
< WARNING: Block comments use a trailing */ on a separate line
< #1288: FILE: /tmp/f1-28490/ospf_interface.c:1288:
< ERROR: do not use assignment in if condition
< #1301: FILE: /tmp/f1-28490/ospf_interface.c:1301:
< ERROR: do not use assignment in if condition
< #1320: FILE: /tmp/f1-28490/ospf_interface.c:1320:
Report for ospf_interface.h | 2 issues
===============================================
< ERROR: "foo * bar" should be "foo *bar"
< #329: FILE: /tmp/f1-28490/ospf_interface.h:329:
Report for pim_iface.c | 10 issues
===============================================
< WARNING: Block comments use * on subsequent lines
< #1609: FILE: /tmp/f1-28490/pim_iface.c:1609:
< WARNING: Missing a blank line after declarations
< #1621: FILE: /tmp/f1-28490/pim_iface.c:1621:
< WARNING: Block comments use * on subsequent lines
< #1653: FILE: /tmp/f1-28490/pim_iface.c:1653:
< WARNING: Block comments use * on subsequent lines
< #1659: FILE: /tmp/f1-28490/pim_iface.c:1659:
< WARNING: braces {} are not necessary for single statement blocks
< #1663: FILE: /tmp/f1-28490/pim_iface.c:1663:

CLANG Static Analyzer Summary

  • Github Pull Request 5009, comparing to Git base SHA 16296be

No Changes in Static Analysis warnings compared to base

1 Static Analyzer issues remaining.

See details at
https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8960/artifact/shared/static_analysis/index.html

@NetDEF-CI
Copy link
Collaborator

Continuous Integration Result: FAILED

See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8961/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Failed

Fedora 29 rpm pkg check: Failed (click for details) Fedora 29 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8961/artifact/F29RPMCHECK/ErrorLog/log_package_start.txt Fedora 29 rpm pkg check: No useful log found
IPv4 protocols on Ubuntu 14.04: Failed (click for details)

RFC Compliance Test ANVL-OSPF-3.1 failing:
Test Summary
This routing table entry then provides the outgoing interface
and next hop router to use in forwarding the packet.
(NOTE: Here we are testing the DUT forwards IP packet to the
correct interface and next hop based on an entry in the
OSPF routing table.)
Test Reference
RFC 1583, s11.1 p96 Routing table lookup
RFC 2328, s11.1 p111 Routing table lookup
Test Classification
MUST
Test ANVL-OSPF-3.1: !FAILED!
Expected to receive IP packet but did not

Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-8961/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

*** defaultIntf: warning: r1 has no interfaces
r1: Daemon eigrpd not running

r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21871]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007faa897f8801 in __GI_abort () at abort.c:79
#2  0x00007faa8a03aa2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000560ff954a219 in ?? ()
#5  0x00007faa8a05b064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007faa8a048056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007faa8a0185c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000560ff95426d2 in main ()

r2: Daemon eigrpd not running

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21911]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f6124134801 in __GI_abort () at abort.c:79
#2  0x00007f6124976a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x00005598c2857219 in ?? ()
#5  0x00007f6124997064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f6124984056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f61249545c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x00005598c284f6d2 in main ()

r3: Daemon eigrpd not running

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21951]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fadccda0801 in __GI_abort () at abort.c:79
#2  0x00007fadcd5e2a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055b75483f219 in ?? ()
#5  0x00007fadcd603064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fadcd5f0056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fadcd5c05c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055b7548376d2 in main ()

2019-09-19 14:56:07,656 ERROR: assert failed at "test_eigrp_topo1/test_converge_protocols": r1: Daemon eigrpd not running
r2: Daemon eigrpd not running
r3: Daemon eigrpd not running


r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21871]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007faa897f8801 in __GI_abort () at abort.c:79
#2  0x00007faa8a03aa2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000560ff954a219 in ?? ()
#5  0x00007faa8a05b064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007faa8a048056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007faa8a0185c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000560ff95426d2 in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21911]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f6124134801 in __GI_abort () at abort.c:79
#2  0x00007f6124976a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x00005598c2857219 in ?? ()
#5  0x00007f6124997064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f6124984056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f61249545c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x00005598c284f6d2 in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21951]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fadccda0801 in __GI_abort () at abort.c:79
#2  0x00007fadcd5e2a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055b75483f219 in ?? ()
#5  0x00007fadcd603064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fadcd5f0056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fadcd5c05c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055b7548376d2 in main ()
2019-09-19 14:56:14,455 ERROR: assert failed at "test_eigrp_topo1/test_shutdown_check_stderr": 
r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21871]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007faa897f8801 in __GI_abort () at abort.c:79
#2  0x00007faa8a03aa2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000560ff954a219 in ?? ()
#5  0x00007faa8a05b064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007faa8a048056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007faa8a0185c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000560ff95426d2 in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21911]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f6124134801 in __GI_abort () at abort.c:79
#2  0x00007f6124976a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x00005598c2857219 in ?? ()
#5  0x00007f6124997064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f6124984056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f61249545c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x00005598c284f6d2 in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21951]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fadccda0801 in __GI_abort () at abort.c:79
#2  0x00007fadcd5e2a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055b75483f219 in ?? ()
#5  0x00007fadcd603064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fadcd5f0056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fadcd5c05c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055b7548376d2 in main ()

r1: Daemon ospfd not running

r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 24705]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fc64dca1801 in __GI_abort () at abort.c:79
#2  0x00007fc64dc9139a in __assert_fail_base (fmt=0x7fc64de187d8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7fc64e731e5a "0", file=file@entry=0x7fc64e731329 "lib/stream.c", line=line@entry=487, function=function@entry=0x7fc64e731a18 "stream_getl") at assert.c:92
#3  0x00007fc64dc91412 in __GI___assert_fail (assertion=0x7fc64e731e5a "0", file=0x7fc64e731329 "lib/stream.c", line=487, function=0x7fc64e731a18 "stream_getl") at assert.c:101
#4  0x00007fc64e6f3ffc in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007fc64e70e49c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x000055611c13dfb6 in ?? ()
#7  0x000055611c13e08d in ?? ()
#8  0x00007fc64e70ef98 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007fc64e6fc056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007fc64e6cc5c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x000055611c137599 in main ()

2019-09-19 15:00:23,780 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": r1: Daemon ospfd not running


r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 24705]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fc64dca1801 in __GI_abort () at abort.c:79
#2  0x00007fc64dc9139a in __assert_fail_base (fmt=0x7fc64de187d8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7fc64e731e5a "0", file=file@entry=0x7fc64e731329 "lib/stream.c", line=line@entry=487, function=function@entry=0x7fc64e731a18 "stream_getl") at assert.c:92
#3  0x00007fc64dc91412 in __GI___assert_fail (assertion=0x7fc64e731e5a "0", file=0x7fc64e731329 "lib/stream.c", line=487, function=0x7fc64e731a18 "stream_getl") at assert.c:101
#4  0x00007fc64e6f3ffc in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007fc64e70e49c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x000055611c13dfb6 in ?? ()
#7  0x000055611c13e08d in ?? ()
#8  0x00007fc64e70ef98 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007fc64e6fc056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007fc64e6cc5c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x000055611c137599 in main ()
2019-09-19 15:00:24,540 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": 
r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 24705]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fc64dca1801 in __GI_abort () at abort.c:79
#2  0x00007fc64dc9139a in __assert_fail_base (fmt=0x7fc64de187d8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7fc64e731e5a "0", file=file@entry=0x7fc64e731329 "lib/stream.c", line=line@entry=487, function=function@entry=0x7fc64e731a18 "stream_getl") at assert.c:92
#3  0x00007fc64dc91412 in __GI___assert_fail (assertion=0x7fc64e731e5a "0", file=0x7fc64e731329 "lib/stream.c", line=487, function=0x7fc64e731a18 "stream_getl") at assert.c:101
#4  0x00007fc64e6f3ffc in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007fc64e70e49c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x000055611c13dfb6 in ?? ()
#7  0x000055611c13e08d in ?? ()
#8  0x00007fc64e70ef98 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007fc64e6fc056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007fc64e6cc5c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x000055611c137599 in main ()


r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 30800]
[New LWP 30801]
[New LWP 30802]
[New LWP 30813]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
[Current thread is 1 (Thread 0x7ff27d5c57c0 (LWP 30800))]
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007ff27c7e4801 in __GI_abort () at abort.c:79
#2  0x00007ff27d231a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x00007ff27c83e795 in musable (mem=0x160) at malloc.c:4874
#5  __malloc_usable_size (m=0x160) at malloc.c:4877
#6  0x00007ff27d213fac in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x000056420157b2fb in netlink_link_change ()
#8  0x0000564201582d84 in netlink_parse_info ()
#9  0x0000564201583545 in ?? ()
#10 0x00007ff27d23f056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x00007ff27d20f5c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#12 0x000056420157689e in main ()
2019-09-19 15:06:37,756 ERROR: assert failed at "test_pim/test_memory_leak": 
r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 30800]
[New LWP 30801]
[New LWP 30802]
[New LWP 30813]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
[Current thread is 1 (Thread 0x7ff27d5c57c0 (LWP 30800))]
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007ff27c7e4801 in __GI_abort () at abort.c:79
#2  0x00007ff27d231a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x00007ff27c83e795 in musable (mem=0x160) at malloc.c:4874
#5  __malloc_usable_size (m=0x160) at malloc.c:4877
#6  0x00007ff27d213fac in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x000056420157b2fb in netlink_link_change ()
#8  0x0000564201582d84 in netlink_parse_info ()
#9  0x0000564201583545 in ?? ()
#10 0x00007ff27d23f056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x00007ff27d20f5c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#12 0x000056420157689e in main ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8961/artifact/TOPOU1804/ErrorLog/log_topotests.txt

Topotest tests on Ubuntu 16.04 i386: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-8961/test

Topology Tests failed for Topotest tests on Ubuntu 16.04 i386:

RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
*** defaultIntf: warning: r1 has no interfaces
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
r1: Daemon eigrpd not running

r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21129]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f11d05 in ?? ()
#0  0xb7f11d05 in ?? ()
#1  <signal handler called>
#2  0x004ecbb3 in ?? ()
#3  0xb7e6c0e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7eb7dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7ea5b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e73fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004e4baa in main ()

r2: Daemon eigrpd not running

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21169]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7edfd05 in ?? ()
#0  0xb7edfd05 in ?? ()
#1  <signal handler called>
#2  0x004c1bb3 in ?? ()
#3  0xb7e3a0e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7e85dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e73b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e41fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004b9baa in main ()

r3: Daemon eigrpd not running

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21209]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f1cd05 in ?? ()
#0  0xb7f1cd05 in ?? ()
#1  <signal handler called>
#2  0x00494bb3 in ?? ()
#3  0xb7e770e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7ec2dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7eb0b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e7efa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x0048cbaa in main ()

2019-09-19 07:56:14,881 ERROR: assert failed at "test_eigrp_topo1/test_converge_protocols": r1: Daemon eigrpd not running
r2: Daemon eigrpd not running
r3: Daemon eigrpd not running


r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21129]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f11d05 in ?? ()
#0  0xb7f11d05 in ?? ()
#1  <signal handler called>
#2  0x004ecbb3 in ?? ()
#3  0xb7e6c0e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7eb7dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7ea5b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e73fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004e4baa in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21169]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7edfd05 in ?? ()
#0  0xb7edfd05 in ?? ()
#1  <signal handler called>
#2  0x004c1bb3 in ?? ()
#3  0xb7e3a0e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7e85dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e73b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e41fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004b9baa in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21209]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f1cd05 in ?? ()
#0  0xb7f1cd05 in ?? ()
#1  <signal handler called>
#2  0x00494bb3 in ?? ()
#3  0xb7e770e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7ec2dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7eb0b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e7efa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x0048cbaa in main ()
2019-09-19 07:56:21,532 ERROR: assert failed at "test_eigrp_topo1/test_shutdown_check_stderr": 
r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21129]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f11d05 in ?? ()
#0  0xb7f11d05 in ?? ()
#1  <signal handler called>
#2  0x004ecbb3 in ?? ()
#3  0xb7e6c0e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7eb7dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7ea5b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e73fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004e4baa in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21169]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7edfd05 in ?? ()
#0  0xb7edfd05 in ?? ()
#1  <signal handler called>
#2  0x004c1bb3 in ?? ()
#3  0xb7e3a0e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7e85dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e73b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e41fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004b9baa in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21209]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f1cd05 in ?? ()
#0  0xb7f1cd05 in ?? ()
#1  <signal handler called>
#2  0x00494bb3 in ?? ()
#3  0xb7e770e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7ec2dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7eb0b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e7efa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x0048cbaa in main ()

r1: Daemon ospfd not running

r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 24550]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7ef5d05 in ?? ()
#0  0xb7ef5d05 in ?? ()
#1  0xb7e9b2d6 in zebra_interface_if_set_value () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0x0041ecb7 in ?? ()
#3  0xb7e50112 in if_up_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7e9bcea in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e89b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e57fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00418235 in main ()

2019-09-19 08:00:36,798 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": r1: Daemon ospfd not running


r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 24550]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7ef5d05 in ?? ()
#0  0xb7ef5d05 in ?? ()
#1  0xb7e9b2d6 in zebra_interface_if_set_value () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0x0041ecb7 in ?? ()
#3  0xb7e50112 in if_up_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7e9bcea in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e89b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e57fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00418235 in main ()
2019-09-19 08:00:37,539 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": 
r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 24550]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7ef5d05 in ?? ()
#0  0xb7ef5d05 in ?? ()
#1  0xb7e9b2d6 in zebra_interface_if_set_value () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0x0041ecb7 in ?? ()
#3  0xb7e50112 in if_up_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7e9bcea in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e89b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e57fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00418235 in main ()

RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument

r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 31434]
[New LWP 31436]
[New LWP 31435]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f16d05 in ?? ()
[Current thread is 1 (Thread 0xb78667c0 (LWP 31434))]
#0  0xb7f16d05 in ?? ()
#1  0xb7e533ff in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0xb7e7d925 in qfree () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#3  0x004cc700 in netlink_link_change ()
#4  0x004d4137 in ?? ()
#5  0x004d49e7 in netlink_parse_info ()
#6  0x004d517a in ?? ()
#7  0xb7eaab59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#8  0xb7e78fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#9  0x004c7a7f in main ()
2019-09-19 08:06:53,550 ERROR: assert failed at "test_pim/test_memory_leak": 
r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 31434]
[New LWP 31436]
[New LWP 31435]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f16d05 in ?? ()
[Current thread is 1 (Thread 0xb78667c0 (LWP 31434))]
#0  0xb7f16d05 in ?? ()
#1  0xb7e533ff in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0xb7e7d925 in qfree () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#3  0x004cc700 in netlink_link_change ()
#4  0x004d4137 in ?? ()
#5  0x004d49e7 in netlink_parse_info ()
#6  0x004d517a in ?? ()
#7  0xb7eaab59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#8  0xb7e78fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#9  0x004c7a7f in main ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8961/artifact/TOPOI386/ErrorLog/log_topotests.txt

CentOS 7 rpm pkg check: Failed (click for details) CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8961/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found
Topology tests on Ubuntu 16.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1604-8961/test

Topology Tests failed for Topology tests on Ubuntu 16.04 amd64:

*** defaultIntf: warning: r1 has no interfaces
r1: Daemon eigrpd not running

r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 18978]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f2f335a5428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f2f335a5428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f2f335a702a in __GI_abort () at abort.c:89
#2  0x00007f2f33dc95a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000563691220d59 in ?? ()
#5  0x00007f2f33de9db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f2f33dd6ca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f2f33da6f98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000563691219182 in main ()

r2: Daemon eigrpd not running

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 19018]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f541cda5428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f541cda5428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f541cda702a in __GI_abort () at abort.c:89
#2  0x00007f541d5c95a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000562e9d282d59 in ?? ()
#5  0x00007f541d5e9db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f541d5d6ca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f541d5a6f98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000562e9d27b182 in main ()

r3: Daemon eigrpd not running

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 19058]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fd0b339d428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fd0b339d428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007fd0b339f02a in __GI_abort () at abort.c:89
#2  0x00007fd0b3bc15a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055a551d73d59 in ?? ()
#5  0x00007fd0b3be1db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fd0b3bceca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fd0b3b9ef98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055a551d6c182 in main ()

2019-09-19 07:55:59,851 ERROR: assert failed at "test_eigrp_topo1/test_converge_protocols": r1: Daemon eigrpd not running
r2: Daemon eigrpd not running
r3: Daemon eigrpd not running


r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 18978]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f2f335a5428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f2f335a5428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f2f335a702a in __GI_abort () at abort.c:89
#2  0x00007f2f33dc95a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000563691220d59 in ?? ()
#5  0x00007f2f33de9db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f2f33dd6ca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f2f33da6f98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000563691219182 in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 19018]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f541cda5428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f541cda5428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f541cda702a in __GI_abort () at abort.c:89
#2  0x00007f541d5c95a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000562e9d282d59 in ?? ()
#5  0x00007f541d5e9db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f541d5d6ca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f541d5a6f98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000562e9d27b182 in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 19058]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fd0b339d428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fd0b339d428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007fd0b339f02a in __GI_abort () at abort.c:89
#2  0x00007fd0b3bc15a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055a551d73d59 in ?? ()
#5  0x00007fd0b3be1db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fd0b3bceca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fd0b3b9ef98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055a551d6c182 in main ()
2019-09-19 07:56:06,504 ERROR: assert failed at "test_eigrp_topo1/test_shutdown_check_stderr": 
r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 18978]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f2f335a5428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f2f335a5428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f2f335a702a in __GI_abort () at abort.c:89
#2  0x00007f2f33dc95a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000563691220d59 in ?? ()
#5  0x00007f2f33de9db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f2f33dd6ca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f2f33da6f98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000563691219182 in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 19018]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f541cda5428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f541cda5428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f541cda702a in __GI_abort () at abort.c:89
#2  0x00007f541d5c95a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000562e9d282d59 in ?? ()
#5  0x00007f541d5e9db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f541d5d6ca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f541d5a6f98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000562e9d27b182 in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 19058]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fd0b339d428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fd0b339d428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007fd0b339f02a in __GI_abort () at abort.c:89
#2  0x00007fd0b3bc15a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055a551d73d59 in ?? ()
#5  0x00007fd0b3be1db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fd0b3bceca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fd0b3b9ef98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055a551d6c182 in main ()

r1: Daemon ospfd not running

r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 22471]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f6b807a1428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f6b807a1428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f6b807a302a in __GI_abort () at abort.c:89
#2  0x00007f6b80799bd7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7f6b812137da "0", file=file@entry=0x7f6b81212ca9 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f6b81213398 "stream_getl") at assert.c:92
#3  0x00007f6b80799c82 in __GI___assert_fail (assertion=0x7f6b812137da "0", file=0x7f6b81212ca9 "lib/stream.c", line=487, function=0x7f6b81213398 "stream_getl") at assert.c:101
#4  0x00007f6b811d5c5a in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f6b811f019c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000555b8a464526 in ?? ()
#7  0x0000555b8a4645dd in ?? ()
#8  0x00007f6b811f0ce8 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f6b811ddca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f6b811adf98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000555b8a45df69 in main ()

2019-09-19 08:00:20,693 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": r1: Daemon ospfd not running


r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 22471]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f6b807a1428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f6b807a1428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f6b807a302a in __GI_abort () at abort.c:89
#2  0x00007f6b80799bd7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7f6b812137da "0", file=file@entry=0x7f6b81212ca9 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f6b81213398 "stream_getl") at assert.c:92
#3  0x00007f6b80799c82 in __GI___assert_fail (assertion=0x7f6b812137da "0", file=0x7f6b81212ca9 "lib/stream.c", line=487, function=0x7f6b81213398 "stream_getl") at assert.c:101
#4  0x00007f6b811d5c5a in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f6b811f019c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000555b8a464526 in ?? ()
#7  0x0000555b8a4645dd in ?? ()
#8  0x00007f6b811f0ce8 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f6b811ddca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f6b811adf98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000555b8a45df69 in main ()
2019-09-19 08:00:21,445 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": 
r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 22471]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f6b807a1428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f6b807a1428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f6b807a302a in __GI_abort () at abort.c:89
#2  0x00007f6b80799bd7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7f6b812137da "0", file=file@entry=0x7f6b81212ca9 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f6b81213398 "stream_getl") at assert.c:92
#3  0x00007f6b80799c82 in __GI___assert_fail (assertion=0x7f6b812137da "0", file=0x7f6b81212ca9 "lib/stream.c", line=487, function=0x7f6b81213398 "stream_getl") at assert.c:101
#4  0x00007f6b811d5c5a in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f6b811f019c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000555b8a464526 in ?? ()
#7  0x0000555b8a4645dd in ?? ()
#8  0x00007f6b811f0ce8 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f6b811ddca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f6b811adf98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000555b8a45df69 in main ()


r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 29450]
[New LWP 29463]
[New LWP 29452]
[New LWP 29451]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f4090ca1428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
[Current thread is 1 (Thread 0x7f40919de880 (LWP 29450))]
#0  0x00007f4090ca1428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f4090ca302a in __GI_abort () at abort.c:89
#2  0x00007f40916d05a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  musable (mem=0x160) at malloc.c:4589
#5  __malloc_usable_size (m=0x160) at malloc.c:4603
#6  0x00007f40916b2bbc in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x000055d3be280664 in netlink_link_change ()
#8  0x000055d3be288033 in netlink_parse_info ()
#9  0x000055d3be288768 in ?? ()
#10 0x00007f40916ddca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x00007f40916adf98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#12 0x000055d3be27bbfe in main ()
2019-09-19 08:06:34,002 ERROR: assert failed at "test_pim/test_memory_leak": 
r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 29450]
[New LWP 29463]
[New LWP 29452]
[New LWP 29451]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f4090ca1428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
[Current thread is 1 (Thread 0x7f40919de880 (LWP 29450))]
#0  0x00007f4090ca1428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f4090ca302a in __GI_abort () at abort.c:89
#2  0x00007f40916d05a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  musable (mem=0x160) at malloc.c:4589
#5  __malloc_usable_size (m=0x160) at malloc.c:4603
#6  0x00007f40916b2bbc in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x000055d3be280664 in netlink_link_change ()
#8  0x000055d3be288033 in netlink_parse_info ()
#9  0x000055d3be288768 in ?? ()
#10 0x00007f40916ddca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x00007f40916adf98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#12 0x000055d3be27bbfe in main ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8961/artifact/TOPOU1604/ErrorLog/log_topotests.txt

Successful on other platforms
  • Debian 9 deb pkg check
  • Ubuntu 12.04 deb pkg check
  • Static analyzer (clang)
  • IPv6 protocols on Ubuntu 14.04
  • Ubuntu 16.04 deb pkg check
  • Debian 10 deb pkg check
  • IPv4 ldp protocol on Ubuntu 16.04
  • Ubuntu 14.04 deb pkg check
  • Addresssanitizer topotest
  • Debian 8 deb pkg check

Topology Tests memory analysis: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8961/artifact/TOPOU1804/MemoryLeaks/
Topology Tests memory analysis: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8961/artifact/TOPOI386/MemoryLeaks/
Topology Tests memory analysis: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8961/artifact/TOPOU1604/MemoryLeaks/

Warnings Generated during build:

Checkout code: Successful with additional warnings
Fedora 29 rpm pkg check: Failed (click for details) Fedora 29 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8961/artifact/F29RPMCHECK/ErrorLog/log_package_start.txt Fedora 29 rpm pkg check: No useful log found
IPv4 protocols on Ubuntu 14.04: Failed (click for details)

RFC Compliance Test ANVL-OSPF-3.1 failing:
Test Summary
This routing table entry then provides the outgoing interface
and next hop router to use in forwarding the packet.
(NOTE: Here we are testing the DUT forwards IP packet to the
correct interface and next hop based on an entry in the
OSPF routing table.)
Test Reference
RFC 1583, s11.1 p96 Routing table lookup
RFC 2328, s11.1 p111 Routing table lookup
Test Classification
MUST
Test ANVL-OSPF-3.1: !FAILED!
Expected to receive IP packet but did not

Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-8961/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

*** defaultIntf: warning: r1 has no interfaces
r1: Daemon eigrpd not running

r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21871]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007faa897f8801 in __GI_abort () at abort.c:79
#2  0x00007faa8a03aa2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000560ff954a219 in ?? ()
#5  0x00007faa8a05b064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007faa8a048056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007faa8a0185c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000560ff95426d2 in main ()

r2: Daemon eigrpd not running

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21911]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f6124134801 in __GI_abort () at abort.c:79
#2  0x00007f6124976a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x00005598c2857219 in ?? ()
#5  0x00007f6124997064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f6124984056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f61249545c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x00005598c284f6d2 in main ()

r3: Daemon eigrpd not running

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21951]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fadccda0801 in __GI_abort () at abort.c:79
#2  0x00007fadcd5e2a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055b75483f219 in ?? ()
#5  0x00007fadcd603064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fadcd5f0056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fadcd5c05c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055b7548376d2 in main ()

2019-09-19 14:56:07,656 ERROR: assert failed at "test_eigrp_topo1/test_converge_protocols": r1: Daemon eigrpd not running
r2: Daemon eigrpd not running
r3: Daemon eigrpd not running


r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21871]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007faa897f8801 in __GI_abort () at abort.c:79
#2  0x00007faa8a03aa2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000560ff954a219 in ?? ()
#5  0x00007faa8a05b064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007faa8a048056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007faa8a0185c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000560ff95426d2 in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21911]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f6124134801 in __GI_abort () at abort.c:79
#2  0x00007f6124976a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x00005598c2857219 in ?? ()
#5  0x00007f6124997064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f6124984056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f61249545c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x00005598c284f6d2 in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21951]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fadccda0801 in __GI_abort () at abort.c:79
#2  0x00007fadcd5e2a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055b75483f219 in ?? ()
#5  0x00007fadcd603064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fadcd5f0056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fadcd5c05c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055b7548376d2 in main ()
2019-09-19 14:56:14,455 ERROR: assert failed at "test_eigrp_topo1/test_shutdown_check_stderr": 
r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21871]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007faa897f8801 in __GI_abort () at abort.c:79
#2  0x00007faa8a03aa2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000560ff954a219 in ?? ()
#5  0x00007faa8a05b064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007faa8a048056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007faa8a0185c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000560ff95426d2 in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21911]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f6124134801 in __GI_abort () at abort.c:79
#2  0x00007f6124976a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x00005598c2857219 in ?? ()
#5  0x00007f6124997064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f6124984056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f61249545c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x00005598c284f6d2 in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21951]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fadccda0801 in __GI_abort () at abort.c:79
#2  0x00007fadcd5e2a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055b75483f219 in ?? ()
#5  0x00007fadcd603064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fadcd5f0056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fadcd5c05c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055b7548376d2 in main ()

r1: Daemon ospfd not running

r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 24705]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fc64dca1801 in __GI_abort () at abort.c:79
#2  0x00007fc64dc9139a in __assert_fail_base (fmt=0x7fc64de187d8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7fc64e731e5a "0", file=file@entry=0x7fc64e731329 "lib/stream.c", line=line@entry=487, function=function@entry=0x7fc64e731a18 "stream_getl") at assert.c:92
#3  0x00007fc64dc91412 in __GI___assert_fail (assertion=0x7fc64e731e5a "0", file=0x7fc64e731329 "lib/stream.c", line=487, function=0x7fc64e731a18 "stream_getl") at assert.c:101
#4  0x00007fc64e6f3ffc in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007fc64e70e49c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x000055611c13dfb6 in ?? ()
#7  0x000055611c13e08d in ?? ()
#8  0x00007fc64e70ef98 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007fc64e6fc056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007fc64e6cc5c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x000055611c137599 in main ()

2019-09-19 15:00:23,780 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": r1: Daemon ospfd not running


r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 24705]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fc64dca1801 in __GI_abort () at abort.c:79
#2  0x00007fc64dc9139a in __assert_fail_base (fmt=0x7fc64de187d8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7fc64e731e5a "0", file=file@entry=0x7fc64e731329 "lib/stream.c", line=line@entry=487, function=function@entry=0x7fc64e731a18 "stream_getl") at assert.c:92
#3  0x00007fc64dc91412 in __GI___assert_fail (assertion=0x7fc64e731e5a "0", file=0x7fc64e731329 "lib/stream.c", line=487, function=0x7fc64e731a18 "stream_getl") at assert.c:101
#4  0x00007fc64e6f3ffc in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007fc64e70e49c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x000055611c13dfb6 in ?? ()
#7  0x000055611c13e08d in ?? ()
#8  0x00007fc64e70ef98 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007fc64e6fc056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007fc64e6cc5c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x000055611c137599 in main ()
2019-09-19 15:00:24,540 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": 
r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 24705]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fc64dca1801 in __GI_abort () at abort.c:79
#2  0x00007fc64dc9139a in __assert_fail_base (fmt=0x7fc64de187d8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7fc64e731e5a "0", file=file@entry=0x7fc64e731329 "lib/stream.c", line=line@entry=487, function=function@entry=0x7fc64e731a18 "stream_getl") at assert.c:92
#3  0x00007fc64dc91412 in __GI___assert_fail (assertion=0x7fc64e731e5a "0", file=0x7fc64e731329 "lib/stream.c", line=487, function=0x7fc64e731a18 "stream_getl") at assert.c:101
#4  0x00007fc64e6f3ffc in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007fc64e70e49c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x000055611c13dfb6 in ?? ()
#7  0x000055611c13e08d in ?? ()
#8  0x00007fc64e70ef98 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007fc64e6fc056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007fc64e6cc5c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x000055611c137599 in main ()


r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 30800]
[New LWP 30801]
[New LWP 30802]
[New LWP 30813]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
[Current thread is 1 (Thread 0x7ff27d5c57c0 (LWP 30800))]
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007ff27c7e4801 in __GI_abort () at abort.c:79
#2  0x00007ff27d231a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x00007ff27c83e795 in musable (mem=0x160) at malloc.c:4874
#5  __malloc_usable_size (m=0x160) at malloc.c:4877
#6  0x00007ff27d213fac in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x000056420157b2fb in netlink_link_change ()
#8  0x0000564201582d84 in netlink_parse_info ()
#9  0x0000564201583545 in ?? ()
#10 0x00007ff27d23f056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x00007ff27d20f5c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#12 0x000056420157689e in main ()
2019-09-19 15:06:37,756 ERROR: assert failed at "test_pim/test_memory_leak": 
r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 30800]
[New LWP 30801]
[New LWP 30802]
[New LWP 30813]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
[Current thread is 1 (Thread 0x7ff27d5c57c0 (LWP 30800))]
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007ff27c7e4801 in __GI_abort () at abort.c:79
#2  0x00007ff27d231a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x00007ff27c83e795 in musable (mem=0x160) at malloc.c:4874
#5  __malloc_usable_size (m=0x160) at malloc.c:4877
#6  0x00007ff27d213fac in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x000056420157b2fb in netlink_link_change ()
#8  0x0000564201582d84 in netlink_parse_info ()
#9  0x0000564201583545 in ?? ()
#10 0x00007ff27d23f056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x00007ff27d20f5c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#12 0x000056420157689e in main ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8961/artifact/TOPOU1804/ErrorLog/log_topotests.txt

Topotest tests on Ubuntu 16.04 i386: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-8961/test

Topology Tests failed for Topotest tests on Ubuntu 16.04 i386:

RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
*** defaultIntf: warning: r1 has no interfaces
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
r1: Daemon eigrpd not running

r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21129]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f11d05 in ?? ()
#0  0xb7f11d05 in ?? ()
#1  <signal handler called>
#2  0x004ecbb3 in ?? ()
#3  0xb7e6c0e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7eb7dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7ea5b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e73fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004e4baa in main ()

r2: Daemon eigrpd not running

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21169]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7edfd05 in ?? ()
#0  0xb7edfd05 in ?? ()
#1  <signal handler called>
#2  0x004c1bb3 in ?? ()
#3  0xb7e3a0e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7e85dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e73b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e41fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004b9baa in main ()

r3: Daemon eigrpd not running

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21209]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f1cd05 in ?? ()
#0  0xb7f1cd05 in ?? ()
#1  <signal handler called>
#2  0x00494bb3 in ?? ()
#3  0xb7e770e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7ec2dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7eb0b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e7efa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x0048cbaa in main ()

2019-09-19 07:56:14,881 ERROR: assert failed at "test_eigrp_topo1/test_converge_protocols": r1: Daemon eigrpd not running
r2: Daemon eigrpd not running
r3: Daemon eigrpd not running


r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21129]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f11d05 in ?? ()
#0  0xb7f11d05 in ?? ()
#1  <signal handler called>
#2  0x004ecbb3 in ?? ()
#3  0xb7e6c0e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7eb7dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7ea5b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e73fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004e4baa in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21169]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7edfd05 in ?? ()
#0  0xb7edfd05 in ?? ()
#1  <signal handler called>
#2  0x004c1bb3 in ?? ()
#3  0xb7e3a0e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7e85dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e73b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e41fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004b9baa in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21209]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f1cd05 in ?? ()
#0  0xb7f1cd05 in ?? ()
#1  <signal handler called>
#2  0x00494bb3 in ?? ()
#3  0xb7e770e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7ec2dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7eb0b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e7efa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x0048cbaa in main ()
2019-09-19 07:56:21,532 ERROR: assert failed at "test_eigrp_topo1/test_shutdown_check_stderr": 
r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21129]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f11d05 in ?? ()
#0  0xb7f11d05 in ?? ()
#1  <signal handler called>
#2  0x004ecbb3 in ?? ()
#3  0xb7e6c0e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7eb7dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7ea5b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e73fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004e4baa in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21169]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7edfd05 in ?? ()
#0  0xb7edfd05 in ?? ()
#1  <signal handler called>
#2  0x004c1bb3 in ?? ()
#3  0xb7e3a0e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7e85dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e73b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e41fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004b9baa in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 21209]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f1cd05 in ?? ()
#0  0xb7f1cd05 in ?? ()
#1  <signal handler called>
#2  0x00494bb3 in ?? ()
#3  0xb7e770e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7ec2dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7eb0b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e7efa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x0048cbaa in main ()

r1: Daemon ospfd not running

r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 24550]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7ef5d05 in ?? ()
#0  0xb7ef5d05 in ?? ()
#1  0xb7e9b2d6 in zebra_interface_if_set_value () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0x0041ecb7 in ?? ()
#3  0xb7e50112 in if_up_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7e9bcea in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e89b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e57fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00418235 in main ()

2019-09-19 08:00:36,798 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": r1: Daemon ospfd not running


r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 24550]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7ef5d05 in ?? ()
#0  0xb7ef5d05 in ?? ()
#1  0xb7e9b2d6 in zebra_interface_if_set_value () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0x0041ecb7 in ?? ()
#3  0xb7e50112 in if_up_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7e9bcea in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e89b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e57fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00418235 in main ()
2019-09-19 08:00:37,539 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": 
r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 24550]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7ef5d05 in ?? ()
#0  0xb7ef5d05 in ?? ()
#1  0xb7e9b2d6 in zebra_interface_if_set_value () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0x0041ecb7 in ?? ()
#3  0xb7e50112 in if_up_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7e9bcea in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e89b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e57fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00418235 in main ()

RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument

r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 31434]
[New LWP 31436]
[New LWP 31435]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f16d05 in ?? ()
[Current thread is 1 (Thread 0xb78667c0 (LWP 31434))]
#0  0xb7f16d05 in ?? ()
#1  0xb7e533ff in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0xb7e7d925 in qfree () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#3  0x004cc700 in netlink_link_change ()
#4  0x004d4137 in ?? ()
#5  0x004d49e7 in netlink_parse_info ()
#6  0x004d517a in ?? ()
#7  0xb7eaab59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#8  0xb7e78fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#9  0x004c7a7f in main ()
2019-09-19 08:06:53,550 ERROR: assert failed at "test_pim/test_memory_leak": 
r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 31434]
[New LWP 31436]
[New LWP 31435]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f16d05 in ?? ()
[Current thread is 1 (Thread 0xb78667c0 (LWP 31434))]
#0  0xb7f16d05 in ?? ()
#1  0xb7e533ff in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0xb7e7d925 in qfree () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#3  0x004cc700 in netlink_link_change ()
#4  0x004d4137 in ?? ()
#5  0x004d49e7 in netlink_parse_info ()
#6  0x004d517a in ?? ()
#7  0xb7eaab59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#8  0xb7e78fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#9  0x004c7a7f in main ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8961/artifact/TOPOI386/ErrorLog/log_topotests.txt

CentOS 7 rpm pkg check: Failed (click for details) CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8961/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found
Topology tests on Ubuntu 16.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1604-8961/test

Topology Tests failed for Topology tests on Ubuntu 16.04 amd64:

*** defaultIntf: warning: r1 has no interfaces
r1: Daemon eigrpd not running

r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 18978]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f2f335a5428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f2f335a5428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f2f335a702a in __GI_abort () at abort.c:89
#2  0x00007f2f33dc95a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000563691220d59 in ?? ()
#5  0x00007f2f33de9db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f2f33dd6ca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f2f33da6f98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000563691219182 in main ()

r2: Daemon eigrpd not running

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 19018]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f541cda5428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f541cda5428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f541cda702a in __GI_abort () at abort.c:89
#2  0x00007f541d5c95a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000562e9d282d59 in ?? ()
#5  0x00007f541d5e9db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f541d5d6ca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f541d5a6f98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000562e9d27b182 in main ()

r3: Daemon eigrpd not running

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 19058]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fd0b339d428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fd0b339d428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007fd0b339f02a in __GI_abort () at abort.c:89
#2  0x00007fd0b3bc15a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055a551d73d59 in ?? ()
#5  0x00007fd0b3be1db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fd0b3bceca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fd0b3b9ef98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055a551d6c182 in main ()

2019-09-19 07:55:59,851 ERROR: assert failed at "test_eigrp_topo1/test_converge_protocols": r1: Daemon eigrpd not running
r2: Daemon eigrpd not running
r3: Daemon eigrpd not running


r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 18978]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f2f335a5428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f2f335a5428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f2f335a702a in __GI_abort () at abort.c:89
#2  0x00007f2f33dc95a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000563691220d59 in ?? ()
#5  0x00007f2f33de9db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f2f33dd6ca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f2f33da6f98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000563691219182 in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 19018]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f541cda5428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f541cda5428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f541cda702a in __GI_abort () at abort.c:89
#2  0x00007f541d5c95a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000562e9d282d59 in ?? ()
#5  0x00007f541d5e9db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f541d5d6ca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f541d5a6f98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000562e9d27b182 in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 19058]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fd0b339d428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fd0b339d428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007fd0b339f02a in __GI_abort () at abort.c:89
#2  0x00007fd0b3bc15a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055a551d73d59 in ?? ()
#5  0x00007fd0b3be1db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fd0b3bceca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fd0b3b9ef98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055a551d6c182 in main ()
2019-09-19 07:56:06,504 ERROR: assert failed at "test_eigrp_topo1/test_shutdown_check_stderr": 
r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 18978]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f2f335a5428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f2f335a5428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f2f335a702a in __GI_abort () at abort.c:89
#2  0x00007f2f33dc95a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000563691220d59 in ?? ()
#5  0x00007f2f33de9db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f2f33dd6ca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f2f33da6f98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000563691219182 in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 19018]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f541cda5428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f541cda5428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f541cda702a in __GI_abort () at abort.c:89
#2  0x00007f541d5c95a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000562e9d282d59 in ?? ()
#5  0x00007f541d5e9db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f541d5d6ca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f541d5a6f98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000562e9d27b182 in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 19058]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fd0b339d428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fd0b339d428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007fd0b339f02a in __GI_abort () at abort.c:89
#2  0x00007fd0b3bc15a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055a551d73d59 in ?? ()
#5  0x00007fd0b3be1db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fd0b3bceca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fd0b3b9ef98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055a551d6c182 in main ()

r1: Daemon ospfd not running

r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 22471]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f6b807a1428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f6b807a1428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f6b807a302a in __GI_abort () at abort.c:89
#2  0x00007f6b80799bd7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7f6b812137da "0", file=file@entry=0x7f6b81212ca9 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f6b81213398 "stream_getl") at assert.c:92
#3  0x00007f6b80799c82 in __GI___assert_fail (assertion=0x7f6b812137da "0", file=0x7f6b81212ca9 "lib/stream.c", line=487, function=0x7f6b81213398 "stream_getl") at assert.c:101
#4  0x00007f6b811d5c5a in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f6b811f019c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000555b8a464526 in ?? ()
#7  0x0000555b8a4645dd in ?? ()
#8  0x00007f6b811f0ce8 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f6b811ddca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f6b811adf98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000555b8a45df69 in main ()

2019-09-19 08:00:20,693 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": r1: Daemon ospfd not running


r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 22471]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f6b807a1428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f6b807a1428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f6b807a302a in __GI_abort () at abort.c:89
#2  0x00007f6b80799bd7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7f6b812137da "0", file=file@entry=0x7f6b81212ca9 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f6b81213398 "stream_getl") at assert.c:92
#3  0x00007f6b80799c82 in __GI___assert_fail (assertion=0x7f6b812137da "0", file=0x7f6b81212ca9 "lib/stream.c", line=487, function=0x7f6b81213398 "stream_getl") at assert.c:101
#4  0x00007f6b811d5c5a in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f6b811f019c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000555b8a464526 in ?? ()
#7  0x0000555b8a4645dd in ?? ()
#8  0x00007f6b811f0ce8 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f6b811ddca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f6b811adf98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000555b8a45df69 in main ()
2019-09-19 08:00:21,445 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": 
r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 22471]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f6b807a1428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f6b807a1428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f6b807a302a in __GI_abort () at abort.c:89
#2  0x00007f6b80799bd7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7f6b812137da "0", file=file@entry=0x7f6b81212ca9 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f6b81213398 "stream_getl") at assert.c:92
#3  0x00007f6b80799c82 in __GI___assert_fail (assertion=0x7f6b812137da "0", file=0x7f6b81212ca9 "lib/stream.c", line=487, function=0x7f6b81213398 "stream_getl") at assert.c:101
#4  0x00007f6b811d5c5a in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f6b811f019c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000555b8a464526 in ?? ()
#7  0x0000555b8a4645dd in ?? ()
#8  0x00007f6b811f0ce8 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f6b811ddca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f6b811adf98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000555b8a45df69 in main ()


r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 29450]
[New LWP 29463]
[New LWP 29452]
[New LWP 29451]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f4090ca1428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
[Current thread is 1 (Thread 0x7f40919de880 (LWP 29450))]
#0  0x00007f4090ca1428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f4090ca302a in __GI_abort () at abort.c:89
#2  0x00007f40916d05a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  musable (mem=0x160) at malloc.c:4589
#5  __malloc_usable_size (m=0x160) at malloc.c:4603
#6  0x00007f40916b2bbc in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x000055d3be280664 in netlink_link_change ()
#8  0x000055d3be288033 in netlink_parse_info ()
#9  0x000055d3be288768 in ?? ()
#10 0x00007f40916ddca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x00007f40916adf98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#12 0x000055d3be27bbfe in main ()
2019-09-19 08:06:34,002 ERROR: assert failed at "test_pim/test_memory_leak": 
r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 29450]
[New LWP 29463]
[New LWP 29452]
[New LWP 29451]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f4090ca1428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
[Current thread is 1 (Thread 0x7f40919de880 (LWP 29450))]
#0  0x00007f4090ca1428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f4090ca302a in __GI_abort () at abort.c:89
#2  0x00007f40916d05a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  musable (mem=0x160) at malloc.c:4589
#5  __malloc_usable_size (m=0x160) at malloc.c:4603
#6  0x00007f40916b2bbc in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x000055d3be280664 in netlink_link_change ()
#8  0x000055d3be288033 in netlink_parse_info ()
#9  0x000055d3be288768 in ?? ()
#10 0x00007f40916ddca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x00007f40916adf98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#12 0x000055d3be27bbfe in main ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8961/artifact/TOPOU1604/ErrorLog/log_topotests.txt

Report for eigrp_interface.c | 6 issues
===============================================
< WARNING: Missing a blank line after declarations
< #143: FILE: /tmp/f1-28420/eigrp_interface.c:143:
< WARNING: C99 // comments do not match recommendation
< #156: FILE: /tmp/f1-28420/eigrp_interface.c:156:
< WARNING: Block comments use a trailing */ on a separate line
< #166: FILE: /tmp/f1-28420/eigrp_interface.c:166:
Report for if.c | 7 issues
===============================================
< WARNING: missing space after struct definition
< #61: FILE: /tmp/f1-28420/if.c:61:
< WARNING: strncat() is error-prone; please use strlcat() if possible#896: FILE: /tmp/f1-28420/if.c:896:
---
> WARNING: strncat() is error-prone; please use strlcat() if possible#861: FILE: /tmp/f2-28420/if.c:861:
309c305
< #973: FILE: /tmp/f1-28420/if.c:973:
Report for isis_circuit.c | 4 issues
===============================================
< WARNING: Block comments use * on subsequent lines
< #1433: FILE: /tmp/f1-28420/isis_circuit.c:1433:
< WARNING: Block comments use a trailing */ on a separate line
< #1433: FILE: /tmp/f1-28420/isis_circuit.c:1433:
Report for ospf6_interface.c | 4 issues
===============================================
< WARNING: quoted string split across lines
< #1954: FILE: /tmp/f1-28420/ospf6_interface.c:1954:
< WARNING: quoted string split across lines
< #1968: FILE: /tmp/f1-28420/ospf6_interface.c:1968:
Report for ospf_interface.c | 12 issues
===============================================
< ERROR: "foo * bar" should be "foo *bar"
< #53: FILE: /tmp/f1-28420/ospf_interface.c:53:
< ERROR: "foo * bar" should be "foo *bar"
< #54: FILE: /tmp/f1-28420/ospf_interface.c:54:
< WARNING: Missing a blank line after declarations
< #1270: FILE: /tmp/f1-28420/ospf_interface.c:1270:
< WARNING: Block comments use a trailing */ on a separate line
< #1289: FILE: /tmp/f1-28420/ospf_interface.c:1289:
< ERROR: do not use assignment in if condition
< #1302: FILE: /tmp/f1-28420/ospf_interface.c:1302:
< ERROR: do not use assignment in if condition
< #1321: FILE: /tmp/f1-28420/ospf_interface.c:1321:
Report for ospf_interface.h | 4 issues
===============================================
< ERROR: "foo * bar" should be "foo *bar"
< #329: FILE: /tmp/f1-28420/ospf_interface.h:329:
< ERROR: "foo * bar" should be "foo *bar"
< #330: FILE: /tmp/f1-28420/ospf_interface.h:330:
Report for pim_iface.c | 10 issues
===============================================
< WARNING: Block comments use * on subsequent lines
< #1609: FILE: /tmp/f1-28420/pim_iface.c:1609:
< WARNING: Missing a blank line after declarations
< #1621: FILE: /tmp/f1-28420/pim_iface.c:1621:
< WARNING: Block comments use * on subsequent lines
< #1653: FILE: /tmp/f1-28420/pim_iface.c:1653:
< WARNING: Block comments use * on subsequent lines
< #1659: FILE: /tmp/f1-28420/pim_iface.c:1659:
< WARNING: braces {} are not necessary for single statement blocks
< #1663: FILE: /tmp/f1-28420/pim_iface.c:1663:
Report for zclient.c | 2 issues
===============================================
< WARNING: void function return statements are not generally useful
< #1607: FILE: /tmp/f1-28420/zclient.c:1607:

CLANG Static Analyzer Summary

  • Github Pull Request 5009, comparing to Git base SHA 16296be

No Changes in Static Analysis warnings compared to base

1 Static Analyzer issues remaining.

See details at
https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8961/artifact/shared/static_analysis/index.html

@NetDEF-CI
Copy link
Collaborator

Continuous Integration Result: FAILED

See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8962/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Failed

Topology tests on Ubuntu 16.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1604-8962/test

Topology Tests failed for Topology tests on Ubuntu 16.04 amd64:

*** defaultIntf: warning: r1 has no interfaces
r1: Daemon eigrpd not running

r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 27952]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fa920fbf428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fa920fbf428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007fa920fc102a in __GI_abort () at abort.c:89
#2  0x00007fa9217e35a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000560d0a890d59 in ?? ()
#5  0x00007fa921803db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fa9217f0ca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fa9217c0f98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000560d0a889182 in main ()

r2: Daemon eigrpd not running

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 27992]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f5c60e03428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f5c60e03428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f5c60e0502a in __GI_abort () at abort.c:89
#2  0x00007f5c616275a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000558fe1a34d59 in ?? ()
#5  0x00007f5c61647db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f5c61634ca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f5c61604f98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000558fe1a2d182 in main ()

r3: Daemon eigrpd not running

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 28040]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f2aa47d9428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f2aa47d9428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f2aa47db02a in __GI_abort () at abort.c:89
#2  0x00007f2aa4ffd5a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000558ca7fbdd59 in ?? ()
#5  0x00007f2aa501ddb4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f2aa500aca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f2aa4fdaf98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000558ca7fb6182 in main ()

2019-09-19 17:03:15,607 ERROR: assert failed at "test_eigrp_topo1/test_converge_protocols": r1: Daemon eigrpd not running
r2: Daemon eigrpd not running
r3: Daemon eigrpd not running


r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 27952]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fa920fbf428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fa920fbf428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007fa920fc102a in __GI_abort () at abort.c:89
#2  0x00007fa9217e35a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000560d0a890d59 in ?? ()
#5  0x00007fa921803db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fa9217f0ca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fa9217c0f98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000560d0a889182 in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 27992]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f5c60e03428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f5c60e03428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f5c60e0502a in __GI_abort () at abort.c:89
#2  0x00007f5c616275a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000558fe1a34d59 in ?? ()
#5  0x00007f5c61647db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f5c61634ca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f5c61604f98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000558fe1a2d182 in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 28040]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f2aa47d9428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f2aa47d9428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f2aa47db02a in __GI_abort () at abort.c:89
#2  0x00007f2aa4ffd5a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000558ca7fbdd59 in ?? ()
#5  0x00007f2aa501ddb4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f2aa500aca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f2aa4fdaf98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000558ca7fb6182 in main ()
2019-09-19 17:03:21,630 ERROR: assert failed at "test_eigrp_topo1/test_shutdown_check_stderr": 
r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 27952]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fa920fbf428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fa920fbf428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007fa920fc102a in __GI_abort () at abort.c:89
#2  0x00007fa9217e35a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000560d0a890d59 in ?? ()
#5  0x00007fa921803db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fa9217f0ca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fa9217c0f98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000560d0a889182 in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 27992]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f5c60e03428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f5c60e03428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f5c60e0502a in __GI_abort () at abort.c:89
#2  0x00007f5c616275a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000558fe1a34d59 in ?? ()
#5  0x00007f5c61647db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f5c61634ca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f5c61604f98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000558fe1a2d182 in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 28040]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f2aa47d9428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f2aa47d9428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f2aa47db02a in __GI_abort () at abort.c:89
#2  0x00007f2aa4ffd5a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000558ca7fbdd59 in ?? ()
#5  0x00007f2aa501ddb4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f2aa500aca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f2aa4fdaf98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000558ca7fb6182 in main ()

r1: Daemon ospfd not running

r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 31445]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fb0f5b0e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fb0f5b0e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007fb0f5b1002a in __GI_abort () at abort.c:89
#2  0x00007fb0f5b06bd7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7fb0f65807da "0", file=file@entry=0x7fb0f657fca9 "lib/stream.c", line=line@entry=487, function=function@entry=0x7fb0f6580398 "stream_getl") at assert.c:92
#3  0x00007fb0f5b06c82 in __GI___assert_fail (assertion=0x7fb0f65807da "0", file=0x7fb0f657fca9 "lib/stream.c", line=487, function=0x7fb0f6580398 "stream_getl") at assert.c:101
#4  0x00007fb0f6542c5a in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007fb0f655d19c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000558ef1a2a526 in ?? ()
#7  0x0000558ef1a2a5dd in ?? ()
#8  0x00007fb0f655dce8 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007fb0f654aca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007fb0f651af98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000558ef1a23f69 in main ()

2019-09-19 17:07:29,577 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": r1: Daemon ospfd not running


r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 31445]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fb0f5b0e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fb0f5b0e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007fb0f5b1002a in __GI_abort () at abort.c:89
#2  0x00007fb0f5b06bd7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7fb0f65807da "0", file=file@entry=0x7fb0f657fca9 "lib/stream.c", line=line@entry=487, function=function@entry=0x7fb0f6580398 "stream_getl") at assert.c:92
#3  0x00007fb0f5b06c82 in __GI___assert_fail (assertion=0x7fb0f65807da "0", file=0x7fb0f657fca9 "lib/stream.c", line=487, function=0x7fb0f6580398 "stream_getl") at assert.c:101
#4  0x00007fb0f6542c5a in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007fb0f655d19c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000558ef1a2a526 in ?? ()
#7  0x0000558ef1a2a5dd in ?? ()
#8  0x00007fb0f655dce8 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007fb0f654aca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007fb0f651af98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000558ef1a23f69 in main ()
2019-09-19 17:07:30,114 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": 
r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 31445]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fb0f5b0e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fb0f5b0e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007fb0f5b1002a in __GI_abort () at abort.c:89
#2  0x00007fb0f5b06bd7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7fb0f65807da "0", file=file@entry=0x7fb0f657fca9 "lib/stream.c", line=line@entry=487, function=function@entry=0x7fb0f6580398 "stream_getl") at assert.c:92
#3  0x00007fb0f5b06c82 in __GI___assert_fail (assertion=0x7fb0f65807da "0", file=0x7fb0f657fca9 "lib/stream.c", line=487, function=0x7fb0f6580398 "stream_getl") at assert.c:101
#4  0x00007fb0f6542c5a in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007fb0f655d19c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000558ef1a2a526 in ?? ()
#7  0x0000558ef1a2a5dd in ?? ()
#8  0x00007fb0f655dce8 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007fb0f654aca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007fb0f651af98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000558ef1a23f69 in main ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8962/artifact/TOPOU1604/ErrorLog/log_topotests.txt

Fedora 29 rpm pkg check: Failed (click for details) Fedora 29 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8962/artifact/F29RPMCHECK/ErrorLog/log_package_start.txt Fedora 29 rpm pkg check: No useful log found
Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-8962/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

*** defaultIntf: warning: r1 has no interfaces
r1: Daemon eigrpd not running

r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 2066]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f1b60f75801 in __GI_abort () at abort.c:79
#2  0x00007f1b617b7a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000563a4493f219 in ?? ()
#5  0x00007f1b617d8064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f1b617c5056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f1b617955c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000563a449376d2 in main ()

r2: Daemon eigrpd not running

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 2106]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fe38e339801 in __GI_abort () at abort.c:79
#2  0x00007fe38eb7ba2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000558490819219 in ?? ()
#5  0x00007fe38eb9c064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fe38eb89056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fe38eb595c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x00005584908116d2 in main ()

r3: Daemon eigrpd not running

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 2146]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f5ae2ba4801 in __GI_abort () at abort.c:79
#2  0x00007f5ae33e6a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055b294f10219 in ?? ()
#5  0x00007f5ae3407064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f5ae33f4056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f5ae33c45c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055b294f086d2 in main ()

2019-09-19 15:04:40,984 ERROR: assert failed at "test_eigrp_topo1/test_converge_protocols": r1: Daemon eigrpd not running
r2: Daemon eigrpd not running
r3: Daemon eigrpd not running


r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 2066]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f1b60f75801 in __GI_abort () at abort.c:79
#2  0x00007f1b617b7a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000563a4493f219 in ?? ()
#5  0x00007f1b617d8064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f1b617c5056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f1b617955c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000563a449376d2 in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 2106]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fe38e339801 in __GI_abort () at abort.c:79
#2  0x00007fe38eb7ba2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000558490819219 in ?? ()
#5  0x00007fe38eb9c064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fe38eb89056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fe38eb595c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x00005584908116d2 in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 2146]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f5ae2ba4801 in __GI_abort () at abort.c:79
#2  0x00007f5ae33e6a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055b294f10219 in ?? ()
#5  0x00007f5ae3407064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f5ae33f4056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f5ae33c45c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055b294f086d2 in main ()
2019-09-19 15:04:47,689 ERROR: assert failed at "test_eigrp_topo1/test_shutdown_check_stderr": 
r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 2066]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f1b60f75801 in __GI_abort () at abort.c:79
#2  0x00007f1b617b7a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000563a4493f219 in ?? ()
#5  0x00007f1b617d8064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f1b617c5056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f1b617955c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000563a449376d2 in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 2106]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fe38e339801 in __GI_abort () at abort.c:79
#2  0x00007fe38eb7ba2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000558490819219 in ?? ()
#5  0x00007fe38eb9c064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fe38eb89056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fe38eb595c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x00005584908116d2 in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 2146]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f5ae2ba4801 in __GI_abort () at abort.c:79
#2  0x00007f5ae33e6a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055b294f10219 in ?? ()
#5  0x00007f5ae3407064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f5ae33f4056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f5ae33c45c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055b294f086d2 in main ()

r1: Daemon ospfd not running

r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 4929]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f4da448b801 in __GI_abort () at abort.c:79
#2  0x00007f4da447b39a in __assert_fail_base (fmt=0x7f4da46027d8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7f4da4f1be5a "0", file=file@entry=0x7f4da4f1b329 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f4da4f1ba18 "stream_getl") at assert.c:92
#3  0x00007f4da447b412 in __GI___assert_fail (assertion=0x7f4da4f1be5a "0", file=0x7f4da4f1b329 "lib/stream.c", line=487, function=0x7f4da4f1ba18 "stream_getl") at assert.c:101
#4  0x00007f4da4eddffc in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f4da4ef849c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000559e8cdb4fb6 in ?? ()
#7  0x0000559e8cdb508d in ?? ()
#8  0x00007f4da4ef8f98 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f4da4ee6056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f4da4eb65c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000559e8cdae599 in main ()

2019-09-19 15:08:51,087 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": r1: Daemon ospfd not running


r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 4929]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f4da448b801 in __GI_abort () at abort.c:79
#2  0x00007f4da447b39a in __assert_fail_base (fmt=0x7f4da46027d8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7f4da4f1be5a "0", file=file@entry=0x7f4da4f1b329 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f4da4f1ba18 "stream_getl") at assert.c:92
#3  0x00007f4da447b412 in __GI___assert_fail (assertion=0x7f4da4f1be5a "0", file=0x7f4da4f1b329 "lib/stream.c", line=487, function=0x7f4da4f1ba18 "stream_getl") at assert.c:101
#4  0x00007f4da4eddffc in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f4da4ef849c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000559e8cdb4fb6 in ?? ()
#7  0x0000559e8cdb508d in ?? ()
#8  0x00007f4da4ef8f98 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f4da4ee6056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f4da4eb65c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000559e8cdae599 in main ()
2019-09-19 15:08:51,774 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": 
r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 4929]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f4da448b801 in __GI_abort () at abort.c:79
#2  0x00007f4da447b39a in __assert_fail_base (fmt=0x7f4da46027d8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7f4da4f1be5a "0", file=file@entry=0x7f4da4f1b329 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f4da4f1ba18 "stream_getl") at assert.c:92
#3  0x00007f4da447b412 in __GI___assert_fail (assertion=0x7f4da4f1be5a "0", file=0x7f4da4f1b329 "lib/stream.c", line=487, function=0x7f4da4f1ba18 "stream_getl") at assert.c:101
#4  0x00007f4da4eddffc in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f4da4ef849c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000559e8cdb4fb6 in ?? ()
#7  0x0000559e8cdb508d in ?? ()
#8  0x00007f4da4ef8f98 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f4da4ee6056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f4da4eb65c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000559e8cdae599 in main ()


r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 11108]
[New LWP 11110]
[New LWP 11121]
[New LWP 11109]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
[Current thread is 1 (Thread 0x7fc00b37a7c0 (LWP 11108))]
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fc00a599801 in __GI_abort () at abort.c:79
#2  0x00007fc00afe6a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x00007fc00a5f3795 in musable (mem=0x160) at malloc.c:4874
#5  __malloc_usable_size (m=0x160) at malloc.c:4877
#6  0x00007fc00afc8fac in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00005635ca7f62fb in netlink_link_change ()
#8  0x00005635ca7fdd84 in netlink_parse_info ()
#9  0x00005635ca7fe545 in ?? ()
#10 0x00007fc00aff4056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x00007fc00afc45c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#12 0x00005635ca7f189e in main ()
2019-09-19 15:15:02,898 ERROR: assert failed at "test_pim/test_memory_leak": 
r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 11108]
[New LWP 11110]
[New LWP 11121]
[New LWP 11109]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
[Current thread is 1 (Thread 0x7fc00b37a7c0 (LWP 11108))]
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fc00a599801 in __GI_abort () at abort.c:79
#2  0x00007fc00afe6a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x00007fc00a5f3795 in musable (mem=0x160) at malloc.c:4874
#5  __malloc_usable_size (m=0x160) at malloc.c:4877
#6  0x00007fc00afc8fac in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00005635ca7f62fb in netlink_link_change ()
#8  0x00005635ca7fdd84 in netlink_parse_info ()
#9  0x00005635ca7fe545 in ?? ()
#10 0x00007fc00aff4056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x00007fc00afc45c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#12 0x00005635ca7f189e in main ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8962/artifact/TOPOU1804/ErrorLog/log_topotests.txt

CentOS 7 rpm pkg check: Failed (click for details) CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8962/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found
Topotest tests on Ubuntu 16.04 i386: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-8962/test

Topology Tests failed for Topotest tests on Ubuntu 16.04 i386:

RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
*** defaultIntf: warning: r1 has no interfaces
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
r1: Daemon eigrpd not running

r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 10286]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7efcd05 in ?? ()
#0  0xb7efcd05 in ?? ()
#1  <signal handler called>
#2  0x0047abb3 in ?? ()
#3  0xb7e570e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7ea2dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e90b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e5efa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00472baa in main ()

r2: Daemon eigrpd not running

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 10326]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7eebd05 in ?? ()
#0  0xb7eebd05 in ?? ()
#1  <signal handler called>
#2  0x004acbb3 in ?? ()
#3  0xb7e460e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7e91dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e7fb59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e4dfa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004a4baa in main ()

r3: Daemon eigrpd not running

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 10366]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7efdd05 in ?? ()
#0  0xb7efdd05 in ?? ()
#1  <signal handler called>
#2  0x0046fbb3 in ?? ()
#3  0xb7e580e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7ea3dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e91b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e5ffa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00467baa in main ()

2019-09-19 08:04:13,880 ERROR: assert failed at "test_eigrp_topo1/test_converge_protocols": r1: Daemon eigrpd not running
r2: Daemon eigrpd not running
r3: Daemon eigrpd not running


r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 10286]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7efcd05 in ?? ()
#0  0xb7efcd05 in ?? ()
#1  <signal handler called>
#2  0x0047abb3 in ?? ()
#3  0xb7e570e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7ea2dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e90b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e5efa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00472baa in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 10326]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7eebd05 in ?? ()
#0  0xb7eebd05 in ?? ()
#1  <signal handler called>
#2  0x004acbb3 in ?? ()
#3  0xb7e460e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7e91dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e7fb59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e4dfa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004a4baa in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 10366]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7efdd05 in ?? ()
#0  0xb7efdd05 in ?? ()
#1  <signal handler called>
#2  0x0046fbb3 in ?? ()
#3  0xb7e580e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7ea3dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e91b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e5ffa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00467baa in main ()
2019-09-19 08:04:20,448 ERROR: assert failed at "test_eigrp_topo1/test_shutdown_check_stderr": 
r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 10286]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7efcd05 in ?? ()
#0  0xb7efcd05 in ?? ()
#1  <signal handler called>
#2  0x0047abb3 in ?? ()
#3  0xb7e570e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7ea2dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e90b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e5efa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00472baa in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 10326]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7eebd05 in ?? ()
#0  0xb7eebd05 in ?? ()
#1  <signal handler called>
#2  0x004acbb3 in ?? ()
#3  0xb7e460e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7e91dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e7fb59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e4dfa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004a4baa in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 10366]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7efdd05 in ?? ()
#0  0xb7efdd05 in ?? ()
#1  <signal handler called>
#2  0x0046fbb3 in ?? ()
#3  0xb7e580e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7ea3dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e91b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e5ffa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00467baa in main ()

r1: Daemon ospfd not running

r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 13705]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f62d05 in ?? ()
#0  0xb7f62d05 in ?? ()
#1  0xb7f082d6 in zebra_interface_if_set_value () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0x00438cb7 in ?? ()
#3  0xb7ebd112 in if_up_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7f08cea in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7ef6b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7ec4fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00432235 in main ()

2019-09-19 08:08:34,274 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": r1: Daemon ospfd not running


r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 13705]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f62d05 in ?? ()
#0  0xb7f62d05 in ?? ()
#1  0xb7f082d6 in zebra_interface_if_set_value () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0x00438cb7 in ?? ()
#3  0xb7ebd112 in if_up_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7f08cea in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7ef6b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7ec4fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00432235 in main ()
2019-09-19 08:08:34,986 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": 
r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 13705]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f62d05 in ?? ()
#0  0xb7f62d05 in ?? ()
#1  0xb7f082d6 in zebra_interface_if_set_value () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0x00438cb7 in ?? ()
#3  0xb7ebd112 in if_up_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7f08cea in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7ef6b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7ec4fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00432235 in main ()

RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8962/artifact/TOPOI386/ErrorLog/log_topotests.txt

Successful on other platforms
  • Debian 9 deb pkg check
  • IPv4 protocols on Ubuntu 14.04
  • Ubuntu 12.04 deb pkg check
  • Static analyzer (clang)
  • IPv6 protocols on Ubuntu 14.04
  • Ubuntu 16.04 deb pkg check
  • Debian 10 deb pkg check
  • IPv4 ldp protocol on Ubuntu 16.04
  • Ubuntu 14.04 deb pkg check
  • Addresssanitizer topotest
  • Debian 8 deb pkg check

Topology Tests memory analysis: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8962/artifact/TOPOU1604/MemoryLeaks/
Topology Tests memory analysis: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8962/artifact/TOPOU1804/MemoryLeaks/
Topology Tests memory analysis: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8962/artifact/TOPOI386/MemoryLeaks/

Warnings Generated during build:

Checkout code: Successful with additional warnings
Topology tests on Ubuntu 16.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1604-8962/test

Topology Tests failed for Topology tests on Ubuntu 16.04 amd64:

*** defaultIntf: warning: r1 has no interfaces
r1: Daemon eigrpd not running

r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 27952]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fa920fbf428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fa920fbf428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007fa920fc102a in __GI_abort () at abort.c:89
#2  0x00007fa9217e35a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000560d0a890d59 in ?? ()
#5  0x00007fa921803db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fa9217f0ca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fa9217c0f98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000560d0a889182 in main ()

r2: Daemon eigrpd not running

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 27992]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f5c60e03428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f5c60e03428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f5c60e0502a in __GI_abort () at abort.c:89
#2  0x00007f5c616275a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000558fe1a34d59 in ?? ()
#5  0x00007f5c61647db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f5c61634ca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f5c61604f98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000558fe1a2d182 in main ()

r3: Daemon eigrpd not running

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 28040]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f2aa47d9428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f2aa47d9428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f2aa47db02a in __GI_abort () at abort.c:89
#2  0x00007f2aa4ffd5a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000558ca7fbdd59 in ?? ()
#5  0x00007f2aa501ddb4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f2aa500aca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f2aa4fdaf98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000558ca7fb6182 in main ()

2019-09-19 17:03:15,607 ERROR: assert failed at "test_eigrp_topo1/test_converge_protocols": r1: Daemon eigrpd not running
r2: Daemon eigrpd not running
r3: Daemon eigrpd not running


r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 27952]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fa920fbf428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fa920fbf428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007fa920fc102a in __GI_abort () at abort.c:89
#2  0x00007fa9217e35a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000560d0a890d59 in ?? ()
#5  0x00007fa921803db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fa9217f0ca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fa9217c0f98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000560d0a889182 in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 27992]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f5c60e03428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f5c60e03428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f5c60e0502a in __GI_abort () at abort.c:89
#2  0x00007f5c616275a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000558fe1a34d59 in ?? ()
#5  0x00007f5c61647db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f5c61634ca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f5c61604f98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000558fe1a2d182 in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 28040]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f2aa47d9428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f2aa47d9428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f2aa47db02a in __GI_abort () at abort.c:89
#2  0x00007f2aa4ffd5a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000558ca7fbdd59 in ?? ()
#5  0x00007f2aa501ddb4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f2aa500aca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f2aa4fdaf98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000558ca7fb6182 in main ()
2019-09-19 17:03:21,630 ERROR: assert failed at "test_eigrp_topo1/test_shutdown_check_stderr": 
r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 27952]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fa920fbf428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fa920fbf428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007fa920fc102a in __GI_abort () at abort.c:89
#2  0x00007fa9217e35a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000560d0a890d59 in ?? ()
#5  0x00007fa921803db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fa9217f0ca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fa9217c0f98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000560d0a889182 in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 27992]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f5c60e03428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f5c60e03428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f5c60e0502a in __GI_abort () at abort.c:89
#2  0x00007f5c616275a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000558fe1a34d59 in ?? ()
#5  0x00007f5c61647db4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f5c61634ca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f5c61604f98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000558fe1a2d182 in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 28040]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f2aa47d9428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f2aa47d9428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f2aa47db02a in __GI_abort () at abort.c:89
#2  0x00007f2aa4ffd5a0 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000558ca7fbdd59 in ?? ()
#5  0x00007f2aa501ddb4 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f2aa500aca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f2aa4fdaf98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000558ca7fb6182 in main ()

r1: Daemon ospfd not running

r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 31445]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fb0f5b0e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fb0f5b0e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007fb0f5b1002a in __GI_abort () at abort.c:89
#2  0x00007fb0f5b06bd7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7fb0f65807da "0", file=file@entry=0x7fb0f657fca9 "lib/stream.c", line=line@entry=487, function=function@entry=0x7fb0f6580398 "stream_getl") at assert.c:92
#3  0x00007fb0f5b06c82 in __GI___assert_fail (assertion=0x7fb0f65807da "0", file=0x7fb0f657fca9 "lib/stream.c", line=487, function=0x7fb0f6580398 "stream_getl") at assert.c:101
#4  0x00007fb0f6542c5a in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007fb0f655d19c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000558ef1a2a526 in ?? ()
#7  0x0000558ef1a2a5dd in ?? ()
#8  0x00007fb0f655dce8 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007fb0f654aca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007fb0f651af98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000558ef1a23f69 in main ()

2019-09-19 17:07:29,577 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": r1: Daemon ospfd not running


r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 31445]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fb0f5b0e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fb0f5b0e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007fb0f5b1002a in __GI_abort () at abort.c:89
#2  0x00007fb0f5b06bd7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7fb0f65807da "0", file=file@entry=0x7fb0f657fca9 "lib/stream.c", line=line@entry=487, function=function@entry=0x7fb0f6580398 "stream_getl") at assert.c:92
#3  0x00007fb0f5b06c82 in __GI___assert_fail (assertion=0x7fb0f65807da "0", file=0x7fb0f657fca9 "lib/stream.c", line=487, function=0x7fb0f6580398 "stream_getl") at assert.c:101
#4  0x00007fb0f6542c5a in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007fb0f655d19c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000558ef1a2a526 in ?? ()
#7  0x0000558ef1a2a5dd in ?? ()
#8  0x00007fb0f655dce8 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007fb0f654aca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007fb0f651af98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000558ef1a23f69 in main ()
2019-09-19 17:07:30,114 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": 
r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 31445]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fb0f5b0e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fb0f5b0e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007fb0f5b1002a in __GI_abort () at abort.c:89
#2  0x00007fb0f5b06bd7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7fb0f65807da "0", file=file@entry=0x7fb0f657fca9 "lib/stream.c", line=line@entry=487, function=function@entry=0x7fb0f6580398 "stream_getl") at assert.c:92
#3  0x00007fb0f5b06c82 in __GI___assert_fail (assertion=0x7fb0f65807da "0", file=0x7fb0f657fca9 "lib/stream.c", line=487, function=0x7fb0f6580398 "stream_getl") at assert.c:101
#4  0x00007fb0f6542c5a in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007fb0f655d19c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000558ef1a2a526 in ?? ()
#7  0x0000558ef1a2a5dd in ?? ()
#8  0x00007fb0f655dce8 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007fb0f654aca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007fb0f651af98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000558ef1a23f69 in main ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8962/artifact/TOPOU1604/ErrorLog/log_topotests.txt

Fedora 29 rpm pkg check: Failed (click for details) Fedora 29 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8962/artifact/F29RPMCHECK/ErrorLog/log_package_start.txt Fedora 29 rpm pkg check: No useful log found
Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-8962/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

*** defaultIntf: warning: r1 has no interfaces
r1: Daemon eigrpd not running

r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 2066]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f1b60f75801 in __GI_abort () at abort.c:79
#2  0x00007f1b617b7a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000563a4493f219 in ?? ()
#5  0x00007f1b617d8064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f1b617c5056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f1b617955c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000563a449376d2 in main ()

r2: Daemon eigrpd not running

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 2106]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fe38e339801 in __GI_abort () at abort.c:79
#2  0x00007fe38eb7ba2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000558490819219 in ?? ()
#5  0x00007fe38eb9c064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fe38eb89056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fe38eb595c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x00005584908116d2 in main ()

r3: Daemon eigrpd not running

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 2146]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f5ae2ba4801 in __GI_abort () at abort.c:79
#2  0x00007f5ae33e6a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055b294f10219 in ?? ()
#5  0x00007f5ae3407064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f5ae33f4056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f5ae33c45c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055b294f086d2 in main ()

2019-09-19 15:04:40,984 ERROR: assert failed at "test_eigrp_topo1/test_converge_protocols": r1: Daemon eigrpd not running
r2: Daemon eigrpd not running
r3: Daemon eigrpd not running


r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 2066]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f1b60f75801 in __GI_abort () at abort.c:79
#2  0x00007f1b617b7a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000563a4493f219 in ?? ()
#5  0x00007f1b617d8064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f1b617c5056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f1b617955c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000563a449376d2 in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 2106]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fe38e339801 in __GI_abort () at abort.c:79
#2  0x00007fe38eb7ba2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000558490819219 in ?? ()
#5  0x00007fe38eb9c064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fe38eb89056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fe38eb595c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x00005584908116d2 in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 2146]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f5ae2ba4801 in __GI_abort () at abort.c:79
#2  0x00007f5ae33e6a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055b294f10219 in ?? ()
#5  0x00007f5ae3407064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f5ae33f4056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f5ae33c45c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055b294f086d2 in main ()
2019-09-19 15:04:47,689 ERROR: assert failed at "test_eigrp_topo1/test_shutdown_check_stderr": 
r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 2066]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f1b60f75801 in __GI_abort () at abort.c:79
#2  0x00007f1b617b7a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000563a4493f219 in ?? ()
#5  0x00007f1b617d8064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f1b617c5056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f1b617955c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x0000563a449376d2 in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 2106]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fe38e339801 in __GI_abort () at abort.c:79
#2  0x00007fe38eb7ba2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x0000558490819219 in ?? ()
#5  0x00007fe38eb9c064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007fe38eb89056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007fe38eb595c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x00005584908116d2 in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 2146]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f5ae2ba4801 in __GI_abort () at abort.c:79
#2  0x00007f5ae33e6a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x000055b294f10219 in ?? ()
#5  0x00007f5ae3407064 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x00007f5ae33f4056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00007f5ae33c45c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#8  0x000055b294f086d2 in main ()

r1: Daemon ospfd not running

r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 4929]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f4da448b801 in __GI_abort () at abort.c:79
#2  0x00007f4da447b39a in __assert_fail_base (fmt=0x7f4da46027d8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7f4da4f1be5a "0", file=file@entry=0x7f4da4f1b329 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f4da4f1ba18 "stream_getl") at assert.c:92
#3  0x00007f4da447b412 in __GI___assert_fail (assertion=0x7f4da4f1be5a "0", file=0x7f4da4f1b329 "lib/stream.c", line=487, function=0x7f4da4f1ba18 "stream_getl") at assert.c:101
#4  0x00007f4da4eddffc in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f4da4ef849c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000559e8cdb4fb6 in ?? ()
#7  0x0000559e8cdb508d in ?? ()
#8  0x00007f4da4ef8f98 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f4da4ee6056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f4da4eb65c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000559e8cdae599 in main ()

2019-09-19 15:08:51,087 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": r1: Daemon ospfd not running


r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 4929]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f4da448b801 in __GI_abort () at abort.c:79
#2  0x00007f4da447b39a in __assert_fail_base (fmt=0x7f4da46027d8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7f4da4f1be5a "0", file=file@entry=0x7f4da4f1b329 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f4da4f1ba18 "stream_getl") at assert.c:92
#3  0x00007f4da447b412 in __GI___assert_fail (assertion=0x7f4da4f1be5a "0", file=0x7f4da4f1b329 "lib/stream.c", line=487, function=0x7f4da4f1ba18 "stream_getl") at assert.c:101
#4  0x00007f4da4eddffc in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f4da4ef849c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000559e8cdb4fb6 in ?? ()
#7  0x0000559e8cdb508d in ?? ()
#8  0x00007f4da4ef8f98 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f4da4ee6056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f4da4eb65c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000559e8cdae599 in main ()
2019-09-19 15:08:51,774 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": 
r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 4929]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f4da448b801 in __GI_abort () at abort.c:79
#2  0x00007f4da447b39a in __assert_fail_base (fmt=0x7f4da46027d8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7f4da4f1be5a "0", file=file@entry=0x7f4da4f1b329 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f4da4f1ba18 "stream_getl") at assert.c:92
#3  0x00007f4da447b412 in __GI___assert_fail (assertion=0x7f4da4f1be5a "0", file=0x7f4da4f1b329 "lib/stream.c", line=487, function=0x7f4da4f1ba18 "stream_getl") at assert.c:101
#4  0x00007f4da4eddffc in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f4da4ef849c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000559e8cdb4fb6 in ?? ()
#7  0x0000559e8cdb508d in ?? ()
#8  0x00007f4da4ef8f98 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f4da4ee6056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f4da4eb65c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000559e8cdae599 in main ()


r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 11108]
[New LWP 11110]
[New LWP 11121]
[New LWP 11109]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
[Current thread is 1 (Thread 0x7fc00b37a7c0 (LWP 11108))]
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fc00a599801 in __GI_abort () at abort.c:79
#2  0x00007fc00afe6a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x00007fc00a5f3795 in musable (mem=0x160) at malloc.c:4874
#5  __malloc_usable_size (m=0x160) at malloc.c:4877
#6  0x00007fc00afc8fac in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00005635ca7f62fb in netlink_link_change ()
#8  0x00005635ca7fdd84 in netlink_parse_info ()
#9  0x00005635ca7fe545 in ?? ()
#10 0x00007fc00aff4056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x00007fc00afc45c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#12 0x00005635ca7f189e in main ()
2019-09-19 15:15:02,898 ERROR: assert failed at "test_pim/test_memory_leak": 
r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 11108]
[New LWP 11110]
[New LWP 11121]
[New LWP 11109]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
[Current thread is 1 (Thread 0x7fc00b37a7c0 (LWP 11108))]
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fc00a599801 in __GI_abort () at abort.c:79
#2  0x00007fc00afe6a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x00007fc00a5f3795 in musable (mem=0x160) at malloc.c:4874
#5  __malloc_usable_size (m=0x160) at malloc.c:4877
#6  0x00007fc00afc8fac in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x00005635ca7f62fb in netlink_link_change ()
#8  0x00005635ca7fdd84 in netlink_parse_info ()
#9  0x00005635ca7fe545 in ?? ()
#10 0x00007fc00aff4056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x00007fc00afc45c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#12 0x00005635ca7f189e in main ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8962/artifact/TOPOU1804/ErrorLog/log_topotests.txt

CentOS 7 rpm pkg check: Failed (click for details) CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8962/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found
Topotest tests on Ubuntu 16.04 i386: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-8962/test

Topology Tests failed for Topotest tests on Ubuntu 16.04 i386:

RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
*** defaultIntf: warning: r1 has no interfaces
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
r1: Daemon eigrpd not running

r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 10286]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7efcd05 in ?? ()
#0  0xb7efcd05 in ?? ()
#1  <signal handler called>
#2  0x0047abb3 in ?? ()
#3  0xb7e570e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7ea2dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e90b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e5efa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00472baa in main ()

r2: Daemon eigrpd not running

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 10326]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7eebd05 in ?? ()
#0  0xb7eebd05 in ?? ()
#1  <signal handler called>
#2  0x004acbb3 in ?? ()
#3  0xb7e460e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7e91dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e7fb59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e4dfa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004a4baa in main ()

r3: Daemon eigrpd not running

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 10366]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7efdd05 in ?? ()
#0  0xb7efdd05 in ?? ()
#1  <signal handler called>
#2  0x0046fbb3 in ?? ()
#3  0xb7e580e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7ea3dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e91b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e5ffa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00467baa in main ()

2019-09-19 08:04:13,880 ERROR: assert failed at "test_eigrp_topo1/test_converge_protocols": r1: Daemon eigrpd not running
r2: Daemon eigrpd not running
r3: Daemon eigrpd not running


r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 10286]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7efcd05 in ?? ()
#0  0xb7efcd05 in ?? ()
#1  <signal handler called>
#2  0x0047abb3 in ?? ()
#3  0xb7e570e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7ea2dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e90b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e5efa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00472baa in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 10326]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7eebd05 in ?? ()
#0  0xb7eebd05 in ?? ()
#1  <signal handler called>
#2  0x004acbb3 in ?? ()
#3  0xb7e460e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7e91dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e7fb59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e4dfa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004a4baa in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 10366]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7efdd05 in ?? ()
#0  0xb7efdd05 in ?? ()
#1  <signal handler called>
#2  0x0046fbb3 in ?? ()
#3  0xb7e580e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7ea3dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e91b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e5ffa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00467baa in main ()
2019-09-19 08:04:20,448 ERROR: assert failed at "test_eigrp_topo1/test_shutdown_check_stderr": 
r1: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 10286]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7efcd05 in ?? ()
#0  0xb7efcd05 in ?? ()
#1  <signal handler called>
#2  0x0047abb3 in ?? ()
#3  0xb7e570e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7ea2dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e90b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e5efa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00472baa in main ()

r2: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 10326]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7eebd05 in ?? ()
#0  0xb7eebd05 in ?? ()
#1  <signal handler called>
#2  0x004acbb3 in ?? ()
#3  0xb7e460e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7e91dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e7fb59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e4dfa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004a4baa in main ()

r3: eigrpd crashed. Core file found - Backtrace follows:
[New LWP 10366]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/eigrpd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7efdd05 in ?? ()
#0  0xb7efdd05 in ?? ()
#1  <signal handler called>
#2  0x0046fbb3 in ?? ()
#3  0xb7e580e1 in if_new_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7ea3dae in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e91b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e5ffa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00467baa in main ()

r1: Daemon ospfd not running

r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 13705]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f62d05 in ?? ()
#0  0xb7f62d05 in ?? ()
#1  0xb7f082d6 in zebra_interface_if_set_value () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0x00438cb7 in ?? ()
#3  0xb7ebd112 in if_up_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7f08cea in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7ef6b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7ec4fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00432235 in main ()

2019-09-19 08:08:34,274 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": r1: Daemon ospfd not running


r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 13705]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f62d05 in ?? ()
#0  0xb7f62d05 in ?? ()
#1  0xb7f082d6 in zebra_interface_if_set_value () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0x00438cb7 in ?? ()
#3  0xb7ebd112 in if_up_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7f08cea in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7ef6b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7ec4fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00432235 in main ()
2019-09-19 08:08:34,986 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": 
r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 13705]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f62d05 in ?? ()
#0  0xb7f62d05 in ?? ()
#1  0xb7f082d6 in zebra_interface_if_set_value () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0x00438cb7 in ?? ()
#3  0xb7ebd112 in if_up_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7f08cea in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7ef6b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7ec4fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x00432235 in main ()

RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8962/artifact/TOPOI386/ErrorLog/log_topotests.txt

Report for eigrp_interface.c | 6 issues
===============================================
< WARNING: Missing a blank line after declarations
< #143: FILE: /tmp/f1-20253/eigrp_interface.c:143:
< WARNING: C99 // comments do not match recommendation
< #156: FILE: /tmp/f1-20253/eigrp_interface.c:156:
< WARNING: Block comments use a trailing */ on a separate line
< #166: FILE: /tmp/f1-20253/eigrp_interface.c:166:
Report for if.c | 7 issues
===============================================
< WARNING: missing space after struct definition
< #61: FILE: /tmp/f1-20253/if.c:61:
< WARNING: strncat() is error-prone; please use strlcat() if possible#896: FILE: /tmp/f1-20253/if.c:896:
---
> WARNING: strncat() is error-prone; please use strlcat() if possible#861: FILE: /tmp/f2-20253/if.c:861:
309c305
< #973: FILE: /tmp/f1-20253/if.c:973:
Report for isis_circuit.c | 4 issues
===============================================
< WARNING: Block comments use * on subsequent lines
< #1433: FILE: /tmp/f1-20253/isis_circuit.c:1433:
< WARNING: Block comments use a trailing */ on a separate line
< #1433: FILE: /tmp/f1-20253/isis_circuit.c:1433:
Report for ospf6_interface.c | 4 issues
===============================================
< WARNING: quoted string split across lines
< #1954: FILE: /tmp/f1-20253/ospf6_interface.c:1954:
< WARNING: quoted string split across lines
< #1968: FILE: /tmp/f1-20253/ospf6_interface.c:1968:
Report for ospf_interface.c | 12 issues
===============================================
< ERROR: "foo * bar" should be "foo *bar"
< #53: FILE: /tmp/f1-20253/ospf_interface.c:53:
< ERROR: "foo * bar" should be "foo *bar"
< #54: FILE: /tmp/f1-20253/ospf_interface.c:54:
< WARNING: Missing a blank line after declarations
< #1270: FILE: /tmp/f1-20253/ospf_interface.c:1270:
< WARNING: Block comments use a trailing */ on a separate line
< #1289: FILE: /tmp/f1-20253/ospf_interface.c:1289:
< ERROR: do not use assignment in if condition
< #1302: FILE: /tmp/f1-20253/ospf_interface.c:1302:
< ERROR: do not use assignment in if condition
< #1321: FILE: /tmp/f1-20253/ospf_interface.c:1321:
Report for ospf_interface.h | 4 issues
===============================================
< ERROR: "foo * bar" should be "foo *bar"
< #329: FILE: /tmp/f1-20253/ospf_interface.h:329:
< ERROR: "foo * bar" should be "foo *bar"
< #330: FILE: /tmp/f1-20253/ospf_interface.h:330:
Report for pim_iface.c | 10 issues
===============================================
< WARNING: Block comments use * on subsequent lines
< #1609: FILE: /tmp/f1-20253/pim_iface.c:1609:
< WARNING: Missing a blank line after declarations
< #1621: FILE: /tmp/f1-20253/pim_iface.c:1621:
< WARNING: Block comments use * on subsequent lines
< #1653: FILE: /tmp/f1-20253/pim_iface.c:1653:
< WARNING: Block comments use * on subsequent lines
< #1659: FILE: /tmp/f1-20253/pim_iface.c:1659:
< WARNING: braces {} are not necessary for single statement blocks
< #1663: FILE: /tmp/f1-20253/pim_iface.c:1663:
Report for zclient.c | 2 issues
===============================================
< WARNING: void function return statements are not generally useful
< #1607: FILE: /tmp/f1-20253/zclient.c:1607:

CLANG Static Analyzer Summary

  • Github Pull Request 5009, comparing to Git base SHA 16296be

No Changes in Static Analysis warnings compared to base

1 Static Analyzer issues remaining.

See details at
https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8962/artifact/shared/static_analysis/index.html

@NetDEF-CI
Copy link
Collaborator

Continuous Integration Result: FAILED

See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8963/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Failed

Topology tests on Ubuntu 16.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1604-8963/test

Topology Tests failed for Topology tests on Ubuntu 16.04 amd64:

*** defaultIntf: warning: r1 has no interfaces
r1: Daemon ospfd not running

r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 4733]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f1b8533e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f1b8533e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f1b8534002a in __GI_abort () at abort.c:89
#2  0x00007f1b85336bd7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7f1b85db07da "0", file=file@entry=0x7f1b85dafca9 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f1b85db0398 "stream_getl") at assert.c:92
#3  0x00007f1b85336c82 in __GI___assert_fail (assertion=0x7f1b85db07da "0", file=0x7f1b85dafca9 "lib/stream.c", line=487, function=0x7f1b85db0398 "stream_getl") at assert.c:101
#4  0x00007f1b85d72c5a in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f1b85d8d19c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x000056438714e526 in ?? ()
#7  0x000056438714e5dd in ?? ()
#8  0x00007f1b85d8dce8 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f1b85d7aca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f1b85d4af98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000564387147f69 in main ()

2019-09-19 08:50:48,448 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": r1: Daemon ospfd not running


r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 4733]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f1b8533e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f1b8533e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f1b8534002a in __GI_abort () at abort.c:89
#2  0x00007f1b85336bd7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7f1b85db07da "0", file=file@entry=0x7f1b85dafca9 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f1b85db0398 "stream_getl") at assert.c:92
#3  0x00007f1b85336c82 in __GI___assert_fail (assertion=0x7f1b85db07da "0", file=0x7f1b85dafca9 "lib/stream.c", line=487, function=0x7f1b85db0398 "stream_getl") at assert.c:101
#4  0x00007f1b85d72c5a in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f1b85d8d19c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x000056438714e526 in ?? ()
#7  0x000056438714e5dd in ?? ()
#8  0x00007f1b85d8dce8 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f1b85d7aca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f1b85d4af98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000564387147f69 in main ()
2019-09-19 08:50:49,073 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": 
r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 4733]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f1b8533e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f1b8533e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f1b8534002a in __GI_abort () at abort.c:89
#2  0x00007f1b85336bd7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7f1b85db07da "0", file=file@entry=0x7f1b85dafca9 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f1b85db0398 "stream_getl") at assert.c:92
#3  0x00007f1b85336c82 in __GI___assert_fail (assertion=0x7f1b85db07da "0", file=0x7f1b85dafca9 "lib/stream.c", line=487, function=0x7f1b85db0398 "stream_getl") at assert.c:101
#4  0x00007f1b85d72c5a in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f1b85d8d19c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x000056438714e526 in ?? ()
#7  0x000056438714e5dd in ?? ()
#8  0x00007f1b85d8dce8 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f1b85d7aca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f1b85d4af98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000564387147f69 in main ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8963/artifact/TOPOU1604/ErrorLog/log_topotests.txt

Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-8963/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

*** defaultIntf: warning: r1 has no interfaces
r1: Daemon ospfd not running

r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 25328]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fc6dfe69801 in __GI_abort () at abort.c:79
#2  0x00007fc6dfe5939a in __assert_fail_base (fmt=0x7fc6dffe07d8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7fc6e08f9e5a "0", file=file@entry=0x7fc6e08f9329 "lib/stream.c", line=line@entry=487, function=function@entry=0x7fc6e08f9a18 "stream_getl") at assert.c:92
#3  0x00007fc6dfe59412 in __GI___assert_fail (assertion=0x7fc6e08f9e5a "0", file=0x7fc6e08f9329 "lib/stream.c", line=487, function=0x7fc6e08f9a18 "stream_getl") at assert.c:101
#4  0x00007fc6e08bbffc in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007fc6e08d649c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000560f17a90fb6 in ?? ()
#7  0x0000560f17a9108d in ?? ()
#8  0x00007fc6e08d6f98 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007fc6e08c4056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007fc6e08945c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000560f17a8a599 in main ()

2019-09-19 15:51:58,900 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": r1: Daemon ospfd not running


r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 25328]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fc6dfe69801 in __GI_abort () at abort.c:79
#2  0x00007fc6dfe5939a in __assert_fail_base (fmt=0x7fc6dffe07d8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7fc6e08f9e5a "0", file=file@entry=0x7fc6e08f9329 "lib/stream.c", line=line@entry=487, function=function@entry=0x7fc6e08f9a18 "stream_getl") at assert.c:92
#3  0x00007fc6dfe59412 in __GI___assert_fail (assertion=0x7fc6e08f9e5a "0", file=0x7fc6e08f9329 "lib/stream.c", line=487, function=0x7fc6e08f9a18 "stream_getl") at assert.c:101
#4  0x00007fc6e08bbffc in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007fc6e08d649c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000560f17a90fb6 in ?? ()
#7  0x0000560f17a9108d in ?? ()
#8  0x00007fc6e08d6f98 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007fc6e08c4056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007fc6e08945c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000560f17a8a599 in main ()
2019-09-19 15:51:59,709 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": 
r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 25328]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fc6dfe69801 in __GI_abort () at abort.c:79
#2  0x00007fc6dfe5939a in __assert_fail_base (fmt=0x7fc6dffe07d8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7fc6e08f9e5a "0", file=file@entry=0x7fc6e08f9329 "lib/stream.c", line=line@entry=487, function=function@entry=0x7fc6e08f9a18 "stream_getl") at assert.c:92
#3  0x00007fc6dfe59412 in __GI___assert_fail (assertion=0x7fc6e08f9e5a "0", file=0x7fc6e08f9329 "lib/stream.c", line=487, function=0x7fc6e08f9a18 "stream_getl") at assert.c:101
#4  0x00007fc6e08bbffc in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007fc6e08d649c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000560f17a90fb6 in ?? ()
#7  0x0000560f17a9108d in ?? ()
#8  0x00007fc6e08d6f98 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007fc6e08c4056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007fc6e08945c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000560f17a8a599 in main ()


r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 31418]
[New LWP 31420]
[New LWP 31419]
[New LWP 31431]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
[Current thread is 1 (Thread 0x7f29baa5b7c0 (LWP 31418))]
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f29b9c7a801 in __GI_abort () at abort.c:79
#2  0x00007f29ba6c7a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x00007f29b9cd4795 in musable (mem=0x160) at malloc.c:4874
#5  __malloc_usable_size (m=0x160) at malloc.c:4877
#6  0x00007f29ba6a9fac in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x000055575ecda2fb in netlink_link_change ()
#8  0x000055575ece1d84 in netlink_parse_info ()
#9  0x000055575ece2545 in ?? ()
#10 0x00007f29ba6d5056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x00007f29ba6a55c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#12 0x000055575ecd589e in main ()
2019-09-19 15:58:13,192 ERROR: assert failed at "test_pim/test_memory_leak": 
r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 31418]
[New LWP 31420]
[New LWP 31419]
[New LWP 31431]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
[Current thread is 1 (Thread 0x7f29baa5b7c0 (LWP 31418))]
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f29b9c7a801 in __GI_abort () at abort.c:79
#2  0x00007f29ba6c7a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x00007f29b9cd4795 in musable (mem=0x160) at malloc.c:4874
#5  __malloc_usable_size (m=0x160) at malloc.c:4877
#6  0x00007f29ba6a9fac in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x000055575ecda2fb in netlink_link_change ()
#8  0x000055575ece1d84 in netlink_parse_info ()
#9  0x000055575ece2545 in ?? ()
#10 0x00007f29ba6d5056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x00007f29ba6a55c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#12 0x000055575ecd589e in main ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8963/artifact/TOPOU1804/ErrorLog/log_topotests.txt

Topotest tests on Ubuntu 16.04 i386: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-8963/test

Topology Tests failed for Topotest tests on Ubuntu 16.04 i386:

RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
*** defaultIntf: warning: r1 has no interfaces
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
r1: Daemon ospfd not running

r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 29629]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f01d05 in ?? ()
#0  0xb7f01d05 in ?? ()
#1  0xb7ea72d6 in zebra_interface_if_set_value () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0x004bdcb7 in ?? ()
#3  0xb7e5c112 in if_up_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7ea7cea in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e95b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e63fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004b7235 in main ()

2019-09-19 17:50:56,793 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": r1: Daemon ospfd not running


r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 29629]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f01d05 in ?? ()
#0  0xb7f01d05 in ?? ()
#1  0xb7ea72d6 in zebra_interface_if_set_value () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0x004bdcb7 in ?? ()
#3  0xb7e5c112 in if_up_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7ea7cea in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e95b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e63fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004b7235 in main ()
2019-09-19 17:50:57,508 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": 
r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 29629]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f01d05 in ?? ()
#0  0xb7f01d05 in ?? ()
#1  0xb7ea72d6 in zebra_interface_if_set_value () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0x004bdcb7 in ?? ()
#3  0xb7e5c112 in if_up_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7ea7cea in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e95b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e63fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004b7235 in main ()

RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8963/artifact/TOPOI386/ErrorLog/log_topotests.txt

Successful on other platforms
  • IPv4 protocols on Ubuntu 14.04
  • Debian 9 deb pkg check
  • Fedora 29 rpm pkg check
  • IPv4 ldp protocol on Ubuntu 16.04
  • Ubuntu 14.04 deb pkg check
  • Ubuntu 12.04 deb pkg check
  • Static analyzer (clang)
  • IPv6 protocols on Ubuntu 14.04
  • Ubuntu 16.04 deb pkg check
  • Debian 10 deb pkg check
  • CentOS 7 rpm pkg check
  • Addresssanitizer topotest
  • Debian 8 deb pkg check

Topology Tests memory analysis: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8963/artifact/TOPOU1604/MemoryLeaks/
Topology Tests memory analysis: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8963/artifact/TOPOU1804/MemoryLeaks/
Topology Tests memory analysis: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8963/artifact/TOPOI386/MemoryLeaks/

Warnings Generated during build:

Checkout code: Successful with additional warnings
Topology tests on Ubuntu 16.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1604-8963/test

Topology Tests failed for Topology tests on Ubuntu 16.04 amd64:

*** defaultIntf: warning: r1 has no interfaces
r1: Daemon ospfd not running

r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 4733]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f1b8533e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f1b8533e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f1b8534002a in __GI_abort () at abort.c:89
#2  0x00007f1b85336bd7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7f1b85db07da "0", file=file@entry=0x7f1b85dafca9 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f1b85db0398 "stream_getl") at assert.c:92
#3  0x00007f1b85336c82 in __GI___assert_fail (assertion=0x7f1b85db07da "0", file=0x7f1b85dafca9 "lib/stream.c", line=487, function=0x7f1b85db0398 "stream_getl") at assert.c:101
#4  0x00007f1b85d72c5a in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f1b85d8d19c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x000056438714e526 in ?? ()
#7  0x000056438714e5dd in ?? ()
#8  0x00007f1b85d8dce8 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f1b85d7aca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f1b85d4af98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000564387147f69 in main ()

2019-09-19 08:50:48,448 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": r1: Daemon ospfd not running


r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 4733]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f1b8533e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f1b8533e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f1b8534002a in __GI_abort () at abort.c:89
#2  0x00007f1b85336bd7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7f1b85db07da "0", file=file@entry=0x7f1b85dafca9 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f1b85db0398 "stream_getl") at assert.c:92
#3  0x00007f1b85336c82 in __GI___assert_fail (assertion=0x7f1b85db07da "0", file=0x7f1b85dafca9 "lib/stream.c", line=487, function=0x7f1b85db0398 "stream_getl") at assert.c:101
#4  0x00007f1b85d72c5a in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f1b85d8d19c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x000056438714e526 in ?? ()
#7  0x000056438714e5dd in ?? ()
#8  0x00007f1b85d8dce8 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f1b85d7aca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f1b85d4af98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000564387147f69 in main ()
2019-09-19 08:50:49,073 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": 
r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 4733]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f1b8533e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f1b8533e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f1b8534002a in __GI_abort () at abort.c:89
#2  0x00007f1b85336bd7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7f1b85db07da "0", file=file@entry=0x7f1b85dafca9 "lib/stream.c", line=line@entry=487, function=function@entry=0x7f1b85db0398 "stream_getl") at assert.c:92
#3  0x00007f1b85336c82 in __GI___assert_fail (assertion=0x7f1b85db07da "0", file=0x7f1b85dafca9 "lib/stream.c", line=487, function=0x7f1b85db0398 "stream_getl") at assert.c:101
#4  0x00007f1b85d72c5a in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007f1b85d8d19c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x000056438714e526 in ?? ()
#7  0x000056438714e5dd in ?? ()
#8  0x00007f1b85d8dce8 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007f1b85d7aca0 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007f1b85d4af98 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000564387147f69 in main ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8963/artifact/TOPOU1604/ErrorLog/log_topotests.txt

Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-8963/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

*** defaultIntf: warning: r1 has no interfaces
r1: Daemon ospfd not running

r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 25328]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fc6dfe69801 in __GI_abort () at abort.c:79
#2  0x00007fc6dfe5939a in __assert_fail_base (fmt=0x7fc6dffe07d8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7fc6e08f9e5a "0", file=file@entry=0x7fc6e08f9329 "lib/stream.c", line=line@entry=487, function=function@entry=0x7fc6e08f9a18 "stream_getl") at assert.c:92
#3  0x00007fc6dfe59412 in __GI___assert_fail (assertion=0x7fc6e08f9e5a "0", file=0x7fc6e08f9329 "lib/stream.c", line=487, function=0x7fc6e08f9a18 "stream_getl") at assert.c:101
#4  0x00007fc6e08bbffc in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007fc6e08d649c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000560f17a90fb6 in ?? ()
#7  0x0000560f17a9108d in ?? ()
#8  0x00007fc6e08d6f98 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007fc6e08c4056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007fc6e08945c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000560f17a8a599 in main ()

2019-09-19 15:51:58,900 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": r1: Daemon ospfd not running


r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 25328]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fc6dfe69801 in __GI_abort () at abort.c:79
#2  0x00007fc6dfe5939a in __assert_fail_base (fmt=0x7fc6dffe07d8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7fc6e08f9e5a "0", file=file@entry=0x7fc6e08f9329 "lib/stream.c", line=line@entry=487, function=function@entry=0x7fc6e08f9a18 "stream_getl") at assert.c:92
#3  0x00007fc6dfe59412 in __GI___assert_fail (assertion=0x7fc6e08f9e5a "0", file=0x7fc6e08f9329 "lib/stream.c", line=487, function=0x7fc6e08f9a18 "stream_getl") at assert.c:101
#4  0x00007fc6e08bbffc in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007fc6e08d649c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000560f17a90fb6 in ?? ()
#7  0x0000560f17a9108d in ?? ()
#8  0x00007fc6e08d6f98 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007fc6e08c4056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007fc6e08945c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000560f17a8a599 in main ()
2019-09-19 15:51:59,709 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": 
r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 25328]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007fc6dfe69801 in __GI_abort () at abort.c:79
#2  0x00007fc6dfe5939a in __assert_fail_base (fmt=0x7fc6dffe07d8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7fc6e08f9e5a "0", file=file@entry=0x7fc6e08f9329 "lib/stream.c", line=line@entry=487, function=function@entry=0x7fc6e08f9a18 "stream_getl") at assert.c:92
#3  0x00007fc6dfe59412 in __GI___assert_fail (assertion=0x7fc6e08f9e5a "0", file=0x7fc6e08f9329 "lib/stream.c", line=487, function=0x7fc6e08f9a18 "stream_getl") at assert.c:101
#4  0x00007fc6e08bbffc in stream_getl () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#5  0x00007fc6e08d649c in zebra_interface_if_set_value () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#6  0x0000560f17a90fb6 in ?? ()
#7  0x0000560f17a9108d in ?? ()
#8  0x00007fc6e08d6f98 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#9  0x00007fc6e08c4056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#10 0x00007fc6e08945c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x0000560f17a8a599 in main ()


r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 31418]
[New LWP 31420]
[New LWP 31419]
[New LWP 31431]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
[Current thread is 1 (Thread 0x7f29baa5b7c0 (LWP 31418))]
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f29b9c7a801 in __GI_abort () at abort.c:79
#2  0x00007f29ba6c7a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x00007f29b9cd4795 in musable (mem=0x160) at malloc.c:4874
#5  __malloc_usable_size (m=0x160) at malloc.c:4877
#6  0x00007f29ba6a9fac in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x000055575ecda2fb in netlink_link_change ()
#8  0x000055575ece1d84 in netlink_parse_info ()
#9  0x000055575ece2545 in ?? ()
#10 0x00007f29ba6d5056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x00007f29ba6a55c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#12 0x000055575ecd589e in main ()
2019-09-19 15:58:13,192 ERROR: assert failed at "test_pim/test_memory_leak": 
r1: zebra crashed. Core file found - Backtrace follows:
[New LWP 31418]
[New LWP 31420]
[New LWP 31419]
[New LWP 31431]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/zebra'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
[Current thread is 1 (Thread 0x7f29baa5b7c0 (LWP 31418))]
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f29b9c7a801 in __GI_abort () at abort.c:79
#2  0x00007f29ba6c7a2f in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#3  <signal handler called>
#4  0x00007f29b9cd4795 in musable (mem=0x160) at malloc.c:4874
#5  __malloc_usable_size (m=0x160) at malloc.c:4877
#6  0x00007f29ba6a9fac in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#7  0x000055575ecda2fb in netlink_link_change ()
#8  0x000055575ece1d84 in netlink_parse_info ()
#9  0x000055575ece2545 in ?? ()
#10 0x00007f29ba6d5056 in thread_call () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#11 0x00007f29ba6a55c8 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#12 0x000055575ecd589e in main ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8963/artifact/TOPOU1804/ErrorLog/log_topotests.txt

Topotest tests on Ubuntu 16.04 i386: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-8963/test

Topology Tests failed for Topotest tests on Ubuntu 16.04 i386:

RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
*** defaultIntf: warning: r1 has no interfaces
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
r1: Daemon ospfd not running

r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 29629]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f01d05 in ?? ()
#0  0xb7f01d05 in ?? ()
#1  0xb7ea72d6 in zebra_interface_if_set_value () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0x004bdcb7 in ?? ()
#3  0xb7e5c112 in if_up_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7ea7cea in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e95b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e63fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004b7235 in main ()

2019-09-19 17:50:56,793 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": r1: Daemon ospfd not running


r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 29629]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f01d05 in ?? ()
#0  0xb7f01d05 in ?? ()
#1  0xb7ea72d6 in zebra_interface_if_set_value () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0x004bdcb7 in ?? ()
#3  0xb7e5c112 in if_up_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7ea7cea in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e95b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e63fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004b7235 in main ()
2019-09-19 17:50:57,508 ERROR: assert failed at "test_ldp_vpls_topo1/test_memory_leak": 
r1: ospfd crashed. Core file found - Backtrace follows:
[New LWP 29629]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/ospfd'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f01d05 in ?? ()
#0  0xb7f01d05 in ?? ()
#1  0xb7ea72d6 in zebra_interface_if_set_value () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#2  0x004bdcb7 in ?? ()
#3  0xb7e5c112 in if_up_via_zapi () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#4  0xb7ea7cea in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#5  0xb7e95b59 in thread_call () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#6  0xb7e63fa1 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#7  0x004b7235 in main ()

RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8963/artifact/TOPOI386/ErrorLog/log_topotests.txt

Report for eigrp_interface.c | 6 issues
===============================================
< WARNING: Missing a blank line after declarations
< #146: FILE: /tmp/f1-2540/eigrp_interface.c:146:
< WARNING: C99 // comments do not match recommendation
< #159: FILE: /tmp/f1-2540/eigrp_interface.c:159:
< WARNING: Block comments use a trailing */ on a separate line
< #169: FILE: /tmp/f1-2540/eigrp_interface.c:169:
Report for if.c | 7 issues
===============================================
< WARNING: missing space after struct definition
< #61: FILE: /tmp/f1-2540/if.c:61:
< WARNING: strncat() is error-prone; please use strlcat() if possible#896: FILE: /tmp/f1-2540/if.c:896:
---
> WARNING: strncat() is error-prone; please use strlcat() if possible#861: FILE: /tmp/f2-2540/if.c:861:
309c305
< #973: FILE: /tmp/f1-2540/if.c:973:
Report for isis_circuit.c | 4 issues
===============================================
< WARNING: Block comments use * on subsequent lines
< #1433: FILE: /tmp/f1-2540/isis_circuit.c:1433:
< WARNING: Block comments use a trailing */ on a separate line
< #1433: FILE: /tmp/f1-2540/isis_circuit.c:1433:
Report for ospf6_interface.c | 4 issues
===============================================
< WARNING: quoted string split across lines
< #1954: FILE: /tmp/f1-2540/ospf6_interface.c:1954:
< WARNING: quoted string split across lines
< #1968: FILE: /tmp/f1-2540/ospf6_interface.c:1968:
Report for ospf_interface.c | 12 issues
===============================================
< ERROR: "foo * bar" should be "foo *bar"
< #53: FILE: /tmp/f1-2540/ospf_interface.c:53:
< ERROR: "foo * bar" should be "foo *bar"
< #54: FILE: /tmp/f1-2540/ospf_interface.c:54:
< WARNING: Missing a blank line after declarations
< #1270: FILE: /tmp/f1-2540/ospf_interface.c:1270:
< WARNING: Block comments use a trailing */ on a separate line
< #1289: FILE: /tmp/f1-2540/ospf_interface.c:1289:
< ERROR: do not use assignment in if condition
< #1302: FILE: /tmp/f1-2540/ospf_interface.c:1302:
< ERROR: do not use assignment in if condition
< #1321: FILE: /tmp/f1-2540/ospf_interface.c:1321:
Report for ospf_interface.h | 4 issues
===============================================
< ERROR: "foo * bar" should be "foo *bar"
< #329: FILE: /tmp/f1-2540/ospf_interface.h:329:
< ERROR: "foo * bar" should be "foo *bar"
< #330: FILE: /tmp/f1-2540/ospf_interface.h:330:
Report for pim_iface.c | 10 issues
===============================================
< WARNING: Block comments use * on subsequent lines
< #1609: FILE: /tmp/f1-2540/pim_iface.c:1609:
< WARNING: Missing a blank line after declarations
< #1621: FILE: /tmp/f1-2540/pim_iface.c:1621:
< WARNING: Block comments use * on subsequent lines
< #1653: FILE: /tmp/f1-2540/pim_iface.c:1653:
< WARNING: Block comments use * on subsequent lines
< #1659: FILE: /tmp/f1-2540/pim_iface.c:1659:
< WARNING: braces {} are not necessary for single statement blocks
< #1663: FILE: /tmp/f1-2540/pim_iface.c:1663:
Report for zclient.c | 2 issues
===============================================
< WARNING: void function return statements are not generally useful
< #1607: FILE: /tmp/f1-2540/zclient.c:1607:

CLANG Static Analyzer Summary

  • Github Pull Request 5009, comparing to Git base SHA 16296be

No Changes in Static Analysis warnings compared to base

1 Static Analyzer issues remaining.

See details at
https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8963/artifact/shared/static_analysis/index.html

We were storing the interface description irrelevant of whether
or not it was a newlink or dellink.  This makes no sense.

Signed-off-by: Donald Sharp <sharpd@cumulusnetworks.com>
When zebra gets a callback from the kernel that an interface has
actually been deleted *and* the end users has not configured
the interface, then allow for deletion of the interface from zebra.

This is especially important in a docker environment where containers
and their veth interfaces are treated as ephermeal.  FRR can quickly
have an inordinate amount of interfaces sitting around that are
not in the kernel and we have no way to clean them up either.

My expectation is that this will cause a second order crashes
in upper level protocols, but I am not sure how to catch these
and fix them now ( suggestions welcome ).  There are too many
use patterns and order based events that I cannot know for certain
that we are going to see any at all, until someone sees this problem
as a crash :(  I do not recommend that this be put in the current
stabilization branch and allow this to soak in master for some time
first.

Testing:

sharpd@donna ~/frr4> sudo ip link add vethdj type veth peer name vethjd
sharpd@donna ~/frr4> sudo ip link add vethaa type veth peer name vethab
sharpd@donna ~/frr4> sudo vtysh -c "show int brief"
Interface       Status  VRF             Addresses
---------       ------  ---             ---------
dummy1          down    default
enp0s3          up      default         10.0.2.15/24
enp0s8          up      default         192.168.209.2/24
enp0s9          up      default         192.168.210.2/24
enp0s10         up      default         192.168.212.4/24
lo              up      default         10.22.89.38/32
vethaa          down    default
vethab          down    default
vethdj          down    default
vethjd          down    default
virbr0          up      default         192.168.122.1/24
virbr0-nic      down    default

sharpd@donna ~/frr4> sudo ip link set vethaa up
sharpd@donna ~/frr4> sudo ip link set vethab up
sharpd@donna ~/frr4> sudo ip link del vethdj
sharpd@donna ~/frr4> sudo vtysh -c "show int brief"
Interface       Status  VRF             Addresses
---------       ------  ---             ---------
dummy1          down    default
enp0s3          up      default         10.0.2.15/24
enp0s8          up      default         192.168.209.2/24
enp0s9          up      default         192.168.210.2/24
enp0s10         up      default         192.168.212.4/24
lo              up      default         10.22.89.38/32
vethaa          up      default
vethab          up      default
virbr0          up      default         192.168.122.1/24
virbr0-nic      down    default

sharpd@donna ~/frr4> sudo ip link del vethaa
sharpd@donna ~/frr4> sudo vtysh -c "show int brief"
Interface       Status  VRF             Addresses
---------       ------  ---             ---------
dummy1          down    default
enp0s3          up      default         10.0.2.15/24
enp0s8          up      default         192.168.209.2/24
enp0s9          up      default         192.168.210.2/24
enp0s10         up      default         192.168.212.4/24
lo              up      default         10.22.89.38/32
virbr0          up      default         192.168.122.1/24
virbr0-nic      down    default

sharpd@donna ~/frr4> sudo ip link add vethaa type veth peer name vethab
sharpd@donna ~/frr4> sudo vtysh -c "show int brief"
Interface       Status  VRF             Addresses
---------       ------  ---             ---------
dummy1          down    default
enp0s3          up      default         10.0.2.15/24
enp0s8          up      default         192.168.209.2/24
enp0s9          up      default         192.168.210.2/24
enp0s10         up      default         192.168.212.4/24
lo              up      default         10.22.89.38/32
vethaa          down    default
vethab          down    default
virbr0          up      default         192.168.122.1/24
virbr0-nic      down    default

sharpd@donna ~/frr4> sudo vtysh -c "show run"
Building configuration...

Current configuration:
!
frr version 7.2-dev
frr defaults datacenter
hostname donna.cumulusnetworks.com
log stdout
no ipv6 forwarding
!
ip route 192.168.3.0/24 192.168.209.1
ip route 192.168.4.0/24 blackhole
ip route 192.168.5.0/24 192.168.209.1
ip route 192.168.6.0/24 192.168.209.1
ip route 192.168.7.0/24 99.99.99.99 nexthop-vrf EVA
ip route 192.168.8.0/24 192.168.209.1
ip route 4.5.6.7/32 12.13.14.15
!
interface dummy1
 ip address 12.13.14.15/32
!
interface vethaa
 description FROO
!
line vty
!
end
sharpd@donna ~/frr4> sudo ip link del vethaa
sharpd@donna ~/frr4> sudo vtysh -c "show int brief"
Interface       Status  VRF             Addresses
---------       ------  ---             ---------
dummy1          down    default
enp0s3          up      default         10.0.2.15/24
enp0s8          up      default         192.168.209.2/24
enp0s9          up      default         192.168.210.2/24
enp0s10         up      default         192.168.212.4/24
lo              up      default         10.22.89.38/32
vethaa          down    default
virbr0          up      default         192.168.122.1/24
virbr0-nic      down    default

sharpd@donna ~/frr4> sudo vtysh -c "show run"
Building configuration...

Current configuration:
!
frr version 7.2-dev
frr defaults datacenter
hostname donna.cumulusnetworks.com
log stdout
no ipv6 forwarding
!
ip route 192.168.3.0/24 192.168.209.1
ip route 192.168.4.0/24 blackhole
ip route 192.168.5.0/24 192.168.209.1
ip route 192.168.6.0/24 192.168.209.1
ip route 192.168.7.0/24 99.99.99.99 nexthop-vrf EVA
ip route 192.168.8.0/24 192.168.209.1
ip route 4.5.6.7/32 12.13.14.15
!
interface dummy1
 ip address 12.13.14.15/32
!
interface vethaa
 description FROO
!
line vty
!
end

Signed-off-by: Donald Sharp <sharpd@cumulusnetworks.com>
Start the conversion to allow zapi interface callbacks to be
controlled like vrf creation/destruction/change callbacks.

This will allow us to consolidate control into the interface.c
instead of having each daemon read the stream and react accordingly.
This will hopefully reduce a bunch of cut-n-paste stuff

Create 4 new callback functions that will be controlled by
lib/if.c

create -> A upper level protocol receives an interface creation event
The ifp is brand spanking newly created in the system.
up -> A upper level protocol receives a interface up event
This means the interface is up and ready to go.
down -> A upper level protocol receives a interface down
destroy -> A upper level protocol receives a destroy event
This means to delete the pointers associated with it.

At this point this is just boilerplate setup for future commits.
There is no new functionality.

Signed-off-by: Donald Sharp <sharpd@cumulusnetworks.com>
Switch the zclient->interface_add functionality to have everyone
use the interface create callback in lib/if.c

Signed-off-by: Donald Sharp <sharpd@cumulusnetworks.com>
For all the places we have a zclient->interface_up convert
them to use the interface ifp_up callback instead.

Signed-off-by: Donald Sharp <sharpd@cumulusnetworks.com>
Signed-off-by: Donald Sharp <sharpd@cumulusnetworks.com>
Convert the callback of the interface_delete to the new
ifp callback.

Signed-off-by: Donald Sharp <sharpd@cumulusnetworks.com>
In an upper level protocol, delete the interface on notification
about deletion.

Signed-off-by: Donald Sharp <sharpd@cumulusnetworks.com>
@LabN-CI
Copy link
Collaborator

LabN-CI commented Sep 19, 2019

💚 Basic BGPD CI results: SUCCESS, 0 tests failed

Results table
_ _
Result SUCCESS git merge/5009 26f8f6f
Date 09/19/2019
Start 13:35:54
Finish 13:57:30
Run-Time 21:36
Total 1815
Pass 1815
Fail 0
Valgrind-Errors 0
Valgrind-Loss 0
Details vncregress-2019-09-19-13:35:54.txt
Log autoscript-2019-09-19-13:36:42.log.bz2
Memory 431 430 360

For details, please contact louberger

@NetDEF-CI
Copy link
Collaborator

Continuous Integration Result: SUCCESSFUL

Congratulations, this patch passed basic tests

Tested-by: NetDEF / OpenSourceRouting.org CI System

CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8970/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Warnings Generated during build:

Checkout code: Successful with additional warnings
Report for eigrp_interface.c | 6 issues
===============================================
< WARNING: Missing a blank line after declarations
< #146: FILE: /tmp/f1-6886/eigrp_interface.c:146:
< WARNING: C99 // comments do not match recommendation
< #159: FILE: /tmp/f1-6886/eigrp_interface.c:159:
< WARNING: Block comments use a trailing */ on a separate line
< #169: FILE: /tmp/f1-6886/eigrp_interface.c:169:
Report for if.c | 7 issues
===============================================
< WARNING: missing space after struct definition
< #61: FILE: /tmp/f1-6886/if.c:61:
< WARNING: strncat() is error-prone; please use strlcat() if possible#896: FILE: /tmp/f1-6886/if.c:896:
---
> WARNING: strncat() is error-prone; please use strlcat() if possible#861: FILE: /tmp/f2-6886/if.c:861:
309c305
< #973: FILE: /tmp/f1-6886/if.c:973:
Report for isis_circuit.c | 4 issues
===============================================
< WARNING: Block comments use * on subsequent lines
< #1433: FILE: /tmp/f1-6886/isis_circuit.c:1433:
< WARNING: Block comments use a trailing */ on a separate line
< #1433: FILE: /tmp/f1-6886/isis_circuit.c:1433:
Report for ospf6_interface.c | 4 issues
===============================================
< WARNING: quoted string split across lines
< #1954: FILE: /tmp/f1-6886/ospf6_interface.c:1954:
< WARNING: quoted string split across lines
< #1968: FILE: /tmp/f1-6886/ospf6_interface.c:1968:
Report for ospf_interface.c | 12 issues
===============================================
< ERROR: "foo * bar" should be "foo *bar"
< #53: FILE: /tmp/f1-6886/ospf_interface.c:53:
< ERROR: "foo * bar" should be "foo *bar"
< #54: FILE: /tmp/f1-6886/ospf_interface.c:54:
< WARNING: Missing a blank line after declarations
< #1270: FILE: /tmp/f1-6886/ospf_interface.c:1270:
< WARNING: Block comments use a trailing */ on a separate line
< #1287: FILE: /tmp/f1-6886/ospf_interface.c:1287:
< ERROR: do not use assignment in if condition
< #1298: FILE: /tmp/f1-6886/ospf_interface.c:1298:
< ERROR: do not use assignment in if condition
< #1317: FILE: /tmp/f1-6886/ospf_interface.c:1317:
Report for ospf_interface.h | 4 issues
===============================================
< ERROR: "foo * bar" should be "foo *bar"
< #329: FILE: /tmp/f1-6886/ospf_interface.h:329:
< ERROR: "foo * bar" should be "foo *bar"
< #330: FILE: /tmp/f1-6886/ospf_interface.h:330:
Report for pim_iface.c | 10 issues
===============================================
< WARNING: Block comments use * on subsequent lines
< #1609: FILE: /tmp/f1-6886/pim_iface.c:1609:
< WARNING: Missing a blank line after declarations
< #1621: FILE: /tmp/f1-6886/pim_iface.c:1621:
< WARNING: Block comments use * on subsequent lines
< #1653: FILE: /tmp/f1-6886/pim_iface.c:1653:
< WARNING: Block comments use * on subsequent lines
< #1659: FILE: /tmp/f1-6886/pim_iface.c:1659:
< WARNING: braces {} are not necessary for single statement blocks
< #1663: FILE: /tmp/f1-6886/pim_iface.c:1663:
Report for zclient.c | 2 issues
===============================================
< WARNING: void function return statements are not generally useful
< #1610: FILE: /tmp/f1-6886/zclient.c:1610:

CLANG Static Analyzer Summary

  • Github Pull Request 5009, comparing to Git base SHA 16296be

No Changes in Static Analysis warnings compared to base

1 Static Analyzer issues remaining.

See details at
https://ci1.netdef.org/browse/FRR-FRRPULLREQ-8970/artifact/shared/static_analysis/index.html

@@ -39,4 +39,10 @@ extern void pbr_send_pbr_map(struct pbr_map_sequence *pbrms,
struct pbr_map_interface *pmi, bool install);

extern struct pbr_interface *pbr_if_new(struct interface *ifp);

extern int pbr_ifp_create(struct interface *ifp);
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you put these in a pbr_interface.c file and then call a pbr_interface_init()? Just to be more consistent.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why? Not all daemons have a xxx_interface.c file nor is it clear to me that we need another file in pbr to hold 4 functions. What are you hoping to do?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I guess I wrongly assumed this was standardized. I'm fine with whatever as long as we are consistent moving forward.

There also exists a *_vrf.c file in many of the daemons doing the same thing. Should this be in *_zebra.c as well?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No each daemon has taken a somewhat different approach here. I'm fixing a bug here not necessarily trying to standardize behavior. And yes I realize I go in and poke stuff around a bunch. Not sure I'm interested in standardizing this across all daemons( which really is the correct long term behavior ). As that I think this needed to be applied a bunch of places and I didn't want to have to make it work right across them.

Copy link
Member

@riw777 riw777 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm... will push in a couple of days if no-one else takes a peek and has comments.

@pguibert6WIND pguibert6WIND self-assigned this Sep 24, 2019
babeld/babel_interface.c Show resolved Hide resolved
lib/if.c Show resolved Hide resolved
lib/if.c Show resolved Hide resolved
@pguibert6WIND
Copy link
Member

I could make some testing with that release, more specifically on network namespace focus. and it seems it is ok .
so globally, I will approve the pull request.
But I agree this is a big change.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants