Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BlackBox tests fail for an OSX build with build type Debug #44

Closed
jacquelinekay opened this issue Jun 4, 2016 · 5 comments
Closed

BlackBox tests fail for an OSX build with build type Debug #44

jacquelinekay opened this issue Jun 4, 2016 · 5 comments

Comments

@jacquelinekay
Copy link

On the ROS 2 CI farm, we observe that the BlackBox tests fail in the case "BlackBox.AsyncPubSubAsNonReliableData300kb" on an OSX machine built with -DCMAKE_BUILD_TYPE=Debug.

http://ci.ros2.org/view/nightly/job/nightly_osx_debug/101/testReport/projectroot.test/blackbox/BlackboxTests/

@richiware
Copy link
Member

We will check it in a OSX machine.

@gerkey
Copy link
Contributor

gerkey commented Jun 15, 2016

Here's the console output from a recent failure:

11:15:03 1: [ RUN      ] BlackBox.AsyncPubSubAsNonReliableData300kb
11:15:03 1: Writer waiting for discovery...
11:15:03 1: Writer discovery phase finished
11:15:03 1: Reader waiting for discovery...
11:15:03 1: Reader discovery phase finished
11:21:44 1: Samples not received: 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 
11:21:44 1: /Users/osrf/jenkins/workspace/nightly_osx_debug/ws/src/eProsima/Fast-RTPS/test/blackbox/BlackboxTests.cpp:720: Failure
11:21:44 1: Value of: 0
11:21:44 1: Expected: data.size()
11:21:44 1: Which is: 20
11:21:44 1: [  FAILED  ] BlackBox.AsyncPubSubAsNonReliableData300kb (400770 ms)

It looks like AsyncPubSubAsNonReliableData300kb takes ~6.5 minutes to run (perhaps related to #46) and fails.

@gerkey
Copy link
Contributor

gerkey commented Jun 15, 2016

I can reproduce the delay and failure locally, having built Fast-CDR and Fast-RTPS in Debug:

$ ./test/blackbox/BlackboxTests --gtest_filter="*AsyncPubSubAsNonReliableData300kb"
Note: Google Test filter = *AsyncPubSubAsNonReliableData300kb
[==========] Running 1 test from 1 test case.
[----------] Global test environment set-up.
[----------] 1 test from BlackBox
[ RUN      ] BlackBox.AsyncPubSubAsNonReliableData300kb
Writer waiting for discovery...
Writer discovery phase finished
Reader waiting for discovery...
Reader discovery phase finished
Samples not received: 10 12 13 14 15 16 17 18 19 20 21 22 23 24 27 28 29 30 
/tmp/f/src/Fast-RTPS/test/blackbox/BlackboxTests.cpp:737: Failure
Value of: 0
Expected: data.size()
Which is: 18
[  FAILED  ] BlackBox.AsyncPubSubAsNonReliableData300kb (400632 ms)
[----------] 1 test from BlackBox (400632 ms total)

[----------] Global test environment tear-down
[==========] 1 test from 1 test case ran. (400737 ms total)
[  PASSED  ] 0 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] BlackBox.AsyncPubSubAsNonReliableData300kb

 1 FAILED TEST

@richiprosima
Copy link
Contributor

Hi @jacquelinekay.

Non-reliable tests were refactored in version 1.2.0. They are now more
determinative and not fail in OSX. Thanks.

@gerkey
Copy link
Contributor

gerkey commented Jun 23, 2016

Indeed, that test started passing last night:

http://ci.ros2.org/view/nightly/job/nightly_osx_debug/125/testReport/

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants