Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Tests are probabilistic #19

Closed
calccrypto opened this issue Jul 3, 2023 · 0 comments
Closed

Tests are probabilistic #19

calccrypto opened this issue Jul 3, 2023 · 0 comments

Comments

@calccrypto
Copy link
Collaborator

calccrypto commented Jul 3, 2023 •
edited
Loading

Tests sometimes fail for no obvious reason (See #20), and then pass with another run. See Attempt #1 and Attempt #2 for a607d55.

The tests also do not all pass on my local machine despite passing on Actions.

The reopen test in particular seems to have issues passing consistently.
calccrypto added a commit to calccrypto/xdd that referenced this issue Sep 13, 2023
@calccrypto
fix common.sh weirdness
4c371bd 
tests/CMakeLists.txt was calling configure_file without a copy method, and it was copying common.sh weirdly
fixed test_xdd_reopen.sh - reverted tracing back to open (fixes MigeljanImeri#19)
also fixed a few other issues missed in the previous shellcheck commit
@calccrypto calccrypto mentioned this issue Sep 13, 2023
Merged
calccrypto added a commit to calccrypto/xdd that referenced this issue Sep 13, 2023
@calccrypto
fix common.sh weirdness
c99e556 
tests/CMakeLists.txt was calling configure_file without a copy method, and it was copying common.sh weirdly
fixed test_xdd_reopen.sh (fixes MigeljanImeri#19)
also fixed a few other issues missed in the previous shellcheck commit
calccrypto added a commit to calccrypto/xdd that referenced this issue Sep 13, 2023
@calccrypto
fix common.sh weirdness
d1acc50 
tests/CMakeLists.txt was calling configure_file without a copy method, and it was copying common.sh weirdly
also fixed a few other issues that were prevented by this issue/missed in the previous shellcheck commit
updated test_xdd_reopen.sh
    grep for the words, not just the strings
    ignoring syscall count mismatches for now (see MigeljanImeri#19)
calccrypto added a commit that referenced this issue Sep 25, 2023
@calccrypto
fix common.sh weirdness
a3510a7 
tests/CMakeLists.txt was calling configure_file without a copy method, and it was copying common.sh weirdly
also fixed a few other issues that were prevented by this issue/missed in the previous shellcheck commit
updated test_xdd_reopen.sh
    grep for the words, not just the strings
    ignoring syscall count mismatches for now (see #19)
MigeljanImeri pushed a commit that referenced this issue Sep 28, 2023
@calccrypto @MigeljanImeri
fix common.sh weirdness
e4b13dc 
tests/CMakeLists.txt was calling configure_file without a copy method, and it was copying common.sh weirdly
also fixed a few other issues that were prevented by this issue/missed in the previous shellcheck commit
updated test_xdd_reopen.sh
    grep for the words, not just the strings
    ignoring syscall count mismatches for now (see #19)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@calccrypto