Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

Flaky test in windows GPU CI #13743

Open
azai91 opened this issue Dec 29, 2018 · 3 comments
Open

Flaky test in windows GPU CI #13743

azai91 opened this issue Dec 29, 2018 · 3 comments

Comments

@azai91
Copy link
Contributor

azai91 commented Dec 29, 2018

In the windows-GPU stage of the CI, different test_random tests fail.

test_random.test_exponential_generator fails on commit 6a293fc but passes after updating README
#13595
http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Fwindows-gpu/detail/PR-13595/9/pipeline

test_random.test_uniform_generator
http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Fwindows-gpu/detail/PR-13681/37/pipeline

Seems to only occur on windows GPU build.

For Q & A and discussion, please start a discussion thread at https://discuss.mxnet.io

Description

(Brief description of the problem in no more than 2 sentences.)

Environment info (Required)

What to do:
1. Download the diagnosis script from https://raw.githubusercontent.com/apache/incubator-mxnet/master/tools/diagnose.py
2. Run the script using `python diagnose.py` and paste its output here.

Package used (Python/R/Scala/Julia):
(I'm using ...)

For Scala user, please provide:

  1. Java version: (java -version)
  2. Maven version: (mvn -version)
  3. Scala runtime if applicable: (scala -version)

For R user, please provide R sessionInfo():

Build info (Required if built from source)

Compiler (gcc/clang/mingw/visual studio):

MXNet commit hash:
(Paste the output of git rev-parse HEAD here.)

Build config:
(Paste the content of config.mk, or the build command.)

Error Message:

(Paste the complete error message, including stack trace.)

Minimum reproducible example

(If you are using your own code, please provide a short script that reproduces the error. Otherwise, please provide link to the existing example.)

Steps to reproduce

(Paste the commands you ran that produced the error.)

What have you tried to solve it?

@mxnet-label-bot
Copy link
Contributor

Hey, this is the MXNet Label Bot.
Thank you for submitting the issue! I will try and suggest some labels so that the appropriate MXNet community members can help resolve it.
Here are my recommended labels: CI, Test, Flaky

@vrakesh
Copy link
Contributor

vrakesh commented Dec 31, 2018

@mxnet-label-bot add [CI, Test, Flaky]

@piyushghai
Copy link
Contributor

piyushghai commented Jan 2, 2019

Another test which failed on Windows GPU :
test_operator_gpu.test_multinomial_generator

The failure is here on Jenkins : http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Fwindows-gpu/detail/PR-13678/24/pipeline

Like @azai91 mentioned, the failure happens on Windows GPU only and is flaky in nature.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

5 participants