Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AIX jdk8_openj9-0.26.0-m1 : javax/rmi/ssl/SSLSocketParametersTest.sh.SSLSocketParametersTest : java.rmi.NoSuchObjectException #12168

Open
andrew-m-leonard opened this issue Mar 10, 2021 · 21 comments

Comments

@andrew-m-leonard
Copy link
Contributor

javax/rmi/ssl/SSLSocketParametersTest.sh.SSLSocketParametersTest
https://ci.adoptopenjdk.net/job/Test_openjdk8_j9_extended.openjdk_ppc64_aix/17/consoleFull

13:27:44  openjdk version "1.8.0_292"
13:27:44  OpenJDK Runtime Environment (build 1.8.0_292-202103091149-b05)
13:27:44  Eclipse OpenJ9 VM (build openj9-0.26.0-m1, JRE 1.8.0 AIX ppc64-64-Bit Compressed References 20210309_991 (JIT enabled, AOT enabled)
13:27:44  OpenJ9   - b227feba2
13:27:44  OMR      - 4665e2f72
13:27:44  JCL      - 1780cbc92b based on jdk8u292-b05)
14:00:34  -------------------------------------------------------------
14:00:34  Launching test for SSLSocketParametersTest
14:00:34  -------------------------------------------------------------
14:00:34  KeyStore = /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_ppc64_aix/openjdk-tests/openjdk/openjdk-jdk/jdk/test/javax/rmi/ssl/keystore
14:00:34  TrustStore = /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_ppc64_aix/openjdk-tests/openjdk/openjdk-jdk/jdk/test/javax/rmi/ssl/truststore
14:00:34  Running SSLSocketParametersTest [1]
14:00:34  ServerFactory::Calling createServerSocket(0)
14:00:34  Inside HelloImpl::runServer
14:00:34  Stub = Proxy[SSLSocketParametersTest$Hello,RemoteObjectInvocationHandler[UnicastRef2 [liveRef: [endpoint:[140.211.9.28:44417,SSLSocketParametersTest$ServerFactory@3f98c7f7,SSLSocketParametersTest$ClientFactory@bb7579f1](local),objID:[-1a3aaedf:1781749f858:-7fff, 8154199408189112208]]]]]
14:00:34  Inside HelloClient::runClient
14:00:34  ClientFactory::Calling createSocket(140.211.9.28,44417)
14:00:34  SSLSocketParametersTest [1] FAILED! Exception: java.rmi.NoSuchObjectException: no such object in table
14:00:34  java.rmi.NoSuchObjectException: no such object in table
14:00:34  	at sun.rmi.transport.StreamRemoteCall.exceptionReceivedFromServer(StreamRemoteCall.java:303)
14:00:34  	at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:279)
14:00:34  	at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:164)
14:00:34  	at java.rmi.server.RemoteObjectInvocationHandler.invokeRemoteMethod(RemoteObjectInvocationHandler.java:235)
14:00:34  	at java.rmi.server.RemoteObjectInvocationHandler.invoke(RemoteObjectInvocationHandler.java:180)
14:00:34  	at com.sun.proxy.$Proxy0.sayHello(Unknown Source)
14:00:34  	at SSLSocketParametersTest$HelloClient.runClient(SSLSocketParametersTest.java:75)
14:00:34  	at SSLSocketParametersTest.runTest(SSLSocketParametersTest.java:137)
14:00:34  	at SSLSocketParametersTest.main(SSLSocketParametersTest.java:286)
@pshipton
Copy link
Member

@andrew-m-leonard can you pls grind this and get a failure rate.

#8515 looks related.

@pshipton pshipton added this to the JTReg Backlog milestone Mar 10, 2021
@andrew-m-leonard
Copy link
Contributor Author

I did a Grinderx20 on AIX today and all passed!
The problem was also seen on Win32 and Win64, i'm waiting to try a Grinder on them as well

@andrew-m-leonard
Copy link
Contributor Author

andrew-m-leonard commented Mar 11, 2021

@andrew-m-leonard
Copy link
Contributor Author

AIX grinder showed intermittent 6 failures in 20 runs: https://ci.adoptopenjdk.net/job/Grinder/7593/
@pshipton fyi

@pshipton
Copy link
Member

Pls try another grinder with -Xint

@andrew-m-leonard
Copy link
Contributor Author

Grinder with -Xint: https://ci.adoptopenjdk.net/job/Grinder/7728/console

@andrew-m-leonard
Copy link
Contributor Author

@pshipton https://ci.adoptopenjdk.net/job/Grinder/7728/console 2 out of 40 failed all with -Xint

@pshipton
Copy link
Member

Is this problem also seen on Hotspot via grinder?

@andrew-m-leonard
Copy link
Contributor Author

andrew-m-leonard commented Mar 18, 2021

Hotspot grinder: https://ci.adoptopenjdk.net/job/Grinder/7842/console
x20 Grinder all Green
@pshipton fyi

@JasonFengJ9
Copy link
Member

Observed in an internal build Test_openjdk8_j9_extended.openjdk_x86-64_windows/8/ (win16x64rt3-3)

openjdk version "1.8.0_302"
OpenJDK Runtime Environment (build 1.8.0_302-b01)
Eclipse OpenJ9 VM (build master-1e9235835, JRE 1.8.0 Windows Server 2016 amd64-64-Bit Compressed References 20210508_122 (JIT enabled, AOT enabled)
OpenJ9   - 1e9235835
OMR      - 7bff18ff5
JCL      - e0e56cb2 based on jdk8u302-b01)

[2021-05-08T07:11:10.752Z] SSLSocketParametersTest [2] FAILED! Exception: java.rmi.NoSuchObjectException: no such object in table
[2021-05-08T07:11:10.752Z] java.rmi.NoSuchObjectException: no such object in table
[2021-05-08T07:11:10.752Z] 	at sun.rmi.transport.StreamRemoteCall.exceptionReceivedFromServer(StreamRemoteCall.java:303)
[2021-05-08T07:11:10.752Z] 	at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:279)
[2021-05-08T07:11:10.753Z] 	at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:164)
[2021-05-08T07:11:10.753Z] 	at java.rmi.server.RemoteObjectInvocationHandler.invokeRemoteMethod(RemoteObjectInvocationHandler.java:235)
[2021-05-08T07:11:10.753Z] 	at java.rmi.server.RemoteObjectInvocationHandler.invoke(RemoteObjectInvocationHandler.java:180)
[2021-05-08T07:11:10.753Z] 	at com.sun.proxy.$Proxy0.sayHello(Unknown Source)
[2021-05-08T07:11:10.753Z] 	at SSLSocketParametersTest$HelloClient.runClient(SSLSocketParametersTest.java:75)
[2021-05-08T07:11:10.753Z] 	at SSLSocketParametersTest.runTest(SSLSocketParametersTest.java:156)
[2021-05-08T07:11:10.753Z] 	at SSLSocketParametersTest.main(SSLSocketParametersTest.java:286)

@pshipton
Copy link
Member

@JasonFengJ9 can you repeat it?

@pshipton
Copy link
Member

pshipton commented May 10, 2021

Created a 10 x 4 grinder https://ci.eclipse.org/openj9/view/Test/job/Grinder/1803/ - repeated the failure a number of times.

@JasonFengJ9
Copy link
Member

JasonFengJ9 commented May 31, 2021

Another occurrence at an internal build JDK8 MacOS Test_openjdk8_j9_extended.openjdk_x86-64_mac/7/ (mac11x64rt02):

[2021-05-29T04:05:01.867Z] SSLSocketParametersTest [2] FAILED! Exception: java.rmi.NoSuchObjectException: no such object in table
[2021-05-29T04:05:01.867Z] java.rmi.NoSuchObjectException: no such object in table
[2021-05-29T04:05:01.867Z] 	at sun.rmi.transport.StreamRemoteCall.exceptionReceivedFromServer(StreamRemoteCall.java:303)
[2021-05-29T04:05:01.867Z] 	at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:279)
[2021-05-29T04:05:01.867Z] 	at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:164)
[2021-05-29T04:05:01.867Z] 	at java.rmi.server.RemoteObjectInvocationHandler.invokeRemoteMethod(RemoteObjectInvocationHandler.java:235)
[2021-05-29T04:05:01.867Z] 	at java.rmi.server.RemoteObjectInvocationHandler.invoke(RemoteObjectInvocationHandler.java:180)
[2021-05-29T04:05:01.867Z] 	at com.sun.proxy.$Proxy0.sayHello(Unknown Source)
[2021-05-29T04:05:01.867Z] 	at SSLSocketParametersTest$HelloClient.runClient(SSLSocketParametersTest.java:75)
[2021-05-29T04:05:01.867Z] 	at SSLSocketParametersTest.runTest(SSLSocketParametersTest.java:156)
[2021-05-29T04:05:01.867Z] 	at SSLSocketParametersTest.main(SSLSocketParametersTest.java:286)

Also occurred at JDK8 AIX Test_openjdk8_j9_extended.openjdk_ppc64_aix/12/ (paix826):

[2021-05-29T09:32:03.263Z] SSLSocketParametersTest [1] FAILED! Exception: java.rmi.NoSuchObjectException: no such object in table
[2021-05-29T09:32:03.263Z] java.rmi.NoSuchObjectException: no such object in table
[2021-05-29T09:32:03.263Z] 	at sun.rmi.transport.StreamRemoteCall.exceptionReceivedFromServer(StreamRemoteCall.java:303)
[2021-05-29T09:32:03.263Z] 	at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:279)
[2021-05-29T09:32:03.263Z] 	at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:164)
[2021-05-29T09:32:03.263Z] 	at java.rmi.server.RemoteObjectInvocationHandler.invokeRemoteMethod(RemoteObjectInvocationHandler.java:235)
[2021-05-29T09:32:03.263Z] 	at java.rmi.server.RemoteObjectInvocationHandler.invoke(RemoteObjectInvocationHandler.java:180)
[2021-05-29T09:32:03.263Z] 	at com.sun.proxy.$Proxy0.sayHello(Unknown Source)
[2021-05-29T09:32:03.263Z] 	at SSLSocketParametersTest$HelloClient.runClient(SSLSocketParametersTest.java:75)
[2021-05-29T09:32:03.263Z] 	at SSLSocketParametersTest.runTest(SSLSocketParametersTest.java:137)
[2021-05-29T09:32:03.263Z] 	at SSLSocketParametersTest.main(SSLSocketParametersTest.java:286)

@JasonFengJ9
Copy link
Member

Observed at JDK8 MacOS Test_openjdk8_j9_extended.openjdk_x86-64_mac/11/ (osxrt8 ), so this is not AIX specific.

openjdk version "1.8.0_302"
OpenJDK Runtime Environment (build 1.8.0_302-b05)
Eclipse OpenJ9 VM (build master-0be9a6f3f, JRE 1.8.0 Mac OS X amd64-64-Bit Compressed References 20210618_157 (JIT enabled, AOT enabled)
OpenJ9   - 0be9a6f3f
OMR      - b7eb96336
JCL      - be819230 based on jdk8u302-b05)

Rerun in Grinder

[2021-06-19T03:01:25.250Z] Running test jdk_other_1 ...
[2021-06-19T03:01:25.250Z] ===============================================
[2021-06-19T03:01:25.250Z] jdk_other_1 Start Time: Fri Jun 18 23:01:17 2021 Epoch Time (ms): 1624071677896
[2021-06-19T03:01:25.250Z] "/Users/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_x86-64_mac/openjdkbinary/j2sdk-image/Contents/Home/bin/..//bin/java" -Xshareclasses:destroyAll; "/Users/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_x86-64_mac/openjdkbinary/j2sdk-image/Contents/Home/bin/..//bin/java" -Xshareclasses:groupAccess,destroyAll; echo "cache cleanup done";
[2021-06-19T03:01:25.250Z] JVMSHRC005I No shared class caches available
[2021-06-19T03:01:25.250Z] JVMSHRC005I No shared class caches available
[2021-06-19T03:01:25.250Z] cache cleanup done
[2021-06-19T03:01:25.250Z] variation: Mode650
[2021-06-19T03:01:25.250Z] JVM_OPTIONS:  -XX:-UseCompressedOops 

[2021-06-19T03:02:01.273Z] -------------------------------------------------------------
[2021-06-19T03:02:01.273Z] Launching test for SSLSocketParametersTest
[2021-06-19T03:02:01.273Z] -------------------------------------------------------------
[2021-06-19T03:02:01.273Z] KeyStore = /Users/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_x86-64_mac/aqa-tests/openjdk/openjdk-jdk/jdk/test/javax/rmi/ssl/keystore
[2021-06-19T03:02:01.273Z] TrustStore = /Users/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_x86-64_mac/aqa-tests/openjdk/openjdk-jdk/jdk/test/javax/rmi/ssl/truststore
[2021-06-19T03:02:01.273Z] Running SSLSocketParametersTest [1]
[2021-06-19T03:02:01.273Z] ServerFactory::Calling createServerSocket(0)
[2021-06-19T03:02:01.273Z] Inside HelloImpl::runServer
[2021-06-19T03:02:01.273Z] Stub = Proxy[SSLSocketParametersTest$Hello,RemoteObjectInvocationHandler[UnicastRef2 [liveRef: [endpoint:[9.42.99.239:53551,SSLSocketParametersTest$ServerFactory@d1988942,SSLSocketParametersTest$ClientFactory@a0b8aa41](local),objID:[-60f33884:17a2237cccb:-7fff, -2789099437545161867]]]]]
[2021-06-19T03:02:01.273Z] Inside HelloClient::runClient
[2021-06-19T03:02:01.273Z] ClientFactory::Calling createSocket(9.42.99.239,53551)
[2021-06-19T03:02:01.273Z] SSLSocketParametersTest [1] FAILED! Exception: java.rmi.NoSuchObjectException: no such object in table
[2021-06-19T03:02:01.273Z] java.rmi.NoSuchObjectException: no such object in table
[2021-06-19T03:02:01.273Z] 	at sun.rmi.transport.StreamRemoteCall.exceptionReceivedFromServer(StreamRemoteCall.java:303)
[2021-06-19T03:02:01.273Z] 	at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:279)
[2021-06-19T03:02:01.273Z] 	at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:164)
[2021-06-19T03:02:01.273Z] 	at java.rmi.server.RemoteObjectInvocationHandler.invokeRemoteMethod(RemoteObjectInvocationHandler.java:235)
[2021-06-19T03:02:01.273Z] 	at java.rmi.server.RemoteObjectInvocationHandler.invoke(RemoteObjectInvocationHandler.java:180)
[2021-06-19T03:02:01.273Z] 	at com.sun.proxy.$Proxy0.sayHello(Unknown Source)
[2021-06-19T03:02:01.273Z] 	at SSLSocketParametersTest$HelloClient.runClient(SSLSocketParametersTest.java:75)
[2021-06-19T03:02:01.273Z] 	at SSLSocketParametersTest.runTest(SSLSocketParametersTest.java:137)
[2021-06-19T03:02:01.273Z] 	at SSLSocketParametersTest.main(SSLSocketParametersTest.java:286)

@pshipton
Copy link
Member

pshipton commented Jul 8, 2021

10 x 4 Windows grinder passed https://openj9-jenkins.osuosl.org/view/Test/job/Grinder/103

@pshipton
Copy link
Member

pshipton commented Jul 8, 2021

20 x 4 AIX grinder reproduced it on 3 of the 4 machines.
https://openj9-jenkins.osuosl.org/view/Test/job/Grinder/105

@pshipton
Copy link
Member

pshipton commented Jul 8, 2021

Can reproduce the failure on Windows by running jdk_other_1 instead of the individual test.
https://openj9-jenkins.osuosl.org/view/Test/job/Grinder/106/
10 x 4 which failed 33/40.

@pshipton
Copy link
Member

pshipton commented Jul 9, 2021

This is a test problem. See https://stackoverflow.com/questions/645208/java-rmi-nosuchobjectexception-no-such-object-in-table

If the test is modified to keep the server object alive in each sub-test then it passes.

@llxia
Copy link
Contributor

llxia commented Jul 18, 2022

@LongyuZhang could you update the exclude to exclude on all platforms? Thanks
https://github.com/adoptium/aqa-tests/blob/1e2a806da7a35b78cb6a3b0ed14602321a9658a8/openjdk/excludes/ProblemList_openjdk8-openj9.txt#L137

Please also packport the change into v0.9.3-release branch.

@JasonFengJ9
Copy link
Member

This java.rmi.NoSuchObjectException: no such object in table occurred often in JDK21 runs, created

JDK21 ppc64_aix
JDK21 aarch64_linux
JDK21 x86-64_linux

@pshipton
Copy link
Member

Excluded on jdk17
adoptium/aqa-tests#5307

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants