-
Notifications
You must be signed in to change notification settings - Fork 4.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
overdue a lot after using 2 d435 for a long time on Android #4066
Comments
we update the librealsense sdk to 2.22.0. 1.Still can't see much different from the kernal log. Than we kill the process with out pulling out USB. |
Hi @guokiddo1 |
We do a lot of work to fix this. 1.we open the devices not from Java(Android) but from JNI. We use libuvc to open the D435. We use tcpdump to get all the USB BUS data when running the process. We are pretty sure the hardware is still connected. But the problem is that if everytime we use hardware_reset(), it will cost about 30s to open 2 RGBD. Now we are trying to fix the problem by logging the transfer->status from libuvc/stream.cpp first. Do you have any more advices for this ? |
By the way, we are using sdk 2.23.0. |
We add logs (print transfer->status) in src/libuvc/stream.cpp when get _uvc_stream_callback When one rgbd return nothing status:1 refer LIBUSB_TRANSFER_ERROR the origion code like this: We will try libusb_clear_halt to reset the end-point |
Reset the endpoint (clear halt) might do the work. |
@guokiddo1 Any luck with libusb_clear_halt? |
for our new binary version.
And some very strange things happends. We are not sure wheather it is a bug of D435 or SDK or our RK3399. So we are now very conflusing about our next step and |
I also see this issue on my FIreFly boards (3399 and 3328) with the solution for un-rooted devices. Configure more streams at higher resolutions accelerates the reproduction. When checking the dmesg log this is what is get: I was not able to reproduce it on pixel 2 or Samsung S8. |
We run it as root devices |
Tracked by DSO-13154. No progress yet. |
@guokiddo1 With your confirmation we will close this issue. Thanks for the feedback! |
Before opening a new issue, we wanted to provide you with some useful suggestions (Click "Preview" above for a better view):
All users are welcomed to report bugs, ask questions, suggest or request enhancements and generally feel free to open new issue, even if they haven't followed any of the suggestions above :)
Issue Description###
<Describe your issue / question / feature request / etc..>
Hi. Our team using 2 d435 on RK3399.
1.We build librealsense2.so from Android Studios.
2.And use it in a binary(name: RGBD_Server) which only get the streams from the 2 RGBD and send out through socket.
3.adb connect to the RK3399. Push the binary and the libs to it. And run the binary through cmd.
./RGBD_Server
Configs of 2 d435:
W x H = 848 x 480
fps = 15
preset = HIGH_ACCURACY
streams = depth & left IR
TEST:
At first 2 RGBD works fine. But we notice that after about 4 hours(more or less), one of the RGBD become very unstable.
So we change the log level to DEBUG and open the Android kernal log test it again.
RESULT:
kernal log: libuvc show no ERROR
librealsense log:
the frequency will be very high!
3.After about 6 hours, one of the RGBD becomes unstable. And soon(maybe about 10 mins later) even lsusb cant find it.
the following logs contains the 3 phenomenon above.
23/05 11:49:53,527 DEBUG [516574672112] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\sync.cpp:516) fps 15 Infrared 109482 3012241.778000 Depth 109482 3012241.778000
23/05 11:49:53,527 DEBUG [516574672112] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\sync.cpp:529) (TS: )Infrared 109482 3012241.778000 Depth 109482 3012241.778000 fps 15 gap 66.666664 next_expected: 3012308.444664
23/05 11:49:53,527 DEBUG [516574672112] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:288) CallbackFinished,Infrared,0,DispatchedAt,1558612193527.291016
23/05 11:49:53,527 DEBUG [516574672112] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:295) Frame Callback [Infrared#0] overdue. (Duration: 1558612193527.291016ms, FPS: 15, Max Duration: 62ms)
23/05 11:49:53,527 DEBUG [516574672112] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\proc\syncer-processing-block.cpp:28) SYNCED: Infrared 109482, 3012241.778000 Depth 109482, 3012241.778000
23/05 11:49:53,527 DEBUG [516574672112] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:502) CallbackStarted,Infrared,109482,DispatchedAt,1558612193527.592041
23/05 11:49:53,527 DEBUG [516574672112] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:288) CallbackFinished,Infrared,109481,DispatchedAt,1558612193527.679932
23/05 11:49:53,527 DEBUG [516574672112] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:295) Frame Callback [Infrared#109481] overdue. (Duration: 77.159912ms, FPS: 15, Max Duration: 62ms)
23/05 11:49:53,527 DEBUG [516574672112] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:288) CallbackFinished,Depth,109481,DispatchedAt,1558612193527.866943
23/05 11:49:53,527 DEBUG [516574672112] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:295) Frame Callback [Depth#109481] overdue. (Duration: 69.266846ms, FPS: 15, Max Duration: 62ms)
23/05 11:49:53,528 DEBUG [516574672112] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:502) CallbackStarted,Depth,109482,DispatchedAt,1558612193528.048096
23/05 11:49:53,528 DEBUG [516574672112] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:288) CallbackFinished,Depth,0,DispatchedAt,1558612193528.102051
23/05 11:49:53,529 DEBUG [516574672112] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:288) CallbackFinished,Infrared,0,DispatchedAt,1558612193528.159912
23/05 11:49:53,533 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\sensor.cpp:453) FrameAccepted,Depth,Counter,0,Index,0,BackEndTS,0.000000,SystemTime,1558612193533.135010 ,diff_ts[Sys-BE],1558612193533.135010,TS,3021743.526000,TS_Domain,Hardware Clock,last_frame_number,0,last_timestamp,0.000000
23/05 11:49:53,536 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:502) CallbackStarted,Depth,0,DispatchedAt,1558612193536.345947
23/05 11:49:53,537 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\sync.cpp:143) DISPATCH (TS: )--> Depth 0 3021743.526000
23/05 11:49:53,537 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\sync.cpp:551) clean inactive stream in (TS: )Depth Infrared Infrared Color
23/05 11:49:53,537 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\sync.cpp:551) clean inactive stream in (TS: )Depth Infrared Infrared Color
23/05 11:49:53,537 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\sync.cpp:551) clean inactive stream in (TS: )Depth Infrared Infrared Color
23/05 11:49:53,537 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\sync.cpp:551) clean inactive stream in (TS: )Depth Infrared Infrared Color
23/05 11:49:53,538 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\sync.cpp:143) DISPATCH (TS: (FN: I Depth I Infrared I Infrared ) I Color )--> Depth 0 3021743.526000
23/05 11:49:53,538 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\sync.cpp:551) clean inactive stream in (TS: (FN: I Depth I Infrared I Infrared ) I Color )Depth Infrared Infrared
23/05 11:49:53,538 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\sync.cpp:551) clean inactive stream in (TS: (FN: I Depth I Infrared I Infrared ) I Color )Depth Infrared Infrared
23/05 11:49:53,538 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\sync.cpp:551) clean inactive stream in (TS: (FN: I Depth I Infrared I Infrared ) I Color )Depth Infrared Infrared
23/05 11:49:53,538 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\sync.cpp:143) DISPATCH (FN: I Depth I Infrared I Infrared )--> Depth 0 3021743.526000
23/05 11:49:53,538 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\sync.cpp:422) clean inactive stream in (FN: I Depth I Infrared I Infrared )Depth
23/05 11:49:53,538 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\sync.cpp:422) clean inactive stream in (FN: I Depth I Infrared I Infrared )Infrared
23/05 11:49:53,539 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:288) CallbackFinished,Depth,109575,DispatchedAt,1558612193539.012939
23/05 11:49:53,539 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:295) Frame Callback [Depth#109575] overdue. (Duration: 2885.302002ms, FPS: 15, Max Duration: 62ms)
23/05 11:49:53,539 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:288) CallbackFinished,Depth,109575,DispatchedAt,1558612193539.459961
23/05 11:49:53,539 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:295) Frame Callback [Depth#109575] overdue. (Duration: 2819.269043ms, FPS: 15, Max Duration: 62ms)
23/05 11:49:53,539 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:288) CallbackFinished,Depth,109575,DispatchedAt,1558612193539.768066
23/05 11:49:53,539 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:295) Frame Callback [Depth#109575] overdue. (Duration: 2752.756104ms, FPS: 15, Max Duration: 62ms)
23/05 11:49:53,540 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:288) CallbackFinished,Depth,109575,DispatchedAt,1558612193540.008057
23/05 11:49:53,540 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:295) Frame Callback [Depth#109575] overdue. (Duration: 2686.362061ms, FPS: 15, Max Duration: 62ms)
23/05 11:49:53,540 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:288) CallbackFinished,Depth,109575,DispatchedAt,1558612193540.247070
23/05 11:49:53,540 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:295) Frame Callback [Depth#109575] overdue. (Duration: 2618.258057ms, FPS: 15, Max Duration: 62ms)
23/05 11:49:53,540 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:288) CallbackFinished,Depth,109575,DispatchedAt,1558612193540.547119
23/05 11:49:53,540 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:295) Frame Callback [Depth#109575] overdue. (Duration: 2552.906006ms, FPS: 15, Max Duration: 62ms)
23/05 11:49:53,541 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:288) CallbackFinished,Depth,109575,DispatchedAt,1558612193540.950928
23/05 11:49:53,541 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:295) Frame Callback [Depth#109575] overdue. (Duration: 2486.604004ms, FPS: 15, Max Duration: 62ms)
23/05 11:49:53,541 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:288) CallbackFinished,Depth,109575,DispatchedAt,1558612193541.164062
23/05 11:49:53,541 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:295) Frame Callback [Depth#109575] overdue. (Duration: 2420.248047ms, FPS: 15, Max Duration: 62ms)
23/05 11:49:53,541 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:288) CallbackFinished,Depth,109575,DispatchedAt,1558612193541.375000
23/05 11:49:53,541 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:295) Frame Callback [Depth#109575] overdue. (Duration: 2353.334961ms, FPS: 15, Max Duration: 62ms)
23/05 11:49:53,541 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:288) CallbackFinished,Depth,109575,DispatchedAt,1558612193541.733887
23/05 11:49:53,541 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\archive.cpp:295) Frame Callback [Depth#109575] overdue. (Duration: 2286.659912ms, FPS: 15, Max Duration: 62ms)
23/05 11:49:53,542 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\sync.cpp:99) I Depth--> Depth 0, 3021743.526000
23/05 11:49:53,542 DEBUG [516695270640] (F:\Code\third_part\realsense-app\app\src\main\cpp\librealsense\src\sync.cpp:258) SYNC (FN: I Depth I Infrared I Infrared )--> Depth 0 3021743.526000
Please let me know if there's anything I can try to make this work.
Thanks in advance.
The text was updated successfully, but these errors were encountered: