Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

visiond: replace wiggly model with non wiggly model #377

Merged
merged 1 commit into from
Sep 27, 2018
Merged

Conversation

geohot
Copy link
Contributor

@geohot geohot commented Sep 27, 2018

Retrained the temporal model on the same dataset but added more dropout. This fixes the wiggle issue, potentially at the expense of responsiveness. Comment here on which model you like the best and issues with them:

  1. 0.5.3 model
  2. 0.5.4 model
  3. 0.5.4-nowiggle model

@ch4se
Copy link

ch4se commented Sep 27, 2018

Wiggles are better because you can see that OP is actually working hard at making decisions

@jfrux
Copy link

jfrux commented Sep 27, 2018 via email

@geohot
Copy link
Contributor Author

geohot commented Sep 27, 2018

From a purely visual perspective, I would not say wiggles inspire confidence.

@openmechanics
Copy link

    • 0.5.3 model-Was cool
    • 0.5.4 model-Drives smooth better then previous models however the only down side is it's trying to be a detective lol best way to describe it. It's trying to find missing lanes and once it finds them it's trying to go that way. So on streets when the lane ends it wants to go full left except for straight.
    • 0.5.4-nowiggle moel- Haven't tried yet.

@ch4se
Copy link

ch4se commented Sep 27, 2018

Yeah I wouldn’t say wiggles inspire confidence, but it at least gives you an idea of when the model actually is confident.

Wiggly model probably makes the user pay more attention, people seem to be overly confident in the system.

@jfrux
Copy link

jfrux commented Sep 27, 2018 via email

@openmechanics
Copy link

openmechanics commented Sep 27, 2018

Yeah I wouldn’t say wiggles inspire confidence, but it at least gives you an idea of when the model actually is confident.

Wiggly model probably makes the user pay more attention, people seem to be overly confident in the system.

agree^ requires user to pay more attention:)

@jeankalud
Copy link

Tested both 0.5.4 with and without wiggle. I prefer the no_wiggle version personally.

I liked seeing the wiggle version trying to find the lines but it doesn't inspires confidence. Also, compared to the previous 0.5.3 version I feel it should be given less authority when confidence level is low. Right now it tends to turn right-left back and forth in some no lines conditions. This should be smoothed out imho.

I REALLY appreciate the increased turn angle limit, its amazing, so manu thanks for this.

@zeeexsixare
Copy link

zeeexsixare commented Sep 27, 2018

Both versions of 0.5.4 drive similarly for me. I agree that wiggles don't inspire confidence. However, the white lines , or the green path line could potentially be turned orange or red dynamically if we want to "feel" how confident the model is. This way we can remove the wiggles but retain model confidence.

I also agree with jeankalud that visiond being able to steer to greater extremes is really nice when the model gets it right. It successfully navigated a low-speed curve that I had to manually override before.

@pjlao307
Copy link
Contributor

no-wiggle feels more "natural" to me on surface streets. On highway it seems very similar.

@ewumnrr
Copy link

ewumnrr commented Sep 27, 2018

Works well, lane detection is more stable. All in all an improvement on local roads and gives very solid highway performance.

@geohot geohot merged commit 8291f35 into devel Sep 27, 2018
@geohot geohot deleted the nowiggle branch September 27, 2018 21:25
@jfrux
Copy link

jfrux commented Sep 28, 2018

image
RIP

klaus385 pushed a commit to klaus385/openpilot that referenced this pull request Dec 31, 2018
visiond: replace wiggly model with non wiggly model
icmma pushed a commit to priuscom/openpilot that referenced this pull request Jun 16, 2019
pd0wm pushed a commit that referenced this pull request Dec 14, 2019
a648cca Add os import
042562d Extracted wifi connect from test helpers
ac0fd5d query fw versions example - use extended diagnostic session
4e9d788 Remove not-needed cadillac-init
f0a5d15 typo
c093286 Add bootkick after re-enabling phone power (#401)
eadb0db security upgrades (#397)
7c13bec Command to get signature (#399)
dad439a static assert on size of health packet (#398)
da9da46 Fix VERSION
df4159c Revert "Revert "Register readback on most modules. Still need to convert the other ones (#396)""
56ec215 Revert "Register readback on most modules. Still need to convert the other ones (#396)"
893e486 Register readback on most modules. Still need to convert the other ones (#396)
6bbae7b VW safety: allow cancel spam on both buses to be compatible with camera and gateway integration
d5f7a28 bump panda
1bcc351 ignition_can: set it to False after 2s of not seeing CAN msgs
96137f1 VW can based ignition not needed. it has ignition line at camera as well.
1b004a1 Same flake8 version as the one in openpilot
e82ba5f Same pylint version as the one in openpilot
656f99b Interrupt refactor (NVIC_SM_1: #334) and Fault handling (#377) (PR #373)
000282e Fix can_logger.py to run correctly on python3 (#392)
7f9b4a5 Fix USB device enumeration on Windows 8.1 and Windows 10 (#393)
dec565c Update Misra test coverage, which now includes rule 2.7
fb6bc3b Fix Misra
878dd00 solve race condition is relay_malfunction right after changing the relay status by adding a counter
2d4cb05 add a safety mode counter
a6797a21 Implement USB power mode on uno
670f90c Merge branch 'master' of github.com:commaai/panda
ca39a5d Added faults integer to health packet
e1c34a1 Panda Jungle testing (#394)
2a093a3 Added heartbeat to echo test
2246435 Fixed health struct size. We should really get an automated test for this
f458d67 Add uptime counter to the health packet (#391)
1662481 enable CAN transcievers outside the set_safety_mode function, which is not related
a7c9874 bump panda ver
1192d93 Power saving refactor (#389)
d58d08f Fix Misra 17.8: can't mod function params
bc685ac Minor indent
a54b86c Failure of set_safety_mode falls back to SILENT. Failure to set silent results in hanging
597436d NOOUTPUT safety mode is now SILENT. NOOUTPUT still exists but keeps C… (#388)
d229f8d ESP forced off in EON build. this prevents ESP to be turned on when e… (#387)
8a044b3 forgot Hyundai: now also using make_msg
4f9c879 remove abunch of lines from safety regression tests by using common make_msg function
fb81414 mispelled word
57f5ef8 Fix misra: addr can't be more than 29 bits anyway
68ff501 typo
d5c772b Fixe Toyota message white-list
48197a9 Better masking for ELM mode
b8fe78c VW is also tested for safety replay
212d336 Safety Chrysler: Added cancel spam button check
d44b562 fix print in example
02d579a functional addr handling
6249a18 tx_hook shall have a white-list of messages (#381)
8138fc1 uds: handle function addrs and fw version query example
6626a54 Fixed python health api
b9b79e8 uds zero second timeout
e0de1a4 define ALLOW_DEBUG in safety tests
86dec4b Safety modes that violate ISO26262 requirements are not compiled in RELEASE build
e74ed93 safety tests a bit more simplified
2027765 relay malfunction test centralized
8af1a01 clean up safety tests
e8f7a3b upd panda