North Nevada Model 🏜️

[YassineYousfi]

No description provided.

[github-actions]

Model Review

	master	PR branch
driving_vision.onnx	2cc530ac-f4f8-4c47-9bed-a4fe4ffaa2b5	2cc530ac-f4f8-4c47-9bed-a4fe4ffaa2b5
big_driving_vision.onnx	2cc530ac-f4f8-4c47-9bed-a4fe4ffaa2b5	2cc530ac-f4f8-4c47-9bed-a4fe4ffaa2b5
big_driving_policy.onnx	cd29ffcf-01dd-4f1c-8808-dc197c174f1d	0e620593-e85f-40c2-9adf-1e945651ed13
driving_policy.onnx	cd29ffcf-01dd-4f1c-8808-dc197c174f1d	0e620593-e85f-40c2-9adf-1e945651ed13

[commaci-public]

ref for commit 83b81b8: https://raw.githubusercontent.com/commaai/ci-artifacts/refs/heads/model_replay_nnv-driving/8494c69d3c710e81|000001d4--2648a9a404_model_tici_83b81b83cdf76a577946a1567f4644e1a018443c.zst

Model Replay Differences

All Model Replay Plots

[benmarten]

ref for commit 83b81b8: https://raw.githubusercontent.com/commaai/ci-artifacts/refs/heads/model_replay_nnv-driving/8494c69d3c710e81|000001d4--2648a9a404_model_tici_83b81b83cdf76a577946a1567f4644e1a018443c.zst
Model Replay Differences



All Model Replay Plots

Just curious what are the x/y-axis here representative of?

[ChristopherRabotin]

Hi there,

Are these plots for the experimental mode? I just tried out the experimental mode today, and the vehicle no longer accelerates on high ways, regardless of whether there is a vehicle in front of it or not. Setting the max speed to 65 mph when at 65 leads the vehicle to slow down over several minutes. The desired acceleration plot here could explain this new behavior.

I will try the standard mode tomorrow.

Long time user (2020) and engineer.

[YassineYousfi]

Just curious what are the x/y-axis here representative of?

x = frame index
y = dependent on the output we're plotting (everything is in SI units, desire is a probability)

[YassineYousfi]

Hi there,

Are these plots for the experimental mode? I just tried out the experimental mode today, and the vehicle no longer accelerates on high ways, regardless of whether there is a vehicle in front of it or not. Setting the max speed to 65 mph when at 65 leads the vehicle to slow down over several minutes. The desired acceleration plot here could explain this new behavior.

I will try the standard mode tomorrow.

Long time user (2020) and engineer.

These plots are just sanity checks, not tests to verify model performance.
They just replay 60 frames from a test segment and pass them through the model.
Please send us a segment of your issues with experimental mode in the Feedback section of our discord.