feat(autoware_launch): add dbt camera cross validation#1757
feat(autoware_launch): add dbt camera cross validation#1757kaancolak wants to merge 3 commits intoautowarefoundation:mainfrom
Conversation
Signed-off-by: Kaan Çolak <kaancolak95@gmail.com>
|
Thank you for contributing to the Autoware project! 🚧 If your pull request is in progress, switch it to draft mode. Please ensure:
|
|
Thank you for your work.
TOPIC share: Removing shape estimation and detection-by-tracker I would like to remove shape estimation (incl. detection by tracker) from the perception pipeline in near future. the multi-object-tracker shall manage to properly utilize cluster objects (typically called 'unknown object'). Recent tracker updates (GIoU association, tracker motion model) leverage to directly use cluster objects. This is for your information. This PR shall be reviewed without this topic. |
Signed-off-by: Kaan Çolak <kaancolak95@gmail.com>
|
@technolojin -san, Thanks for the reply and informations. For point 2, I fixed it over topic manipulation: ROI fusion now has a dual guard (switch/detector/tracker_based AND switch/detector/camera_lidar) and the intermediate topic is only wired in camera modes, so in lidar, lidar_radar, and radar modes DBT outputs directly to detection_by_tracker/objects with no ROI fusion node launched. |
|
Friendly ping @YoshiRi @technolojin @MasatoSaeki @ogrex @yukkysaito I’d appreciate your review on the PR when you’re available. Thank you. |
Description
Add a separate
roi_detected_object_fusionstep fordetection_by_tracker(DBT) objects in the detection pipeline. This filters phantom detections, particularly pedestrians that originate from the tracker feedback loop.Problem
In the existing pipeline, the output of
detection_by_trackerwas fed directly into the merger/tracker without any camera validation.Once a momentary false-positive tracker was created for a static object misclassified as a pedestrian,detection_by_trackerwould continuously find the point cloud cluster at that position and re-publish it as a pedestrian detection. Thendetection_by_trackerwould find the point cloud cluster at that position and re-publish it as a pedestrian detection. Since the DBT channel'scan_spawn_new_tracker(link) isfalsebut it can still update existing trackers with a default existence probability of 0.75, the tracker's total existence probability stays above the expiry threshold indefinitely, effectively living forever through the feedback mechanism.detection_by_tracker_out.mp4
Solution
A
roi_detected_object_fusionnode is inserted in detection.launch.xml between thedetection_by_trackernode output and all downstream consumers (both multi-channel tracker and merged-mode merger). The DBT node now outputs to an intermediate topic (detection_by_tracker/unfiltered/objects), which is validated against camera ROIs before being published to the original topic (detection_by_tracker/objects).A dedicated parameter file (roi_detected_object_fusion_dbt.param.yaml) is used with stricter thresholds for PEDESTRIAN:
comparison_video_scene3.mp4
How was this PR tested?
Notes for reviewers
None.
Effects on system behavior
None.