SMIRK is an experimental pedestrian emergency breaking ADAS facilitating research on quality assurance of critical components that rely on machine learning.
Suggested new formulation: "SYS-PER-REQ4: In any sequence of 5 consecutive frames from a video feed any pedestrian shall not be missed in more than 20% of the frames."
The manuscript has been accepted for publication in Software Quality Journal. Update citation information accordingly and increment the SMIRK version to v1.0.
Add another negative class [N5] with out-of-distribution (OOD) examples, i.e., the cylinder shape in the ESI Pro-SiVIC object catalog. This class should be added to the development data to make sure we have negative examples for the training of the variational autoencoder used for OOD detection.
It is confusing for the reader that FP means different things for SMIRK on the system level and for the model's bounding boxes on a lower level. We shall rename it on this level to avoid confusion, it has no very limited impact on the rest of the documentation. New proposed names in Section 3.2: FN = Missed pedestrian, FP = Ghost braking
"interpretability refers to a passive characteristic of a model referring to the level at which a given model makes sense for a human observer. /.../ By contrast, explainability can be viewed as an active characteristic of a model, denoting any action or procedure taken by a model with the intent of clarifying or detailing its internal functions"
This would make more sense for SMIRK.
Alejandro Barredo Arrieta, Natalia Díaz-Rodríguez, Javier Del Ser, Adrien Bennetot, Siham Tabik, Alberto Barbado, Salvador Garcia, Sergio Gil-Lopez, Daniel Molina, Richard Benjamins, Raja Chatila, Francisco Herrera, Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI, Information Fusion, Volume 58, 2020, pp. 82-115,
The 50 m threshold for pedestrian detection and recognition in the performance requirements does not match the ODD. If ego car moves at 70 km/h, a TTC of 4 s means that the pedestrian can be almost 80 m away.
"In any sequence of 5 consecutive frames from a 10 FPS video feed, no pedestrian within 80 m shall be missed in more than 20% of the frames" shall be expressed using fractions. "Any sequence" is too strict, as model testing of rolling windows show that occlusion and far away pedestrians lead to misses. The requirement needs to be relaxed.
Evaluation of object detection models is non-trivial and relies on the metric intersection over union. The fact that false positives (FP) appear due to low IoU scores despite parts of a pedestrian indeed is detected is often counter-intuitive, i.e., "how can a detected pedestrian ever be an FP?" An FP means that the intersection over union between a predicted bounding box and a ground truth bounding box is less that 0.5. This does not necessarily mean that the model predicted a non-pedestrian as a reason to break - our model testing shows that this often means that a fraction of a real pedestrian was detected. Commencing emergency braking in such cases would be valid.
The corresponding performance requirement shall be set to 1%. The hazardous non-pedestrian emergency braking will be mitigated by the safety cage architecture.