Simulating Photo-realistic Snow and Fog on Existing Images for Enhanced CNN Training and Evaluation
By Alexander von Bernuth, Georg Volk, Oliver Bringmann. 2019
52 citations recorded by the source corpus.
Verification and robustness testing of machine learning algorithms for autonomous driving is crucial. Due to the increasing complexity and quantity of those systems in a single vehicle, just driving the required distance with a newly developed vehicle is not feasible anymore: billions of hours on the street without failure are necessary to qualify for industry standards like ISO 26262. That is where simulation comes into play: machine learning algorithms are trained and evaluated on well known image data sets like KITTI or Cityscapes. But today’s data sets mostly contain images taken under perfect weather conditions and therefore do not harden optical object detection algorithms against various weather conditions. This paper focuses on reusing these established and labeled data sets by augmenting them with adverse weather effects like snow and fog. Those effects are rendered physically correct and life like while being added to existing real world images. Thanks to easy parametrization the weather influences may be varied as necessary and allow for finely tuned learning and optimization processes. The weather effects are evaluated with regard to realism and impact on an established object detection algorithm. These newly created weather-influenced images may be used to validate or train new object detection algorithms.
Subfields: Automotive Engineering, Computer Vision and Pattern Recognition, Environmental Engineering
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Automotive Engineering
In Computer Vision and Pattern Recognition
- Matthias Bethge
- Wieland Brendel
- Robert Geirhos
- Luc Van Gool
- Trevor Darrell
- Andrea Vedaldi
- Ming-Hsuan Yang
- Claudio Michaelis
In Environmental Engineering
Citations in the corpus
- Benchmarking Robustness in Object Detection: Autonomous Driving when Winter is Coming (2019, background): “von Bernuth et al. [2018] report a drop in the AP of a Recurrent Rolling Convolution network trained on the KITTI dataset when the camera images are modified by simulated rain drops on the windshield. von Bernuth et al. [2019] model photo-realistic snow and fog conditions to augment real and virtual”