Cheap Rendering vs. Costly Annotation: Rendered Omnidirectional Set of Vehicles [SCCG 2014]

Petr Šlosár, Roman Juránek, Adam Herout
Graph@FIT, Brno University of Technology
Corresponding author: {ispanhel; herout} [at] fit.vutbr.cz

Abstract

Detection of vehicles in traffic surveillance needs good and large training datasets in order to achieve competitive detection rates. We are showing an approach to automatic synthesis of custom datasets, simulating various major influences: viewpoint, camera parameters, sunlight, surrounding environment, etc. Our goal is to create a competitive vehicle detector which “has not seen a real car before.” We are using Blender as the modeling and rendering engine. A suitable scene graph accompanied by a set of scripts was created, that allows simple configuration of the synthesized dataset. The generator is also capable of storing rich set of metadata that are used as annotations of the synthesized images. We synthesized several experimental datasets, evaluated their statistical properties, as compared to real-life datasets. Most importantly, we trained a detector on the synthetic data. Its detection performance is comparable to a detector trained on state-of-the-art real-life dataset. Synthesis of a dataset of 10,000 images takes only several hours, which is much more efficient, compared to manual annotation, let aside the possibility of human error in annotation.

Downloads

  • Paper
  • Blender with generator script
  • We prepared three datasets with different camera settings – rear, eye-level, and omnidirectional (with unconstrained camera). Each dataset contains 5,000 annotated images. The annotations are in bbGt format suitable for Aggregate Channel Features framework. We also provide depth map for each image.
  • If you use software or data provided here, please cite this paper.
  • For commercial use please contact us to {ispanhel, herout} [at] fit.vutbr.cz

Datasets License


Except where otherwise noted, this work is licensed under
https://creativecommons.org/licenses/by-nc-sa/4.0/legalcode.
© 2015, ŠLOSAR, JURÁNEK, HEROUT. Some Rights Reserved.

Citation

@inproceedings{Slosar2014,
Title = {Cheap Rendering vs. Costly Annotation: Rendered Omnidirectional Set of Vehicles},
Author = {Petr Šlosár and Roman Juránek and Adam Herout},
Booktitle = {SCCG},
Year = {2014}
}

sccg14teaser

Acknowledgements

This work was supported by the project V3C, TE01020415, and by the project IT4I, CZ 1.05/1.1.00/02.0070.