Code Monkey home page Code Monkey logo

sl-1-4-object-based-camera-object-model's Introduction

SL 1-4 Object Based Camera Object Model

Credibility Assessment

This model is a parameterizable object based video perception sensor and tracking model using the interface OSI. The model was developed in the project SetLevel by Bosch. The model should simulate some basic video typical effects in a phenomenological way. The "object based camera object model" is based on object lists and all modeling is performed on object level. The model output are object lists for OSI SenorData moving and stationary objects. The outer layer of the model is the OSI Sensor Model Packaging (OSMP). It specifies ways in which models using the Open Simulation Interface (OSI) are to be packaged for their use in simulation environments using FMI 2.0. For more detailed information see the official documentation.

Camera Sensor Demo

Modeling Approach

Modeling of Specific Effects

It includes typical sensor artifacts like

  • soft FoV transitions
  • different detection ranges for different targets
  • occlusion effects depending on the sensor technology
  • existence probability
  • tracker simulation

The detection of moving objects, stationary objects, traffic signs and traffic lights is implemented.

Parameterization

  • FOV: describes the horizontal Field of View of the Camera System
  • Range: deschribes the view distance of the sensor

Interface

Input: Required Fields in OSI3::SensorView

  • sensor_view.mounting_position
  • sensor_view.global_ground_truth.timestamp
  • sensor_view.global_ground_truth.host_vehicle_id
  • sensor_view.global_ground_truth.stationary_object.id
  • sensor_view.global_ground_truth.stationary_object.base.position
  • sensor_view.global_ground_truth.stationary_object.base.orientation
  • sensor_view.global_ground_truth.stationary_object.base.dimension

Output: Fields in OSI3::SensorData Filled by the Sensor Model

  • sensor_data.timestamp
  • sensor_data.moving_object.header.ground_truth_id
  • sensor_data.moving_object.header.tracking_id
  • sensor_data.moving_object.header.existence_probability
  • sensor_data.moving_object.header.measurement_state
  • sensor_data.moving_object.header.sensor_id
  • sensor_data.moving_object.base.position
  • sensor_data.moving_object.base.dimension

Build Instructions

The following is an example for building a model as an FMU in Ubuntu.

Build Model in Ubuntu 18.04 / 20.04

  1. Clone this repository with submodules:

    git clone https://github.com/openMSL/your-model.git --recurse-submodules
  2. Build the model by executing in the extracted project root directory:

    mkdir cmake-build
    cd cmake-build
    # If FMU_INSTALL_DIR is not set, CMAKE_BINARY_DIR is used
    cmake -DCMAKE_BUILD_TYPE=Release -DFMU_INSTALL_DIR:PATH=/tmp ..
    make
  3. Take FMU from FMU_INSTALL_DIR

Configuration for Windows

  • Windows 10
  • Visual Studio 2019
  • CMake 3.10.2 or higher
  • OSI 3.2.0
  • Protobuf 3.11.4 or higher (tested with Protobuf 21.x)
  1. Build protobuf for your special Visual Studio Version
  2. Build sensor model with linker to build protobuf version Settings: OSI, Protobuf and the Modul have to be build with the same configuration: Debug/Release-Build Project-Properties >> C/C++ >> Code-Generation >> Runtime Library Multi-threaded Debug DLL (/MDd) for all solutions under Project-Properties >> VC++ Directories: set the correct include paths in CMake set Protobuf_INCLUDE_DIRS and Protobuf_LIBRARIES

Licensing

The work created by Robert Bosch GmbH is licensed under the terms of the Mozilla Public License, v. 2.0

Disclaimers

This sensor model is very basic and not validated to provide a realistic sensor behaviour. The model shows generic behaviour and is thus not sensor specific. This is a prototype. Use at own risk. Aboslutely not warranty is given for functionality or statements made and we are not liable in case of any damage.

Credits

This work received funding from the research project "SET Level" of the PEGASUS project family, promoted by the German Federal Ministry for Economic Affairs and Energy based on a decision of the German Bundestag.

SET Level PEGASUS Family BMWi
SETLevel Pegasus BMWi

References

sl-1-4-object-based-camera-object-model's People

Contributors

afwalser avatar clemenslinnhoff avatar jubone avatar marzenafranek avatar

Stargazers

 avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

Forkers

junyang0412

sl-1-4-object-based-camera-object-model's Issues

This is a test issue

Describe the bug:
A clear and concise description of what the bug is.

To Reproduce:
Steps to reproduce the behavior:

  1. Go to '...'
  2. Click on '....'
  3. Scroll down to '....'
  4. See error

Expected behavior:
A clear and concise description of what you expected to happen.

Screenshots:
If applicable, add screenshots to help explain your problem.

Describe the setup you are using:

  • Branch, Commit ID in which the bug appears
  • OS: [e.g. Windows 11, Ubuntu 22.04]
  • Hardware: [CPU, Graphics Card, HiL Hardware, ...]
  • Simulation Framework: [e.g. OpenMCx, Model.CONNECT, FMI Bench, ...]
  • Test Setup: [SiL, HiL, ViL, ...]
  • Model Input: [e.g. CarMaker, Carla, dSpace ASM, esmini, ...]

Additional context:
Add any other context about the problem here.

If you know a person, who could answer this issue, feel free to assign them. Otherwise, the maintainer group will assign someone.

Update CI Pipeline

Describe the solution you'd like

  • Update CI pipeline to the current state of the template repository
  • Adjust Readme pipeline badges

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.