Code Monkey home page Code Monkey logo

rewardsignaldesign's Introduction

RewardSignalDesign

This repo contains the code for the paper, "From Navigation to Racing: Reward Signal Design for Autonomous Racing"

Overview

  • We evaluate different reward signals on F1/10th autonomous cars
  • We test the reward signals using a planning, perception and control navigation stack with a minimum curvature global planner and the Reference Modification local planner

Code Overview

  • The repo contains two scripts to generate the results which are located in the TestingScripts folder
  • The TrainVehicles.py Script will train the vehicles with the different reward signals
  • The TestVehilces.py script, evaluated the vehicles.
  • All the training and evaluation is done on the porto F1/10th race track.

Reward signals evaluated

  • No racing reward
  • Centerline progress reward
  • Global plan progress reward
  • Centerline cross-track, heading error reward
  • Global plan cross-track, heading error reward
  • Steering punishment reward

Installation

  • Requirements:
    • PyTorch
    • Numpy
    • Matplotlib
    • casadi
    • numba
    • scipy
  • Installation
    • clone the repo onto your computer
    • navigate into the folder, cd RewardSignalDesign
    • install it using pip python3 -m pip install -e .
  • Built on Linux Ubuntu system (20.04.2 LTS) using Python v3.8.5

Citing

If you have found our work helpful, please cite as:

@inproceedings{evans2021reward,
  title={Reward signal design for autonomous racing},
  author={Evans, Benjamin and Engelbrecht, Herman A and Jordaan, Hendrik W},
  booktitle={2021 20th International Conference on Advanced Robotics (ICAR)},
  pages={455--460},
  year={2021},
  organization={IEEE}
}

rewardsignaldesign's People

Contributors

bdevan5 avatar

Stargazers

ChengYang Li avatar

Watchers

James Cloos avatar  avatar

Forkers

icar-2021

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.