Code Monkey home page Code Monkey logo

retina's Introduction

πŸ‘€ Retina : Low-Power Eye Tracking with Event Camera and Spiking Hardware πŸ‘€

PWC PWC

πŸ’» Blog |πŸ“œ Paper | πŸ—‚οΈ Data

Retina : Low-Power Eye Tracking with Event Camera and Spiking Hardware
πŸ§‘πŸ»β€πŸš€ Pietro Bonazzi 1, Sizhen Bian 1, Giovanni Lippolis 2, Yawei Li1, Sadique Sheik 2, Michele Magno1

1 ETH Zurich, Switzerland
2 SynSense AG, Switzerland

βœ‰οΈ Citation ❀️

Leave a star to support our open source initiative!⭐️

@InProceedings{Bonazzi_2024_CVPR,
    author    = {Bonazzi, Pietro and Bian, Sizhen and Lippolis, Giovanni and Li, Yawei and Sheik, Sadique and Magno, Michele},
    title     = {Retina : Low-Power Eye Tracking with Event Camera and Spiking Hardware},
    booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},
    month     = {June},
    year      = {2024},
    pages     = {5684-5692}
}

πŸš€ TL;DR quickstart πŸš€

Clone the repo

git clone https://gitlab.ethz.ch/pbonazzi/retina.git
cd retina

Create the environment

First, make sure your cmake is up to date and install dv_processing dependencies https://gitlab.com/inivation/dv/dv-processing

Then, create the environment:

conda create -n retina python=3.10
conda activate retina
pip install -r requirements.txt

Get the dataset

Please fill up this form to download the dataset https://pietrobonazzi.com/projects/retina

Verify the structure:

.
β”œβ”€β”€ name
β”‚   β”œβ”€β”€ annotations.csv
β”‚   └── events.aedat4
β”œβ”€β”€ ...
β”œβ”€β”€ silver.csv

Training

--args : See the list of arguments in the launch_fire function

python train.py --args

retina's People

Contributors

pbonazzi avatar

Stargazers

Qianpeng Li avatar Khadija Iddrisu avatar Thomson avatar avatar avatar ys830 avatar avatar Henrique avatar Yifan Yu avatar θ‚–δΊ‘δΈ° avatar Tom Stein avatar DaeHyun Kang avatar Yawei Li avatar SeChan Park avatar avatar space-shell avatar Chen Ning avatar Yuhan Wang avatar Ale Luz avatar Chuqiao Yan avatar

Watchers

avatar

Forkers

arghasen10

retina's Issues

Model weights

Hello! How can I obtain the weights for trained model? I wanted to try this model out for my gaze estimation case :)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    πŸ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. πŸ“ŠπŸ“ˆπŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❀️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.