Code Monkey home page Code Monkey logo

orbitvision's Introduction

OrbitVision

OrbitVision is an Object Detection project developed by FRC Team 1360. Training is done using a CUDA compatible GPU (development was done using an RTX 3070 Ti), and execution is run on a Raspberry Pi with a Coral Edge TPU.

Directory Overview

TODO

orbitvision's People

Contributors

michgedd avatar brightlaw9 avatar

Watchers

 avatar

Forkers

brightlaw9

orbitvision's Issues

Update tflite_model_validate.py for easier use

TFLite model validate currently requires changing the script and running in debugger mode to obtain the output equation. Change the program so that it runs as the following when running like ../../scripts/tflite_model_validate --image=<path_to_image> --ptiq_path=<path to tflite w/ PTIQ> --no_ptiq_path=<path to tflite w/o PTIQ>

  1. Load the image
  2. Load PTIQ and non-PTIQ model
  3. List model outputs. Ask the user which output is the boxes, classes, scores, and num_boxes.
  4. Run inference on the non_PTIQ model. Draw bounding boxes. Show boxes to user and ask if ok. Save bounding box data.
  5. Run inference on the PTIQ. Use linear regression to create the equation. Show bounding boxes to user. Ask if ok.
  6. If user answered "ok", export the equation to the user.

Train FRC 2022 Model

Model Name: FRC_2022

Number of Labels: 2

Label Names: red_ball, blue_ball

Base Model: ssd_mobilenet_v2_320x320_coco17_tpu-8

Update convert_to_tflite.py for easier use

convert_to_tflite should accept the exported model path and model name, and create both a PTIQ and non_PTIQ model in exported_models/. Script should be run by doing something along the lines of:

../../scripts/convert_to_tflite.py --export_model_path=<path to exported model> --model_name=<model name>

Research alternative development methods

Currently an RPi is needed in order to build and develop the inferencing application. This is not ideal, as it is slow to build and develop. Ideally, we can have a VM running Raspberry Pi OS, and use that to build and develop. Research a way to do this.

Create setup script for RPi

Script should

  • Change the CPU governor to "performance"
  • Verify that the TPU is connected
  • Verify that the camera is connected
  • Launch OrbitVision

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.