OrbitVision is an Object Detection project developed by FRC Team 1360. Training is done using a CUDA compatible GPU (development was done using an RTX 3070 Ti), and execution is run on a Raspberry Pi with a Coral Edge TPU.
TODO
License: Other
TFLite model validate currently requires changing the script and running in debugger mode to obtain the output equation. Change the program so that it runs as the following when running like ../../scripts/tflite_model_validate --image=<path_to_image> --ptiq_path=<path to tflite w/ PTIQ> --no_ptiq_path=<path to tflite w/o PTIQ>
Currently we are using OpenCV from apt repo. Ideally, we should be building OpenCV from source so that we can build with -O3 optimizations and control which version we use.
Create documentation for a non-developer to be able to use OrbitVision inference
Create README describing model use cases
Currently we are using libedgetpu from apt repo. Ideally, we should be building OpenCV from source so that we can build with -O3 optimizations and control which version we use.
Model Name: FRC_2022
Number of Labels: 2
Label Names: red_ball, blue_ball
Base Model: ssd_mobilenet_v2_320x320_coco17_tpu-8
Improve the documentation for exporting to TFLite by including specific commands for how to export
Flash limelight with, and test OrbitVision disk image. The LL is a Pi Compute and should work with our code
convert_to_tflite should accept the exported model path and model name, and create both a PTIQ and non_PTIQ model in exported_models/. Script should be run by doing something along the lines of:
../../scripts/convert_to_tflite.py --export_model_path=<path to exported model> --model_name=<model name>
Currently an RPi is needed in order to build and develop the inferencing application. This is not ideal, as it is slow to build and develop. Ideally, we can have a VM running Raspberry Pi OS, and use that to build and develop. Research a way to do this.
Write values (bounding box coordinates, label, angle to target, etc) to NetworkTables so RoboRIO can access inference results.
Create a webserver so a computer connected to the robot's network can view the camera feed, both with and without bounding boxes
Add more information on the initial README file
Script should
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.