Code Monkey home page Code Monkey logo

test-depthai_dual_cam_ros_detector's Introduction

depthai_dual_cam_ros_detector

This repo provides the code and instructions to reproduce an issue I encounter while running a depthai pipeline of two color cameras and detection networks with OAK-FFC-3P. The issue happens specifically when connecting with two IMX577 modules from Arducam.

Hardware

OAK-FFC-3P configuration

As comparison, we also ran the same pipeline with IMX214 from Luxonis. Here are the two configuration.

  • 2-IMX577: OAK-FFC-3P with two IMX577 modules on CAM_B and CAM_C

2 IMX577

  • 2-IMX214: OAK-FFC-3P with two IMX214 modules on CAM_B and CAM_C

2 IMX214

The hosts

All the tests have been run with two different hosts seperately for comparison.

  • workstation host: a laptop running Ubuntu 22.04.3
  • pi host: a Raspberry Pi 4 Model B with precompiled Depthai OS (OAK_CM4_POE_V10_64bit, Debian GNU/Linux 12 bookworm).

Reproduce the issue

I built a docker image with depthai-ros noetic and our minimum reproducible application. A run script run.sh will launch the pipeline and use pipeline_graph to show the pipeline details.

Steps

  • Clone this repo by git clone https://github.com/lincolnxlw/depthai_dual_cam_ros_detector.git.
  • Download my prebuilt docker image by docker pull lincolnxlw/my-depthai-ros.
  • Run the main script in the repo's root folder ./run.sh.

Expected behavior

Both camera nodes should return expected 15 FPS.

Expected FPS

Observed behavior

With configuration 2-IMX577, one camera will return 0 FPS and never recover during run.

Failure FPS

Detailed test results

workstation host

  • 2-IMX577: failed 9 times out of 30 times
  • 2-IMX214: failed 0 times out of 30 times

pi host

  • 2-IMX577: failed 11 times out of 30 times
  • 2-IMX214: failed 0 times out of 30 times

Other details

All connections during the testing are tripple checked. I also randomly paired up IMX577 modules and the result persist.

Detail 1 Detail 2 Detail 3 All Tested Modules

test-depthai_dual_cam_ros_detector's People

Contributors

alex-luxonis avatar lincolnxlw avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.