Code Monkey home page Code Monkey logo

dji-mobilesdk-vision's Introduction

dji-mobilesdk-vision

Do computer vision with a DJI drone and a mobile device.

This project opens the door of using DJI's consumer drones, to do near-real-time computer vision. It takes advantage of DJI's advanced long distance video transmission link and the Mobile SDK, and demonstrates how to access the frames of the live video feed, do any computer vision and machine learning tricks you like on the mobile device, and take actions based on your needs.

What you need

  1. A DJI drone that supports Mobile SDK: Phantom, Inspire, Mavic, and even the tiny Spark. (I tested it on Mavic and Spark).

  2. At this moment, only iOS demo is provided. So you'll need a Mac to build the code, and an iPhone or iPad to run the App.

How to build

  1. Follow the DJI Mobile SDK's documentation to do necessary setup. Basically, you will need to install xcode, cocoapods, and register an App key from DJI developer website. When registering the App key, you need to have a unique bundle identifier like com.yourorganization.yourappname.

  2. Clone this repo to /Users/username/dji-mobilesdk-vision

  3. Download opencv2.framework. I compiled opencv 3.2.0 with aruco tag support (not included in official build) and put it here. Unzip and put the opencv2.framework to path dji-mobilesdk-vision/drone-cv.

  4. Open a terminal, cd into /Users/username/dji-mobilesdk-vision/drone-cv, and run pod install. This step may take some time.

  5. Open /Users/username/dji-mobilesdk-vision/drone-cv/drone-cv.xcworkspace.

  6. Put the App key you applied from DJI developer website (in step 1) in the DJISDKAppKey entry in Info.plist file. Put the bundle identifier associated with the App Key the General settings of the drone-cv.

  7. Build the code, side load to your iOS device, connect your Phone to the RC of the drone.

dji-mobilesdk-vision's People

Contributors

tirelesstinkerer avatar arsankalp avatar

Watchers

James Cloos avatar Ray Grauberger avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.