Code Monkey home page Code Monkey logo

shadowkun / vitis-ai Goto Github PK

View Code? Open in Web Editor NEW

This project forked from xilinx/vitis-ai

0.0 1.0 0.0 643.18 MB

Vitis AI is Xilinx’s development stack for AI inference on Xilinx hardware platforms, including both edge devices and Alveo cards.

Home Page: https://www.xilinx.com/ai

License: Apache License 2.0

Shell 3.37% Makefile 0.72% C++ 31.88% Tcl 4.37% V 2.83% SystemVerilog 33.93% CMake 1.63% Python 8.36% C 0.22% CSS 0.01% HTML 0.21% JavaScript 0.36% Jupyter Notebook 12.06% Perl 0.05%

vitis-ai's Introduction


Vitis AI is Xilinx’s development stack for AI inference on Xilinx hardware platforms, including both edge devices and Alveo cards. It consists of optimized IP, tools, libraries, models, and example designs. It is designed with high efficiency and ease of use in mind, unleashing the full potential of AI acceleration on Xilinx FPGA and ACAP.


Vitis AI is composed of the following key components:
  • AI Model Zoo - A comprehensive set of pre-optimized models that are ready to deploy on Xilinx devices.
  • AI Optimizer - An optional model optimizer that can prune a model by up to 90%. It is separately available with commercial licenses.
  • AI Quantizer - A powerful quantizer that supports model quantization, calibration, and fine tuning.
  • AI Compiler - Compiles the quantized model to a high-efficient instruction set and data flow.
  • AI Profiler - Perform an in-depth analysis of the efficiency and utilization of AI inference implementation.
  • AI Library - Offers high-level yet optimized C++ APIs for AI applications from edge to cloud.
  • DPU - Efficient and scalable IP cores can be customized to meet the needs for many different applications

Learn More: Vitis AI Overview

  • Release Notes
  • Alveo U50 support with DPUv3E, a throughput optimized CNN overlay
  • Tensorflow 1.15 support
  • VART (Vitis AI Runtime) with unified API and samples for Zynq, ZU+ and Alveo
  • Vitis AI library fully open source
  • Whole Application Acceleration example on Alveo

Getting Started

Two options are available for installing the containers with the Vitis AI tools and resources.

Installation

  • Install Docker - if Docker not installed on your machine yet

  • Ensure your linux user is in the group docker

  • Clone the Vitis-AI repository to obtain the examples, reference code, and scripts.

    git clone https://github.com/Xilinx/Vitis-AI  
    
    cd Vitis-AI
    
  • Run Docker Container

    1. Run the CPU image from docker hub
    ./docker_run.sh xilinx/vitis-ai
    

    or

    1. build the CPU image locally and run it
    cd docker
    ./docker_build_cpu.sh
    
    # After build finished
    cd ..
    ./docker_run.sh xilinx/vitis-ai-cpu:latest
    

    or

    1. build the GPU image locally and run it
    cd docker
    ./docker_build_gpu.sh
    
    # After build finished
    cd ..
    ./docker_run.sh xilinx/vitis-ai-gpu:latest
    
  • Get started with examples

Programming with Vitis AI

Vitis AI offers a unified set of high-level C++/Python programming APIs to run AI applications across edge-to-cloud platforms, including DPUv1 and DPUv3 for Alveo,
and DPUv2 for Zynq Ultrascale+ MPSoC and Zynq-7000. It brings the benefits to easily port AI applications from cloud to edge and vice versa. 7 samples in VART Samples are available to help you get familiar with the unfied programming APIs.

ID Example Name Models Framework Notes
1 resnet50 ResNet50 Caffe Image classification with VART C++ APIs.
2 resnet50_mt_py ResNet50 TensorFlow Multi-threading image classification with VART Python APIs.
3 inception_v1_mt_py Inception-v1 TensorFlow Multi-threading image classification with VART Python APIs.
4 pose_detection SSD, Pose detection Caffe Pose detection with VART C++ APIs.
5 video_analysis SSD Caffe Traffic detection with VART C++ APIs.
6 adas_detection YOLO-v3 Caffe ADAS detection with VART C++ APIs.
7 segmentation FPN Caffe Semantic segmentation with VART C++ APIs.

For more information, please refer to Vitis AI User Guide

References

Questions and Support

vitis-ai's People

Contributors

andyluo7 avatar wilderfield avatar kamranjk avatar bryanloz-xilinx avatar shua1zhang avatar durgabhavaniv avatar sumitn-xilinx avatar mahinlma avatar nkpavan avatar qianglin-xlnx avatar naal-xlnx avatar anushaperla avatar erihsu avatar rampagee avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.