gzy19990617 Goto Github PK

aitemplate

AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.

awesome-tensor-compilers

A list of awesome compiler projects and papers for tensor computation and deep learning.

community

PaddlePaddle Developer Community

course

高性能并行编程与优化 - 课件

cpp_learn

cuda-i-can

cudatutorial

A CUDA tutorial to make people learn CUDA program from 0

cutlass

CUDA Templates for Linear Algebra Subroutines

deeprec

DeepRec is a high-performance recommendation deep learning framework based on TensorFlow. It is hosted in incubation in LF AI & Data Foundation.

fastdeploy

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.

how-to-optimize-gemm

hpc-lab-sysu

2020秋中山大学高性能计算课程课件与作业

kuiperinfer

带你从零实现一个高性能的深度学习推理库，Implement a high-performance deep learning inference library step by step

learning-cuda-trt

learning-cuda-trt

lightseq

LightSeq: A High Performance Library for Sequence Processing and Generation

lite.ai.toolkit

🛠 A lite C++ toolkit of awesome AI models with ONNXRuntime, NCNN, MNN and TNN. YOLOv5, YOLOX, YOLOP, YOLOv6, YOLOR, MODNet, YOLOX, YOLOv7, YOLOv8. MNN, NCNN, TNN, ONNXRuntime.

llama.cpp

Port of Facebook's LLaMA model in C/C++

mydynamo

onnx

Open standard for machine learning interoperability

onnx-tensorrt

ONNX-TensorRT: TensorRT backend for ONNX

onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

paddle

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

paddle-symbolic-trace

A implementation of symbolic trace based on paddle and bytecode transformer.

paddlefx

an experimental project for paddle python IR.

paddletest

PaddlePaddle TestSuite

ppl.nn

A primitive library for neural network

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

serving

A flexible, high-performance serving system for machine learning models

tensorflow

An Open Source Machine Learning Framework for Everyone

tensorflow-cmake

TensorFlow examples in C, C++, Go and Python without bazel but with cmake and FindTensorFlow.cmake