xumicoder Goto Github PK

aitemplate

AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.

cuassembler

An unofficial cuda assembler, for all generations of SASS, hopefully ：）

cuda-tensorcore-hgemm

dis

This is the repo for our new project Highly Accurate Dichotomous Image Segmentation

eureka

Official Repository for "Eureka: Human-Level Reward Design via Coding Large Language Models"

fastertransformer

Transformer related optimization, including BERT, GPT

fgvc-pim

Pytorch implementation for "A Novel Plug-in Module for Fine-Grained Visual Classification". fine-grained visual classification task.

gpt4all

gpt4all: an ecosystem of open-source chatbots trained on a massive collections of clean assistant data including code, stories and dialogue

how-to-optimize-gemm

RowMajor sgemm optimization

mnn

MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba

ncnn

ncnn is a high-performance neural network inference framework optimized for the mobile platform

opencuda

stanford_alpaca

Code and documentation to train Stanford's Alpaca models, and generate the data.

tensorrt-llm

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

tensorrtx

Implementation of popular deep learning networks with TensorRT network definition API

yolov7

Implementation of paper - YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors