jinmin527 Goto Github PK

flash_attention_inference

Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.

gemm_conv2d_cuda

CUDA Gemm Convolution implementation

gemm_mma

Optimize GEMM with tensorcore step by step

ggml

Tensor library for machine learning

hands-on-rl

https://hrl.boyuai.com/

infllm

The code of our paper "InfLLM: Unveiling the Intrinsic Capacity of LLMs for Understanding Extremely Long Sequences with Training-Free Memory"

learn-cuda-programming

Learn CUDA Programming, published by Packt

learning-cuda-trt

A large number of cuda/tensorrt cases . 大量案例来学习cuda/tensorrt

lectures

Material for cuda-mode lectures

libflash_attn

Standalone Flash Attention v2 kernel without libtorch dependency

llmsninestorydemontower

【LLMs九层妖塔】分享 LLMs在自然语言处理（ChatGLM、Chinese-LLaMA-Alpaca、小羊驼 Vicuna、LLaMA、GPT4ALL等）、信息检索（langchain）、语言合成、语言识别、多模态等领域（Stable Diffusion、MiniGPT-4、VisualGLM-6B、Ziya-Visual等）等 实战与经验。

mathexperiment

数学实验 2023 春

matmultutorial

A Easy-to-understand TensorOp Matmul Tutorial

my_trt_pro

跟着Tensorrt_pro学习各种知识

nvidia_sgemm_practice

Step-by-step optimization of CUDA SGEMM

parallel-computing-cuda

Course that teaches introductory Parallel Computing using CUDA.

pycuda_learn

python3 code for Hands-On GPU Programming with Python and CUDA

python_cpp_extension

C++ and CUDA extensions for Python/Pytorch and GPU Accelerated Augmentation.

pytorch-cppcuda-tutorial

tutorial for writing custom pytorch cpp+cuda kernel, applied on volume rendering (NeRF)

pytorch-linear-operator-cuda

A simple demo in writing pytorch linear operator by CUDA extension

query_doc_topk

simple_reinforcement_learning

swifttransformer

High performance Transformer implementation in C++.

tensorrt-developer_guide_in_chinese

tensorrtx

Implementation of popular deep learning networks with TensorRT network definition API

tensorrt_cpp

C++ library based on tensorrt integration

thread-block-scheduling

trt-samples-for-hackathon-cn

Simple samples for TensorRT programming

trt_learn

TensorRT encapsulation, learn, rewrite, practice.

trt_pro_learn

对 tensorRT_Pro 开源项目理解 :tm: :cyclone: