jamesthez Goto Github PK

awesome-tensor-compilers

A list of awesome compiler projects and papers for tensor computation and deep learning.

bladedisc

BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.

cuda_image_filtering_constant

cuda_image_filtering_shared

cudaprof

A profiler for CUDA programs based on CUPTI. Similar to NVIDIA Profiler, but simpler.

deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

flash-llm

fp6_llm

An efficient GPU support for LLM inference with 6-bit quantization (FP6).

jamesthez.github.io

Website of Zhen Zheng.

peizhishi.github.io

persistvgg

Pure cuda implementation of VGG net

recom

shell_script

一键安装 shadowsocks，支持 chacha20-ietf-poly1305 加密方式

syncmicrobenchmark

This work aims at characterizing the synchronization methods in CUDA.

tensorflow

tensorflow-internals

It is open source ebook about TensorFlow kernel and implementation mechanism.

tensorrt-llm

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

unlock-music

Unlock encrypted music file in browser. 在浏览器中解锁加密的音乐文件。

versapipe

A framework for pipelined computing on GPU

xla_hlo_dump_parse