jiangshancode Goto Github PK

augmented-traffic-control

Augmented Traffic Control: A tool to simulate network conditions

awesome-mixture-of-experts-papers

A curated reading list of research in Mixture-of-Experts(MoE).

awre

aws-cv-task2vec

Official code for the paper "Task2Vec: Task Embedding for Meta-Learning" (https://arxiv.org/abs/1902.03545, ICCV 2019)

bone-point

cloud-gaming-video-dataset

cudatutorial

A CUDA tutorial to make people learn CUDA program from 0

distributed-llama

Run LLMs on weak devices or make powerful devices even more powerful by distributing the workload and dividing the RAM usage.

how_to_optimize_in_gpu

This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several basic kernel optimizations, including: elementwise, reduce, sgemv, sgemm, etc. The performance of these kernels is basically at or near the theoretical limit.

jiangshancode

MyBlog

llama.cpp

LLM inference in C/C++

llm.c

LLM training in simple, raw C/CUDA

myblogimages

MyBlogImages

nanopyc

ncnn-examples

C program of NCNN

nn-cuda-example

Several simple examples for popular neural network toolkits calling custom CUDA operators.

nnfusion

A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.

simsiam

Pytorch implementation of the paper Exploring Simple Siamese Representation Learning.

triton

Development repository for the Triton language and compiler

vehicle-recognition

Vehicle recognition

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

xgboost

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow