smallccn Goto Github PK

amos

Automatic Mapping Generation, Verification, and Exploration for ISA-based Spatial Accelerators

androidusbcamera

Universal UVCCamera library,supporting recording,pushing,etc. // USB摄像头(UVC)视频录制和图片抓拍，支持边推流边录像

artificial-intelligence-terminology-database

A comprehensive mapping database of English to Chinese technical vocabulary in the artificial intelligence domain

binder_native

android native C++层实现binder通信（全双工）

bisheng

Bisheng is an open LLM devops platform for next generation AI applications.

buddy-mlir

An MLIR-Based Ideas Landing Project

bytetransformer

optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052

clpeak

A tool which profiles OpenCL devices to find their peak capacities

codefuse-chatbot

An intelligent assistant serving the entire software development lifecycle, powered by a Multi-Agent Framework, working with DevOps Toolkits, Code&Doc Repo RAG, etc.

cudnn_samples_v8

cuDNN samples v8.x

d2l-book

Books with Jupyter notebooks

dcgm-exporter

NVIDIA GPU metrics exporter for Prometheus leveraging DCGM

deeplearningsystem

Deep Learning System core principles introduction.

det-model-prune-torch

docker-android

Android in docker solution with noVNC supported and video recording

fastllm

纯c++的全平台llm加速库，支持python调用，chatglm-6B级模型单卡可达10000+token / s，支持glm, llama, moss基座，手机端流畅运行

fisherpruning

Group Fisher Pruning for Practical Network Compression(ICML2021)

fisherpruning-pytorch

An implementation of <Group Fisher Pruning for Practical Network Compression> based on pytorch and mmcv

flexgen

Running large language models like OPT-175B/GPT-3 on a single GPU. Focusing on high-throughput generation.

go

The Go programming language

gopher-lua

GopherLua: VM and compiler for Lua in Go

gpt-sovits

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

gpu_poor

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

httpserver

C++实现基于boost库实现的http服务端

imagebind

ImageBind One Embedding Space to Bind Them All

iree

👻

k8s-device-plugin

NVIDIA device plugin for Kubernetes

knowledge-qa-llm

QA based on local knowledge and LLM.

lit-llama

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

llama

Inference code for LLaMA models