wxpjimmy / awesome-llm-inference Goto Github PK
View Code? Open in Web Editor NEWThis project forked from deftruth/awesome-llm-inference
๐ปA small Collection for Awesome LLM Inference [Papers|Blogs|Docs] with codes, contains TensorRT-LLM, streaming-llm, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
Home Page: https://github.com/DefTruth/Awesome-LLM-Inference
License: GNU General Public License v3.0