ksm26 / efficiently-serving-llms Goto Github PK
View Code? Open in Web Editor NEWLearn the ins and outs of efficiently serving Large Language Models (LLMs). Dive into optimization techniques, including KV caching and Low Rank Adapters (LoRA), and gain hands-on experience with Predibase’s LoRAX framework inference server.
Home Page: https://www.deeplearning.ai/short-courses/efficiently-serving-llms/