hwzhuhao Goto Github PK

api-for-open-llm

Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. 开源大模型的统一后端接口

autogen

A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap

cloud-native-docs

clusternet

Managing your Kubernetes clusters (including public, private, edge, etc) as easily as visiting the Internet

crewai

Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

dify

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

fastchat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

fluent-operator

Operate Fluent Bit and Fluentd in the Kubernetes way - Previously known as FluentBit Operator

golang-doc

golang document

gpt_api_free

Free ChatGPT API Key，免费ChatGPT API，支持GPT4 API（免费），ChatGPT国内可用免费转发API，直连无需代理。可以搭配ChatBox等软件/插件使用，极大降低接口使用成本。国内即可无限制畅快聊天。

gptcache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

helm

The Kubernetes Package Manager

inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

karmada

Open, Multi-Cloud, Multi-Cluster Kubernetes Orchestration

kserve

Standardized Serverless ML Inference Platform on Kubernetes

kube-middleware

kubefed

Kubernetes Cluster Federation

kubeflow

Machine Learning Toolkit for Kubernetes

kubernetes

Production-Grade Container Scheduling and Management

kubesphere

The container platform tailored for Kubernetes multi-cloud, datacenter, and edge management ⎈ 🖥 ☁️

langchain

🦜🔗 Build context-aware reasoning applications

llama-factory

A WebUI for Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

llmperf

LLMPerf is a library for validating and benchmarking LLMs

lm-evaluation-harness

A framework for few-shot evaluation of language models.

lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

ollama

Get up and running with Llama 3.1, Mistral, Gemma 2, and other large language models.

opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

optimum-benchmark

🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.

ragflow

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

skypilot

SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 12+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.