MikuGG is a generative visual novel platform. This is the open source interactor code for the website miku.gg. You can set up miku locally or develop features using this respository instructions.
- Node.js: Download and install from https://nodejs.org/en/download/
- An Aphrodite engine running instance.
- A GPU for running a large language model.
Note On windows, Make sure to add Node.js to your system's PATH.
We only support the OpenAI-like APIs
- Aphrodite with an OpenAI API endpoint.
- text-generation-webui with exposed api.
Recommended models We recommend using GPTQ quants to get the best possible model with the less GPU power. The more parameters (7B, 13B, etc..), the better the model will be (in this examples). But it will require more GPU power. It only supports NVIDIA cards.
This are recommendations based on December 2023. Also, You can use oobabooga to run llama.cpp models without GPU.
- RTX 1660, 2060, RTX 3050, 3060
- RTX 2060 12GB, 3060 12GB, 3080, A2000
- RTX 3080 20GB, A4500, A5000, 3090, 4090, 6000, Tesla V100
- 20B models
- 30B models (old llama v1, not recommended)
- A100 40GB, 2x3090, 2x4090, A40, RTX A6000, 8000, Titan Ada
# Example with Aphrodite
python -m aphrodite.endpoints.openai.api_server --model TheBloke/MythoMax-L2-13B-GPTQ -q gptq --api-keys sk-EMPTY
# Endpoint will be http://localhost:2242/v1
# Example with text-generation-webui
./start_linux.sh --api
# Then, load the model
# Endpoint will be http://localhost:5000/v1-
Double-click
install.bator run it in the command prompt. This will install the necessary dependencies for Node.js. -
The script will prompt you for optional API keys. Enter the keys when prompted or leave them blank if you don't have them.
-
Open a terminal and navigate to the project root directory.
-
Run
make install. This will install the necessary dependencies. -
The script will prompt you for optional API keys. Enter the keys when prompted or leave them blank if you don't have them.
- Double-click
run.bator run it in the command prompt.
-
Open a terminal and navigate to the project root directory.
-
Run
make run
The UIs that are up an running are
# Bot directory UI
http://localhost:8585/
# Chat interactor UI
http://localhost:5173/
# Bot Builder UI
http://localhost:8586/
For more information on how to use the Mikugg project, please refer to the official documentation at https://docs.miku.gg.
pnpm install
pnpm build
pnpm run
# hotfix for vite not refreshing deps
# need to restart the app with this command if you edit the deps under package/
rm -rf apps/interactor/node_modules/.vite && pnpm startTo sync with the lastest version from git, just run
pnpm pull# publish public packages to npm
npx lerna publish --no-private
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent