feat: Enabling LLM fine tuning in the WASI-NN ggml plugin about wasmedge HOT 3 OPEN

Hi @hydai,

I'm Ankit, and I'm thrilled about the opportunity to contribute to the WasmEdge organization, especially through this project. I believe it aligns well with my skills and interests.

To better prepare myself to become a potential contributor, could you suggest any prerequisite tasks or specific issues that would be beneficial to work on? I'm enthusiastic about collaborating with the team to make meaningful contributions to WasmEdge.

Looking forward to your guidance.

Best regards,
Ankit

from wasmedge.

Hi @Aankirz
This project is relying on the llama.cpp. We would like to enable the fine-tuning feature in the WASI-NN ggml plugin. So there is something you should pay attention to: WASI-NN spec, fine-tuning in llama.cpp, and how to integrate them into our current plugin.

from wasmedge.

Hi @hydai sir, I have gone through this project and got to know that need to define new APIs for fine-tuning operations within WASI-NN and Understand llama.cpp's fine-tuning and create bindings in the plugin to call its functions. If applicable then Implement functionalities for LoRA-related tasks like loading pre-trained models. But main focus should on WASI-NN Spec Extensions, understanding llama.cpp Fine-Tuning and creating WASI-NN ggml Plugin Bindings.

from wasmedge.