Allow for support for Azure OpenAI Services about k8sgpt HOT 9 CLOSED

This is a solution：https://github.com/stulzq/azure-openai-proxy

from k8sgpt.

We have the ability to switch the --backend and an IAI interface which should make implementing it pretty easily.
Do you know if there is a golang based SDK? The current SDK we use is tightly coupled to OpenAI public endpoints though I could look at whether we can modify that.

from k8sgpt.

Are you using this? https://github.com/sashabaranov/go-openai (Do not believe there is
Perhaps it would be better if I get support for the Azure OpenAI endpoint there first make it easier to add the new backend here?

from k8sgpt.

I'm looking into this going forward. The SDK we are using has an open issue on support for Azure OpenAI, but I will look into several solutions for this.

from k8sgpt.

I feel we might want to build our own SDK to control our destiny a bit more.

from k8sgpt.

I was thinking of that as well. Let's have a discussion about it tomorrow, when I got more time :)

from k8sgpt.

Are you using this? https://github.com/sashabaranov/go-openai (Do not believe there is Perhaps it would be better if I get support for the Azure OpenAI endpoint there first make it easier to add the new backend here?

Hi!
It seems that sashabaranov/go-openai already supports Azure OpenAI.
https://github.com/sashabaranov/go-openai/releases/tag/v1.6.0

from k8sgpt.

I have created a draft PR to introduce azure open ai provider, bear with us a little longer as it also includes other changes that need to test first before merging it

from k8sgpt.

@msandbu , would you be able to beta-test the feature since I don't have an azure openai deployment up and running?

from k8sgpt.