Function calling on stream mode about cleverbird HOT 8 CLOSED

At present, function calling is not supported in streamed mode. (This is mentioned in the README.) I'd like to add support for this ability in the future, though.

from cleverbird.

from cleverbird.

Hey there. I have now had a chance to properly investigate this, and it appears to me from my API tests that there is no support on OpenAI's side for function calling in streaming mode. It simply ignores the defined functions as if they didn't exist, and reverts to "I'm just an AI and can't do that" messages.

So what this means, unfortunately, is that there's just no way to do it at the moment with the current API.

I'm going to close this out, but if this capability is introduced in the future by OpenAI, I'd be very happy to add support.

from cleverbird.

@btfranklin , I almost got it working using this package. I can stream the chat and print the function arguments, but still struggling to get the function arguments passed to the view... Your package is much cleaner, so I am trying to get this working on CleverBird : )
MacPaw/OpenAI#96 (comment)

from cleverbird.

@alelordelo That sounds really cool. If you would like open a PR against CleverBird with your implementation once you get it working, I would be happy to consider it for integration into the package. I'll go ahead and re-open this ticket since you're actively looking into this. Please do follow up with how it goes!

from cleverbird.

looks like openAI is also struggling to get function calling streamed:

Limitations
Support for streaming output (including Messages and Run Steps).

from cleverbird.

from the latest GPT4 Turbo

from cleverbird.

I'm going to go ahead and close this, since a long time has passed and I haven't heard more.

from cleverbird.