Intermittent Jason.DecodeError while streaming output about openai.ex HOT 6 OPEN

Same problem here when using streaming with assistent API.
For me it seems to happen when i reach a certain size with the assistent instructions text.
For now i reduced the instruction size and the problem doesn't seem to happen.

from openai.ex.

@thiagomajesk sorry for delay - it seems like that "Unexpected message ... :stream_next" issue you mentioned above is a separate issue. Also, I looked at the openai.ex source and threads_create_and_run/1 uses the same underlying function calls as completion, so PR #61 should cover the threads API as well.

Additionally, the error looks like it might be generated outside of this library. Are you able to locate the code path in your application that is generating that log message?

from openai.ex.

I'm having a similar issue with the latest models (4 and 4o) while using the assistants API, I get the following error if I try to stream the response of the threads_create_and_run function:

[error] Unexpected message: {#Reference<0.3374531620.451411971.196574>, :stream_next}

from openai.ex.

@JoaoSetas , @thiagomajesk - have you tried with PR #61 ? I'm using that patch successfully in production at high volume and the problem no longer occurs.

from openai.ex.

Hi, @bfolkens! I'm not sure if this is yet another issue on top of that one or a separate issue, but the problem persists even with your branch. Check this code out:

OpenAI.threads_create_and_run([
  assistant_id: @id, 
  model: "gpt-4o",  
  stream: true,
  thread: %{messages: [%{role: "user", content: "Hi"}]}
])
 |> Enum.to_list()

The same problem happens using both assistants beta API V1 and V2

from openai.ex.

I am also experiencing this issue intermittently and it's quite frustrating. I'm looking forward to the fix being merged!

from openai.ex.