Function calling (using food-search.ts) about ax HOT 8 CLOSED

will take a look

from ax.

can you confirm you're testing with the latest version we fixed a bunch of stuff today and also added the new 3.5 sonnet model.

from ax.

@dosco Anthropic and Groq still throwing the same errors. I'm having different issues with Cohere and Google, but I need to double check that I'm not missing something.

I like the new AxAI syntax, easier to follow!

from ax.

great will take a look and fix this today. thanks as the api was growing the proper prefix helps with autocomplete etc

from ax.

latest release https://github.com/ax-llm/ax/releases/tag/9.0.9 has fixes for anthropic, cohere, gemini, i'm looking into groq but i suspect its more a model issue there i might bump up the default model choice to a bigger model

from ax.

@dosco Cool, I'll check it out! Regarding Groq, one thing to keep in mind - they limit llama3-70b to 6k tokens/min and llama3-8b to 30k t/m. I found myself hitting the limit with the larger model quite often, within one run.

from ax.

probably need to add a rate limiter we support those in the library maybe groq needs one by default

from ax.

in the latest release i added a default token bucket bases rate limiter to groq by default to slow it down when needed.

from ax.