apeatling / simple-guide-to-mlx-finetuning Goto Github PK

Contributors

Stargazers

Forkers

arunsathiya tomkallo dominicdatascienctist gurusura namebrandon call518 adeelahmad jiangcongtao tzislam gautamdudeja90

def query_litellm(prompt, context=''):
    messages = [{"content": context+prompt, "role": "user"}]
    response = completion(model="gpt-3.5-turbo", messages=messages)
    answer = response['choices'][0]['message']['content'].strip()

    followup_prompt = "What is a likely follow-up question or request? Return just the text of the question or request."
    followup_messages = [{"content": answer, "role": "assistant"}, {"content": followup_prompt, "role": "user"}]
    followup_response = completion(model="gpt-3.5-turbo", messages=followup_messages)
    followup = followup_response['choices'][0]['message']['content'].strip()

    return answer, followup