Use test vars in function schema about promptfoo HOT 4 CLOSED

Thanks for the suggestion @tomquist! #792 implements this and will be in the next release.

from promptfoo.

Released in 0.59.0!

from promptfoo.

@typpo Awesome! Thanks for the quick implementation. 🎉

I have one use-case which still wouldn’t be possible with this implementation:

I want to pass in a JSON Array as a var so I can use it in a string schema as the enum property. Would it be possible to support a function at any level of the template object? This waz you could do something like this:

tools: [
  {
    type: …, parameters: (context) => ({ enum: context.vars.options, …})
  }
]

Sorry for the minimalistic example, I’m on mobile right now

I think this could just be handled as another case in renderVarsInObject().

Also I’m happy to open a new issue if you prefer.

from promptfoo.

@typpo I submitted a PR to implement this: #813

from promptfoo.