Request: suppress warning `Treating it as a text prompt.` from each `eval` about promptfoo HOT 3 OPEN

There isn't a way to suppress the warning, but I noticed something strange about your prompt. Are you intentionally including the literal string "\n"? If not you probably should use literal newlines (this stackoverflow post is useful). Incidentally that will prevent the "maybe filepath" trigger that is causing the output you want to hide.

from promptfoo.

Yeah actually I did also observe that the \n was involved with the warning showing up or not showing up. Though I chose to ignore this seeming edge case in the warning not appearing because I liked when the warning didn't occur 😆.

Also in #729 we observed \n doesn't really play nice with JSON conversions, so actually I removed the \n from my prompt in favor of actual whitespace lines.

Feel free to use this issue as an opportunity to:

• Resolve the edge case where the warning doesn't occur, when perhaps it should
• Create a way to suppress this warning

Or just close this one out, as you stated there's not a way to suppress the warning 👍

from promptfoo.

This warning is indeed a bit troublesome.

My situation is that I need to load the contents of a JSON file myself as prompt input (ref: issue #680), and this warning will occur as long as there is any '\n' character in a string.

Illustration:
Could not find prompt file: "[{"role":"user","content":"Line 1\nLine 2\n..."}]". Treating it as a text prompt.

But I'm not sure if adding a rule !str.includes('\\n') is appropriate. After all, a file path can also match this pattern... 😭

Workaround:

Appending the '\n' character to the end of the stringified JSON content can bypass this warning.

from promptfoo.