Quotes aren't always parsed properly about lmql HOT 3 OPEN

Thanks for reporting. Marking this as a good first issue.

The fix is likely somewhere close to https://github.com/eth-sri/lmql/blob/main/src/lmql/language/compiler.py#L428, where we compile LLM query strings into multi-line strings in the compiled representation of the program.

from lmql.

I did some investigation and here are my findings:

import lmql

@lmql.query()
def quote_at_begin():
    '''lmql
    "\"x\"=123"
    '''
# This case passes without any errors.

@lmql.query()
def quote_at_end():
    '''lmql
    "123=\"x\""
    '''
# This triggers a SyntaxError:
# SyntaxError: unterminated string literal (detected at line 1)

So only the quote_at_end causes error.
I feel this may be a bug of python ast parser ?
because it can parse ast.parse(f""""x"==123""") works but not ast.parse(f"""123=="x"""") ?

A temporary workaround is to check if we ends with quote and add a space after it to make the parser working and then remove the space immediately after parsing.

from lmql.