cward@cward pql [master] $ python -m unittest find_tests

...........F.F...................

FAIL: test_date (find_tests.PqlSchemaLessTestCase)

Traceback (most recent call last):
File "find_tests.py", line 92, in test_date
self.compare('a == date(10)', {'a': datetime(1969, 12, 31, 19, 0, 10)})
File "find_tests.py", line 10, in compare
self.assertEqual(pql.find(string), expected)
AssertionError: {'a': datetime.datetime(1970, 1, 1, 1, 0, 10)} != {'a': datetime.datetime(1969, 12, 31, 19, 0, 10)}

• {'a': datetime.datetime(1970, 1, 1, 1, 0, 10)}
• {'a': datetime.datetime(1969, 12, 31, 19, 0, 10)}

FAIL: test_epoch (find_tests.PqlSchemaLessTestCase)

Traceback (most recent call last):
File "find_tests.py", line 99, in test_epoch
self.compare('a == epoch("2012")', {'a': 1340164800})
File "find_tests.py", line 10, in compare
self.assertEqual(pql.find(string), expected)
AssertionError: {'a': 1345068000.0} != {'a': 1340164800}

• {'a': 1345068000.0}
  ? - ---
• {'a': 1340164800}
  ? + +

Ran 33 tests in 0.007s

FAILED (failures=2)

Running 0.4.2, I found an interesting unhandled exception triggered by a bad expression syntax. Using the expression:

a == "b" ()

I get an exception 'Str' object has no attribute 'id'

AttributeError: 'Str' object has no attribute 'id'
...
[
    ".../lib/python2.7/site-packages/pql/matching.py", 
    171, 
    "handle", 
    "options=self.get_options())"
]

Input such as pql.find("a < -1") does not work, is there anyway to fix that?

Hello,

I am writing a restful sevice which act a storage layer to mongodb/mysql/... . mongodb query format is quite good for restful , but the problem is how to convert mongodb query to construct plain sql ( I use sqlalchemy ). Then I found pql , but looks like it doesn't support mongo query back to sql ?

Because pql simulate the python language so it may be very helpful if it support the same way with python as below
query = '{var1} and {var2}'.format(var1=var1 or True, var2=var2)
in case var1 = None, True, False
Expect: it is still valid
Actual: throw exception

https://github.com/nicolaiarocci/cerberus

There is an error while creating query for GeoQueries, especially near. Your example location == near([1, 2], 10) generates {'location': SON([('$near', [1, 2]), ('$maxDistance', 10)])}, where SON([( is some random characters (possibly missing { and } ). It is replicated for location == near(Point(1, 2), 10) and location == nearSphere(Point(1, 2)) . Thanks.

so that something like
a > date(1366549200)
would work.

The Python ast module, which this library depends on has been changed in more recent versions of Python. For sure 3.8, and possibly 3.7 or earlier. The ast parser assigns a value of "Constant" to quoted strings and constant numeric values to the right of the comparison expression. When this is handled by the resolve() method, the string "Constant" is appended to "handle_" and then the getattr() method fails because none of the field handler functions have a handle_Constant() function. Hoping that this issue can be fixed.

PQL should have the ability to support queries against attributes that contain a dash in the name.

Current Behavior:

> import pql
> q1 = 'fieldname=="test"'
> pql.find(q1)
>> {'fieldname': 'test'}
> q2 = 'field-name=="test"'
> pql.find(q2)
>> ParseError: Unsupported syntax (BinOp). options: ['Attribute', 'Name']

Expected Behavior:

> import pql
> q1 = 'fieldname=="test"'
> pql.find(q1)
>> {'fieldname': 'test'}
> q2 = 'field-name=="test"'
> pql.find(q2)
>> {'field-name': 'test'}

Parsing a query using the date() function returns a spec clause which using datetime object. I need to use a timestamp (epoc seconds) in place of a datetime.

IS:
date_field >= date("1998-01-01") == {'date_field': {'$gte': datetime.datetime(1998, 1, 1, 0, 0)}}

WAS:
date_field >= date("1998-01-01") == {'date_field': {'$gte': 883612800}}

eg::
from datetime import datetime
from calendar import timegm
dt = datetime(1998, 1, 1, 0, 0)
ts = timegm(dt.timetuple())

Perhaps an argument could be set when calling parse, where by default the parse would return datetime objects, or epoch timestamp if epoch=True? Or configurable option set somewhere? at parser init?

pql_parser = pql.SchemaFreeParser()
spec = pql_parser.parse(query, epoch=True)

{$and: [{a: {$gt: 1}}, {a: {$lt: 2}}]} -> {a: {$gt: 1, $lt: 2}}

Is it possible to use pql to generate multiple conditions on the same term? For example:

{'$and': [{'a': {'$gt': 1, '$lt': 10}]}

As opposed to a series of separate conditions:

{'$and': [{'a': {'$gt': 1}}, {'a': {'$lt': 10}]}

When I ran your first very simple example I got an error

pql.find("a > 1 and b == 'foo' or not c.d == False")
ParseError: Unsupported syntax (NameConstant). options: ['Call', 'Dict', 'List', 'Name', 'Num', 'Str', 'operator_and_right']

I think you need to replace False with null.

pql.find("a > 1 and b == 'foo' or not c.d == null")
Out[24]: {'$or': [{'a': 1}, {'$and': [{'b': '2'}, {'c.d': None}]}]}

I used Python 3.5.

Cheers

H

Hello,

First off I want to say great stuff! This library has really helped enhance an internal tool here at Jawbone where we used to require mongo query language.

Perhaps I missed something but I couldn't figure out how to add generic functions or types short of using a schema or monkey patching. The find method instantiates either SchemaFreeParser or the SchemaParser so there is no way to extend those (without patching). Perhaps find could take a parser as a parameter instead of instantiating one? Also, the issue I had with using the scheme is I don't have a complete schema so I only wanted to define certain fields with a specific type. Perhaps SchemaParser could fall back to GenericField/Type when not found in the map?

We store our timestamps in unix epoch. So I wanted a function to allow a user to compare a timestamp to a human readable date. Here's how I ended up adding EpochFunc to pql:

class EpochFunc(pql.matching.Func):
    def handle_epoch(self, node):
        return self.parse_arg(node, 0, EpochField())


class EpochField(pql.matching.AlgebricField):
    def handle_Str(self, node):
        dt = dateutil.parser.parse(node.s)
        return float(dt.strftime('%s.%f'))

    def handle_Num(self, node):
        return node.n

    def handle_Call(self, node):
        return EpochFunc().handle(node)


class GenericFunc(pql.matching.StringFunc, pql.matching.IntFunc, pql.matching.ListFunc, pql.matching.DateTimeFunc, pql.matching.IdFunc, EpochFunc):
    pass


# Monkey Patch GenericFunc with our GenericFunc which includes EpochFunc
pql.matching.GenericFunc = GenericFunc

Possible Asks:

1. Allow a parser to be passed to find.
2. Have SchemaParser fall back to Generic when field map misses.
3. Have a way to extend generic functions.

Cheers,
Lew

I want $gte,$lte for same field in PQL, so how can i do this.

mongo query:
{'updated_on': {'$gte': datetime.datetime(2012, 2, 4, 0, 0),'$lte': datetime.datetime(2012, 3, 4, 0, 0)}}

I want PQL string structure for this mongo query.

Thanking you.