location filter uses lowercase only and ignores locations with dashes about brightway2-data HOT 6 CLOSED

Original comment by Chris Mutel (Bitbucket: cmutel, GitHub: cmutel).

CA-QC is a separate issue, as - is a special character in the search engine. Fixing this will be complicated, and is a bit too much off the path for Brightway2 development, at least for me. You can always do the following:

#!python

[x for x in Database("foo").search("bar", filter={'location': "ca"}) if x['location'] == 'QC-CA']

I will make a post to the Whoosh mailing list about the first case; note that the default analyzer is case-insensitive, but this is maybe applied inconsistently?

from brightway2-data.

Original comment by Chris Mutel (Bitbucket: cmutel, GitHub: cmutel).

Post to Whoosh list

from brightway2-data.

Original comment by Chris Mutel (Bitbucket: cmutel, GitHub: cmutel).

Reply from Matt Chaput (whoosh author):

When you use the query parser, it runs the analyzer on the text and builds the query objects from the output.
If you construct query objects directly, you are giving them the *exact* text to search for.

Our search filter uses a query object:

And([Term(k, v) for k, v in filter.items()])

However, it is not yet clear to me how to work with the Whoosh machinery to make this case-insensitive.

from brightway2-data.

Original comment by Bernhard Steubing (Bitbucket: bsteubing, GitHub: bsteubing).

also the "mask" option does only work with lowercase.
Knowing this limitation, couldn't you simply convert all user input to location, mask, etc. to lowercase? Just an idea.

from brightway2-data.

Original comment by Chris Mutel (Bitbucket: cmutel, GitHub: cmutel).

All search data stored as lowercase. Fixes #35. To get this beahviour in an existing database, use 'db.make_searchable(reset=True'

from brightway2-data.

Original comment by Chris Mutel (Bitbucket: cmutel, GitHub: cmutel).

Note that the fix doesn't help terms that have a dash, these have to be filtered outside the Whoosh search index.

from brightway2-data.