Enhancement to the weaviate datatypes support (text[], object, object[]) with WeaviateDocumentIndex about docarray HOT 6 OPEN

Can u give an example of the Doc structure u plan to use and how u would interact with the Index?

from docarray.

Sure:

class SampleDoc(BaseDoc):
    allergies: Optional[List[str]] = []

This object should result into a text[] data type in the WeaviateDocumentIndex.

let's assume a value of ['glutenfree','peanutfree'] in the array.

Then I would be able to do a filter with ContainsAny or ContainsAll on that Field within my search or filter request to find all objects which contain all of the allergenfree terms:

            filter = {
                "path":["allergies"],
                "operator": "ContainsAll",
                "valueText": ['glutenfree','peanutfree']
            }

from docarray.

The point is right now that this type is cureently only handled as blob and cannot be filtered upon?

from docarray.

FWIW, after the initial release of the docarray-weaviate integration, weaviate has added support for nested objects, so they don't have to be stored as blobs anymore. However, they can't be filtered upon yet.

However, in @vincetrep example, the thing he wants to filter on is a list of texts, and this is already supported in weaviate's python client.

from docarray.

Hey @hsm207,

Is this change something easy to achieve?

from docarray.

hey @JoanFM

I don't think I'm in a position to give good estimates anymore. It's almost a year since I last worked on this and I'm not sure how the abstractions work anymore 🤣

maybe @JohannesMessner knows better?

from docarray.