Filtering large arrays of objects about arduinojson HOT 4 CLOSED

Hi @T-vK,

As you can confirm with the ArduinoJson Assistant, the filter you need is this:

{
  "meta": {
    "timestamp": true
  },
  "beats": [
    {
      "start": true
    }
  ],
  "bars": [
    {
      "start": true
    }
  ]
}

You can create this filter like so:

JsonDocument filter;
filter["meta"]["timestamp"] = true;
filter["beats"][0]["start"] = true;
filter["bars"][0]["start"] = true;

In the last part of your message, you say you want to apply logic operators to filters.
Unfortunately, it is not possible at the moment, and I don't see it implemented in the foreseeable future.
This request has been made multiple times (#1721, #1486, #1316, #1708), but we have yet to find a suitable solution.

As a workaround, I suggest you try the deserialization in chunks technique.

Best regards,
Benoit

from arduinojson.

Indeed, deserialization in chunks requires significant modifications in your program. I do not have an example that precisely matches your use case, but you can find one that combines both techniques in the Reddit case study of Mastering ArduinoJson.

Are you sure you can't work with just the filter?
Did you check with the ArduinoJson Assistant how much RAM you need?

from arduinojson.

Ohh, I thought [0] would mean that it just applied to the first item of the array. I actually thought there was a bug because filter["beats"][0] = true; still keeps all beats items not just the first. Thanks for the explanation! 🙏

Chunk deserialization seems to be very invasive in the streaming process. I don't really understand how I would combine the usage of filters and chunk deserialization in order to get rid of some items from some arrays. Are there any examples?

from arduinojson.

I'll look into it. The issue is that the project I'm working on is already using most of the RAM even without the Spotify integration, so I need to save as much as possible to get a stable result. At the moment songs containing more than n beats will reliably cause my ESP to run out of memory.

from arduinojson.