[BUG] Exception repeatedly thrown when widening window to include a column containing arrays of bytes about parquetviewer HOT 5 CLOSED

Thanks @mukunku! Yes, the byte[] in the sample file is a 3D mask we use for our application that does not correspond to any well-known file type. I think the solution you have provided is excellent, and will serve our purposes very nicely.

from parquetviewer.

Have the same issue with v2.6 throwing error for byte columns. 2.4.7834 also threw an error 'encoding RLE_Dictionary is not supported' for the same file.

Edit: also an issue in 2.7.0.3

from parquetviewer.

I haven't been able to replicate this issue on my end. I tried with a parquet file containing byte and byte[] fields.

Any chance you folks could provide a sample file?

from parquetviewer.

I haven't been able to replicate this issue on my end. I tried with a parquet file containing byte and byte[] fields.

Any chance you folks could provide a sample file?

Sure thing - the attached one fails pretty hard on Version 2.7.1.0. In 2.6.0.2 it shows just the first two columns, but not the last (byte[]) column. In 2.4.2.0 it works great (shows all three columns, including last byte[] column).
BytesFailsIn2.7.1.0.zip

from parquetviewer.

Thanks a lot for the sample file @Dave-Kiwi .

I added a temporary patch to support converting byte[] data to string so it can be displayed. This is available now in v2.7.2.1

Details

So this is an issue with the fact that we use AutoGenerateColumns = true when generating the gridview. And the internal .net framework logic thinks byte[] types are for images. So it tries to render an image with your byte data and fails. And it fails for each cell so that might be why it triggers so often.

I also put in a fix so any time a value can't be rendered it will be skipped like so:

A real proper fix would be to do our own column generation and handle all the different data types ourselves. This is something I'll have to pursue another time; if there's more desire to support different array types.

from parquetviewer.