Stack Overflow (?) crash when using `all_horizontal` about polars HOT 4 CLOSED

Yes, we will fix that. ;)

from polars.

I have the same issue.

from polars.

This is a stackoverflow. We can improve remove that. However, if you are doing such wide horizontal operations, I would consider transposing as this will never be performant (and will also not be on pandas when they transition to pyarrow).

from polars.

On my 2 computers, the code starts crashing at about ~750 columns.

I would argue that this amount of columns, while quite big, should not crash polars.
In my use case, I use polars to handle time series, and unfortunately we can have in the worst case ~1k colums for 10k-100k rows, so transposing the dataframe would not help. We would have to write custom code to split the dataframes then aggregate the results.

(In my initial code, I used all_horizontal to drop all rows containing at least 1 nan)

As a temporary workaround, sum_horizontal does not crash, so maybe I will see if I can rely on this method instead.

from polars.