scan_csv infer_schema_length=None doesn't merge across files about polars HOT 2 CLOSED

Note also that if a column is missing in one CSV, and present in the other, there will be a ShapeError. I expect it to just be present in the final LazyFrame, with null for the rows from the CSV where the column doesn't exist.

from polars.

Note also that if a column is missing in one CSV, and present in the other, there will be a ShapeError. I expect it to just be present in the final LazyFrame, with null for the rows from the CSV where the column doesn't exist.

For this, I would suggest to scan the files individually and then use a diagonal concat, i.e.:

pl.concat([pl.scan_csv(path) for path in files], how='diagonal')

I don't think we should add this to the CSV reader would cause issues with some other functionality that relies on the CSV files having the same number of columns.

from polars.