Comments (2)
Thanks to @cmdlineluser there's a workaround if within pl.scan_parquet
rechunk
is set to True
.
from polars.
Awesome, thanks!
from polars.
Related Issues (20)
- Filtering with pl.col is substantially (27x) slower than filtering with pl.Series HOT 3
- Ability to `sink` lazy datasets to `STDOUT` or to files
- Panicking with "Unreachable code" when passing a DataFrame into `DataFrame.drop` HOT 1
- Polars produce wrong result in streaming mode HOT 2
- Consider removing unnecessary projection for single key join followed by `.select(pl.len())` HOT 1
- Initializing a struct series with an array type field using Numpy arrays results in nulls
- `Series` constructor is not strict for nested lists
- `join` can be called with both `on=` and `left_on=`
- Casting negative or large values to Time causes panic HOT 2
- cross join should raise when `on` is provided HOT 1
- Implement min-max predicate pushdown optimisation through joins (from DuckDB)
- `df.write_excel` does not work with file objects HOT 2
- Broken API links in the user guide (404 page not found) + stale documentation example (fetch function) HOT 4
- Performance of register_plugin_function HOT 7
- `include_index` ignored in `pl.from_pandas(pd.Series)`
- `map_batches` isn't streaming with new streaming engine HOT 2
- Move the option to overwrite field names to be responsibility of the `new_columns` parameter
- Adding Literal column of Enum dtype fails (for small DataFrame only) HOT 1
- Parquet writer statistics for categorical/enum values have overall min/max instead of row_group min/max HOT 1
- Parquet scanner doesn't do predicate pushdown for categoricals/enums HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from polars.