Comments (3)
Hi~ @gitfortian . Could you sync the size of your Paimon table and the number of data files in this table,did this occur in hive client and how much memory you have set.
from paimon.
There is an improvement in #3348
from paimon.
hi~ @gitfortian you can have a try #3348
from paimon.
Related Issues (20)
- [Bug] While loop to cache build could lead to harmful IO operation
- [Feature] Avoid release all of the LookupFile during failover
- It is hoped that paimon-cdc whole database synchronization can set partitioning and bucketing strategies for each table.
- [Feature] Add writing different data for keys in lookup file store benchmark
- [Feature] When the MergeEngine of the dimension table is aggregation / partial-update, there is no need to forcibly enable changelog-producer. HOT 2
- [Bug] Flink lookup join throws ArrayIndexOutOfBoundsException
- [Feature] Fix invalid header size in slice comparator for sort file store
- [Bug] an exception occurs when running HiveCatalogTest in IDEA.
- [Bug] [core] in Partition table case, call IndexBootstrap.bootstrapType function throw exception
- [Feature] Show Columns syntax not support in paimon
- non-partitioned table, Failed to write deletion vectors [Bug] HOT 8
- [Feature] paimon sink support unaligned checkpoint
- [Bug] [core] The java api calls Tableimp.write to write data and throws exception HOT 3
- [Bug] Avoid FileNotFoundException when looking for the latest snapshot of user
- [Bug] when use `from-timestamp` read data from snapshot, if time < earliestSnapshot time , no data return
- [Bug] Flaky test Hive31CatalogITCase.testDropPartitionFromBranchLocationInProperties & TestHiveMetastore HOT 1
- [Feature] Support schema evolution for nested struct add new children fields. HOT 1
- [Bug] The actual exception from AppendOnlyFileStoreWrite#compactRewriter may be swallowed.
- [Feature] [Spark] Support Spark 4.0 (preview)
- [Feature] [Spark] Remove support for Spark 3.1 HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from paimon.