Comments (6)
If your initial request was something like text search across a folder full of different parquet files, like
grep
search, that's not something I plan on adding any time soon.
Yes
My request was this
I hope you add this feature soon
At the right time
from parquetviewer.
Could you try the following to see if it will work for you?
- Using v2.6.0 go to
File -> Open Folder
- Select your folder containing your parquet files
- Once loaded, increase Record Count to how ever much you need. (Search only runs on records that are loaded into memory†)
- Perform your search in the query box
from parquetviewer.
Hey @AFgh24 Any luck with the latest beta release?
from parquetviewer.
Thank
I put two sample files in one folder
The first example file opens in the folder (no problem)
https://github.com/Teradata/kylo/tree/master/samples/sample-data/parquet
The second example files are closed without being fully loaded (problematic)
https://huggingface.co/docs/datasets-server/parquet
https://huggingface.co/datasets/duorc/resolve/refs%2Fconvert%2Fparquet/SelfRC/duorc-validation.parquet
https://huggingface.co/datasets/duorc/resolve/refs%2Fconvert%2Fparquet/ParaphraseRC/duorc-validation.parquet
When both sample files are placed in the same folder, the following error is given
https://gcdnb.pbrd.co/images/I2sVBNG44bza.png
from parquetviewer.
Hey @AFgh24 ,
Thanks for the sample files. This error means the folder you are trying to open contains different parquet files. The utility cannot open multiple parquet files with different schemas. It only works if all the parquet files in the folder have the same schema, meaning they are truly partitioned.
If your initial request was something like text search across a folder full of different parquet files, like grep
search, that's not something I plan on adding any time soon.
from parquetviewer.
Going to close this issue out with the won't fix tag for now.
from parquetviewer.
Related Issues (20)
- Unsupported Nested Structs HOT 7
- [FEAT] IO Unblock? HOT 1
- The query doesn't not seem to be valid. Please try again cannot find column 'user_name' HOT 4
- [BUG] Opening folder with `_SUCCESS` files causes exception HOT 3
- [FEAT] Support Array of Struct Type HOT 8
- [QUESTION] Query formatting HOT 4
- [BUG] Error viewing metadata HOT 5
- [BUG] Error when opening file containing columns of LIST type HOT 3
- [BUG] sbyte and byte types swapped HOT 1
- [BUG] Unable to open the file which contains a nullable guid column HOT 2
- [BUG] Exception repeatedly thrown when widening window to include a column containing arrays of bytes HOT 5
- [BUG] Unable to display data exported from Oracle database HOT 5
- Application Error when trying to open parquet file HOT 2
- [FEAT] View per-column metadata HOT 3
- [BUG] audio unsupported!!!! HOT 1
- [BUG] Timestamp display arrow 13.0 HOT 3
- [BUG] Cannot open parquet file when column name includes "/" HOT 1
- [BUG] Cannot open Delta Lake checkpoint parquet file HOT 4
- [BUG] Cannot Open Parquet HOT 8
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from parquetviewer.