Comments (4)
For some reasons pip or conda did not install the git master properly and obtained an old version of at least vaex/file/other.py.
It seems corrected after forcing installation.
However, I suggest to raise an exception when no format was found.
from vaex.
Hi Morgan,
there are two issues here, one is a change in file format (the latest git has a better format that allows masked values), but it still understands the older format, and that you've resolved yourself.
The second issue is that if it fails to open a file, it will return None. The reason is that every reader is tried, so if the hdf5 one fails, it will try others and does not know for instance that a file should be able to be opened with the hdf5 reader but due to some bug failed to.
I think a better behaviour would be:
- have a file extension to reader mapping, so .hdf5 will be tried by that specific class
- if it fails, it will try all the others
- and if that still didn't get to anything, it will print out the stacktrace by the initial attempt of opening the file
Do you agree?
cheers,
Maarten
from vaex.
I don't know if you want to check the extension itself. Sounds a good idea to try.
I suggested to raise an issue if none of the readers work. Of course that does not fully says why, but at least would not a code run with a None object.
from vaex.
Fixed in master a while ago.
from vaex.
Related Issues (20)
- [BUG-REPORT] Printing vaex df after sort running out of memory
- [BUG-REPORT] HOT 1
- [BUG-REPORT] Large Groupby Agg runs out of memory
- Vaex not exporting to file properly inside of a mulitprocessing pool.
- [FEATURE-REQUEST] looking for vaex equivalent of pandas_df.corr(min_periods=100)
- [FEATURE-REQUEST] Getting dtype of columns as they are when rendered in a pandas dataframe?
- [BUG-REPORT] SyntaxError when representing result of a basic operation involving Expression and numpy array, with the array on the right of the operator HOT 1
- How do i overcome this issue? HOT 1
- [BUG-REPORT] why the same dataframe and same groupby(vaex.agg.list) operation, one got error and one got correct if i export to hdf5 and loaded it back
- [BUG-REPORT] jupyter notebook error in tutorial docs
- [BUG-REPORT] HDF5 file remains locked after close
- [BUG-REPORT] MinMaxScaler not working after filtering
- [FEATURE-REQUEST] is it still supported
- [FEATURE-REQUEST] read hdf5 file in C++
- [BUG-REPORT] Docs are down HOT 2
- statistics on 2d grids: control the `bin_centers`
- interactive statistic heatmap / quadrilateral mesh
- Unexpected Discrepancy Between Printed Values and Returned Results in vaex.apply() Function
- Exporting out of memory dataframe to parquet error
- Support Cross-Validation ??
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from vaex.