Comments (1)
Atoti can handle very large volumes of data while still providing fast answers to queries. However loading a large amount of data during the modeling phase of the application is rarely a good idea because creating stores, cubes, hierarchies and measures are all operations that takes more time when there is more data.
Sampling is a way to have immediate feedback for each cell call so as a rule of thumb you can try to use session.load_all_data
as late as possible in your project, even as the last line of your notebook if you can.
Think of it as first building your model with a sample of the data, then replaying every thing with the whole dataset but instead of replaying each cell you call session.load_all_data
.
I encourage you to read this medium article about sampling.
I will add some doc to the session.load_all_data
method to clarify that.
from atoti.
Related Issues (20)
- How to format date (i18n)?
- Can't change from seconds to datetime HOT 4
- Use quick filter to filter with two different hierarchies with the same value
- Two reachable fields with the same alias HOT 1
- Can't add an integer/double to a vector HOT 4
- Extra columns in pandas dataframe not supported HOT 2
- Network is unreachable HOT 2
- Missing specification for apply_filters parameter of atoti.function.rank module HOT 1
- How to only show axis ticks for existing values?
- Unknown store when deleting table HOT 1
- UserServiceClient.clear() with Custom Roles Breaks roles Property HOT 3
- Date filter does not reset HOT 1
- Saving axis offsets HOT 1
- "Publish in App" is not available if name is not assigned to visualization HOT 3
- Vector access - Out of Bounds error HOT 1
- Getting Conda Can Not Find Packages when upgrading Atoti HOT 5
- external_database definition missing in atoti_directquery_redshift.table_options module HOT 2
- Atoti 0.8.2 and Python 3.9.1 HOT 3
- Plugin atoti-jupyterlab3 v0.8.2 does not have the same version as the main package (v0.8.3). HOT 12
- head() function throwing an AttributeError
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from atoti.