Comments (3)
Having resolved the sync issue, the most noticable change was that tests began timing out.
Running tests in 18.3:
Top 10 slowest tests (11.943 seconds, 70.3% of total time):
leveled_iclerk:file_gc_test/0
2.210 seconds
leveled_inker:compact_journal_test/0
2.047 seconds
leveled_pmanifest:snapshot_timeout_test/0
2.005 seconds
leveled_sst:simple_persisted_test/0
1.212 seconds
leveled_tree:skpl_timing_test/0
1.130 seconds
leveled_inker:empty_manifest_test/0
1.011 seconds
leveled_pmem:with_index_test_/0
0.747 seconds
leveled_pclerk:merge_file_test/0
0.579 seconds
leveled_cdb:state_test/0
0.514 seconds
leveled_tictac:merge_bysize_xlarge_test_/0
0.488 seconds
Finished in 16.985 seconds
132 tests, 0 failures
But running tests in R16 (basho10):
Top 10 slowest tests (72.099 seconds, 85.3% of total time):
leveled_bookie:hashlist_query_test_/0
13.720 seconds
leveled_iclerk:compact_singlefile_totwosmallfiles_test_/0
11.224 seconds
leveled_cdb:get_keys_byposition_manykeys_test_/0
11.184 seconds
leveled_bookie:foldobjects_vs_foldheads_bybucket_test_/0
8.958 seconds
leveled_bookie:foldobjects_vs_hashtree_test_/0
8.911 seconds
leveled_bookie:hashlist_query_withjournalcheck_test_/0
8.892 seconds
leveled_inker:compact_journal_test/0
2.685 seconds
leveled_bookie:ttl_test/0
2.305 seconds
leveled_iclerk:file_gc_test/0
2.214 seconds
leveled_pmanifest:snapshot_timeout_test/0
2.006 seconds
Finished in 84.511 seconds
132 tests, 0 failures
from leveled.
This time difference may be related to the riak_sync of flushing manually each write (rather than passing the sync flag). This might be macbook specific.
Essentially running sync on OT18 (which should pass the sync flag) is only marginally slower (20%) than running the ct tests with no sync on OTP16. It is definitely syncing - as it manages >> 1000 tps in iostat. The same test with sync (and hence riak_sync) in OTP 16 only manages 500 tps and is more than fifty times slower
Without sync enabled there is negligible performance difference between OTP versions.
from leveled.
from leveled.
Related Issues (20)
- Memory utilisation for large stores HOT 2
- Snapshot time
- Outdated deps preventing build HOT 3
- Potential Issue re delete post-compaction HOT 1
- Use standard erlang logger HOT 1
- Rebuilding ledger - but first 50K gone HOT 1
- leveled_monitor - sample_period HOT 1
- Penciller work backlog HOT 2
- Never stalling is an issue HOT 1
- Backup timeouts HOT 1
- term_to_binary/1 may change - and it has in OTP 26 HOT 1
- Object TTL HOT 1
- Snapshot releasing on shutdown HOT 2
- Allow full bookie snapshots that support query API
- Further compression control
- Publish to Hex HOT 5
- Leveled - Safety Features within Design/Implementation
- Extend query support in leveled HOT 3
- Clearing garbage HOT 1
- Experiment with read cache
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from leveled.