Code Monkey home page Code Monkey logo

cloud-report's Introduction

cloud-report-2022

Details about and from the Cloud Report done in Q2 2022

From 2018 to 2021, we produced the series of "Cloud Report", wherein we assessed the performance of AWS vs. GCP along dimensions like TPC-C throughput, I/O, CPU and latency.

This repo will let us aggregate and share data among team members, including processes and results.

Resources for Cloud Report:

Enclosed Binary

The go program contained in this repo can automatically run tests on cloud providers baked into Roachprod.

For more details, see reproduction-steps.md in this repo.

Note: It would be possible to extend this binary to run on other platforms relatively easily, but requires some work to handle cloud-specific tasks––namely, getting machine metadata.

TPC-C Reproduction Steps

  • follow the steps in reproduction-steps.md
  • execute run_tpcc_experiment.sh; e.g., ./run_tpcc_experiment.sh -c aws

Staff

Keith McClellan

  • Vision, structure, messaging, writing

Charlie Custer for Marketing

  • Vision, structure, messaging, writing

Jessica Edwards for Marketing

  • Report production and promotion, messaging

Lidor Carmel for Engineering

  • Automation, data collection and analysis

Yevgeniy Miretskiy for Engineering

  • Automation, data collection and analysis

Stan Rosenberg for Engineering

  • Automation, data collection and analysis

Jane Xing for Engineering

  • Automation, data collection and analysis

cloud-report's People

Contributors

arulajmani avatar awoods187 avatar jess-edwards avatar miretskiy avatar nvanbenschoten avatar pbardea avatar sploiselle avatar srosenberg avatar xun-cockroachlabs avatar zhouxing19 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

cloud-report's Issues

Probably inaccurate pricing for azure managed disks

From the report:

Azure does not provide a 2500 GB option; we used the average cost of a 2TB option and scaled it to 2.5TB.

If I understand correctly, on azure, a 2.5TB premium disk will cost the same as a 4TB premium disk, while a 2.5TB ultra disk will cost the same as a 3TB ultra disk. The former is the disk size as presented to the virtual machine, the latter is the actual disk size. In this case, it so happens that there is no performance difference between a 2TB and a 4TB premium disk, nor between a 2TB and a 3TB ultra disk, thus the performance numbers should be still fair to other providers. However, the pricing calculation as quoted above can still be misleading.

Going forward, the best approach is probably to use either a 2TB disk or a 4TB disk, to cater to azure.

Cant get correct csv file

when use
./cloud-report1 analyze -d cloudDetails/cc.json
i get error:
2021/10/04 18:00:55 analyze.go:374: Analyzing report-data/20211004/gce/pd-ssd/logs/n2-standard-4/coremark-results.20211004.11:33:27/success
Error: error parsing "" in report-data/20211004/gce/pd-ssd/logs/n2-standard-4/coremark-results.20211004.11:33:27/single-0.log: strconv.ParseFloat: parsing "": invalid syntax
Usage:
cloud-report analyze [flags]

Flags:
-h, --help help for analyze

Global Flags:
-d, --cloud-details JSON path(s) to JSON file containing cloud specific configuration.
-o, --output-dir string directory to emit results and scripts (default "./report-data")
-r, --report-version string subdirectory for cloud report data (default "20211004")

error parsing "" in report-data/20211004/gce/pd-ssd/logs/n2-standard-4/coremark-results.20211004.11:33:27/single-0.log: strconv.ParseFloat: parsing "": invalid syntax

When delete success file, i get nothing, only clear csv files.
strace for command ./cloud-report1 analyze -d cloudDetails/cc.json

[pid 204326] newfstatat(AT_FDCWD, "report-data/20211004/results/gce", {st_mode=S_IFDIR|0775, st_size=4096, ...}, 0) = 0
[pid 204326] openat(AT_FDCWD, "report-data/20211004/results/gce/cpu.csv", O_RDWR|O_CREAT|O_TRUNC|O_CLOEXEC, 0644) = 3
[pid 204326] epoll_ctl(4, EPOLL_CTL_ADD, 3, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=3624763416, u64=140118342860824}}) = -1 EPERM (Operation not permitted)
[pid 204326] epoll_ctl(4, EPOLL_CTL_DEL, 3, 0xc0000f96bc) = -1 EPERM (Operation not permitted)
[pid 204326] write(3, "Cloud,Date,MachineType,Cores,Sin"..., 53) = 53
[pid 204326] close(3) = 0
[pid 204326] exit_group(0) = ?
[pid 204329] <... futex resumed>) = 231
[pid 204328] <... futex resumed>) = ?
[pid 204330] <... futex resumed>) = ?
[pid 204331] <... futex resumed>) = ?
[pid 204327] <... nanosleep resumed> <unfinished ...>) = ?
[pid 204331] +++ exited with 0 +++
[pid 204330] +++ exited with 0 +++
[pid 204329] +++ exited with 0 +++
[pid 204328] +++ exited with 0 +++
[pid 204327] +++ exited with 0 +++
+++ exited with 0 +++

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.