Light

buildkite / rails-parallel-example Goto Github PK

View Code? Open in Web Editor NEW

7.0 21.0 15.0 10 KB

An example of how to run Rails CI and test steps in parallel with Buildkite

Home Page: https://github.com/buildkite/example-pipelines

License: MIT License

Shell 7.64% Ruby 92.36%

buildkite rails knapsack rbenv parallel pipeline

rails-parallel-example's Introduction

Buildkite Rails Parallel Example

This repository is an example on how to easily run 20 parallel testing agents for a Rails application using Buildkite, rbenv and Knapsack.

This repository doesn't actually include a Rails sample application, but has the same CI scripts you would use for a production application.

Files to note:

.buildkite/hooks/environment - loads rbenv
.buildkite/pipeline.yml - the pipeline config showing how to have parallel steps
scripts/ci/setup.sh - sets up the CI environment for each step
scripts/ci/parallel_specs.sh - runs the specs in parallel using Knapsack

How does it work?

In the pipeline configuration file the parallelism property for the test step is set to 20. When a build, the step will appear 20 times in the pipeline, each with different environment variables exposed so you can divvy up your test suite accordingly. You can then run 20 agents (on the same machine, or distributed) to work on the 20 jobs in parallel.

steps:
  - name: ":rspec:"
    command: "scripts/ci/setup.sh && scripts/ci/parallel_specs.sh"
    parallelism: 20

See the parallelizing builds guide for more information to create parallelized and distributed builds with Buildkite.

Consult the Knapsack documentation for configuring your database and dependent services to support running parallel steps on the one machine.

Knapsack Pro

See Knapsack Pro version of this example pipeline for how to perform dynamic splits/allocation of test nodes.

License

See Licence.md (MIT)

rails-parallel-example's People

Contributors

Stargazers

Watchers

Forkers

autit-build-agent knapsackpro thephw manoelhc urspraveen2001 isabella232 nickrycar dinjas thewatts niceking

rails-parallel-example's Issues

Action Required: Fix Renovate Configuration

There is an error with this repository's Renovate configuration that needs to be fixed. As a precaution, Renovate will stop PRs until it is resolved.

File: renovate.json
Error type: Invalid JSON (parsing failed)
Message: Syntax error: expecting String near it": 0, }

Doesn't seem to work on BuildKite?

Hello! :)

Super intrigued about BuildKite -

Forked this repo, set it up in BuildKite, and submitted a PR, and it failed almost instantly.
I'm super new here - so maybe I was expecting more of the sample repo than I should have been.

Thanks for your help!

Dependency Dashboard

This issue lists Renovate updates and detected dependencies. Read the Dependency Dashboard docs to learn more.

Repository problems

These problems occurred while renovating this repository. View logs.

WARN: Detected empty commit - aborting git push

Other Branches

These updates are pending. To force PRs open, click the checkbox below.

Update dependency knapsack to v1.22.0
Update dependency rspec to v3.13.0

Open

These updates have all been created already. Click a checkbox below to force a retry/rebase of any.

Update dependency knapsack to v4

Detected dependencies

bundler

Gemfile

rspec undefined

knapsack undefined

npm

package.json

Check this box to trigger a request for Renovate to run again on this repository

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.