Code Monkey home page Code Monkey logo

abstract-pipeline-runner's Introduction

Abstract Pipeline Runner

This is a rust library that gives you an easy abstraction to "run" any hierarchy of "nodes" you can think of, and supports running nodes sequentially or in parallel.

A node is a struct that can contain either a "task", or a series of more nodes, or a parallel list of more nodes.

a series of nodes get "run" in order, whereas a parallel list of nodes get spawned at the same time, one thread per node.

a "task" is an interface that you as the user of this library will implement to provide an actual way of "doing work". Any data structure can be a "task", so long as it implements the methods provided in the Task trait in this library. Each time a Task is called to "run", it gets provided an immutable view of the global state of the pipeline, and the task can make dynamic decisions based on that. the task "run" method must return a success code (true or false) as well as an optional diff of the global state to be applied by the abstract pipeline runner.

This library does not contain any code to spawn subshells, or execute programs. It only provides a way to easily define a hierarchy of steps, and to run those steps on 1 or more threads as defined by the hierarchy structure.

See also:

abstract-pipeline-runner's People

Contributors

nikita-skobov avatar

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.