Code Monkey home page Code Monkey logo

aws-emr-launcher's Introduction

Build Status

aws-emr-launcher

aws-emr-launcher is a generic python library that enables to provision emr clusters with yaml config files (Configuration as Code).

Get started by installing the packages.

pip install pyyaml==5.2

pip install aws-emr-launcher

Features

  • Configuration as Code to launch EMR clusters.

  • Support to launch EMR clusters in multiple AWS regions.

  • Provision for environment specific configuration files.

  • Works with lambda layers.

Documentation

Documentation for this project is available in GitHub Wiki.

aws-emr-launcher's People

Contributors

harshadranganathan avatar

Stargazers

 avatar  avatar  avatar

Watchers

 avatar

aws-emr-launcher's Issues

pyyaml wheel setup failing

Steps to reproduce:

  1. Specify pyyaml as a dependency in setup.py, generate and publish dist.
  2. Run pip install of aws-emr-launcher package which will fail with below error
Collecting pyyaml
  Downloading https://test-files.pythonhosted.org/packages/3a/09/50cff727ed4679924f3994c69a1fa27405a69a40038dc71b47204746ad2d/PyYAML-3.11.tar.gz (138kB)
     |████████████████████████████████| 143kB 2.2MB/s
    ERROR: Command errored out with exit status 1:
     command: 'c:\users\harshad\.virtualenvs\aws-emr-launcher-example-ulrtls6g\scripts\python.exe' -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\Harshad\\A
ppData\\Local\\Temp\\pip-install-19u756cl\\pyyaml\\setup.py'"'"'; __file__='"'"'C:\\Users\\Harshad\\AppData\\Local\\Temp\\pip-install-19u756cl\\pyyaml\\setup.py'"'"';f=getattr(t
okenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base 'C:\Use
rs\Harshad\AppData\Local\Temp\pip-install-19u756cl\pyyaml\pip-egg-info'
         cwd: C:\Users\Harshad\AppData\Local\Temp\pip-install-19u756cl\pyyaml\
    Complete output (7 lines):
    running egg_info
    creating C:\Users\Harshad\AppData\Local\Temp\pip-install-19u756cl\pyyaml\pip-egg-info\PyYAML.egg-info
    writing C:\Users\Harshad\AppData\Local\Temp\pip-install-19u756cl\pyyaml\pip-egg-info\PyYAML.egg-info\PKG-INFO
    writing dependency_links to C:\Users\Harshad\AppData\Local\Temp\pip-install-19u756cl\pyyaml\pip-egg-info\PyYAML.egg-info\dependency_links.txt
    writing top-level names to C:\Users\Harshad\AppData\Local\Temp\pip-install-19u756cl\pyyaml\pip-egg-info\PyYAML.egg-info\top_level.txt
    writing manifest file 'C:\Users\Harshad\AppData\Local\Temp\pip-install-19u756cl\pyyaml\pip-egg-info\PyYAML.egg-info\SOURCES.txt'
    error: package directory 'lib3\yaml' does not exist
    ----------------------------------------
ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

Travis CI build is failing

[pipenv.exceptions.InstallError]: ['Could not find a version that satisfies the requirement pywin32==227 (from -r /tmp/pipenv-h6ja6p9z-requirements/pipenv-d4v0ap3w-requirement.txt (line 1)) (from versions: )', 'No matching distribution found for pywin32==227 (from -r /tmp/pipenv-h6ja6p9z-requirements/pipenv-d4v0ap3w-requirement.txt (line 1))']

Refer -

getmoto/moto#2686

docker/docker-py#2469

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.