Comments (1)
I have tested and it works with this customization script:
#!/bin/bash
apt-get install -y python-pip
pip install numpy==1.15.4
pip install pandas==0.23.4
pip install ujson==1.35
pip install geopandas==0.4.0
pip install lxml==4.3.0
Custom image command:
python generate_custom_image.py \
--image-name conda-custom-image-01 \
--dataproc-version 1.4.10-debian9 \
--customization-script combined.sh \
--zone us-central1-f \
--gcs-bucket gs://test-bucket/dataproc-custom-image-01 \
--no-smoke-test
from custom-images.
Related Issues (20)
- Not Able To Create A Custom Image On MacOS 10.14.5, Python 2.7 HOT 3
- line 37: run.sh: syntax error: invalid arithmetic operator (error token is ".sh") HOT 4
- AttributeError: module 'constants' has no attribute 'version_help_text' HOT 1
- Hue is not getting installed when I pass the Hue initialization script HOT 1
- RuntimeError in Custom Images Python Script HOT 7
- Error creating custom images with Python3
- Dataproc Version Parsing Logic Uses Unavailable Images HOT 1
- Allow using latest version of image HOT 2
- Installing Singularity on a system like Google (GCP) custom images HOT 2
- Script is not working with newer image versions HOT 4
- Dry-run that builds image without publishing it. HOT 1
- Creating a new custom image with 2.0.0-debian10 HOT 1
- Created image is 3 subminor versions behind HOT 4
- --dataproc-version pulling wrong image for Dataproc 2.0 Debian 10 HOT 2
- Error: Requested disk size cannot be smaller than the image size HOT 3
- Cannot find dataproc base image released over 9 days ago HOT 3
- Cannot find dataproc base image HOT 2
- Support `2.0-rocky8` for `--dataproc-version` regex
- Overriding cluster properties
- generate_custom_image script doesn't work
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from custom-images.