Code Monkey home page Code Monkey logo

Comments (7)

schnie avatar schnie commented on May 31, 2024 1

Hey @pedromachados, we'll be updating the docs soon. We are in the process of moving some of this functionality to our CLI, but that's under very active development at this point.

For now, running something like docker-compose --scale worker=2 or just plain docker-compose up is the way to go.

To run a custom image, you can change to the directory of your project and just run something like docker build -t mycompany/airflow:latest .. If you've previously worked with the project in this directory it should have a Dockerfile with FROM astronomerinc/ap-airflow:latest-onbuild. If that file does not exist, you can simply create it.

Now that you have a base image, you can change the values inside the .env file next to the docker-compose.yaml file. You should be able to change IMAGE_NAME, to whatever you named it before (mycompany/airflow), and set AIRFLOW_HOME to path to your actual project. This will mount several directories from the image to the host so you can hack on your python code without restarting the docker-compose project. You will have to restart if you add anything to packages.txt or requirements.txt though.

This was basically what the old start script did under the hood.

Hope that helps for now. @tedmiston and @andscoop can you guys help out with these docs and/or brainstorming any other ideas here?

from astronomer.

tedmiston avatar tedmiston commented on May 31, 2024

^ One typo in the third command above — should be docker build ...

I'll update the docs in Open to reflect what Greg wrote.

from astronomer.

ryw avatar ryw commented on May 31, 2024

@tedmiston closing this out today? If not, remove from milestone

from astronomer.

tedmiston avatar tedmiston commented on May 31, 2024

@ryw Yes, I'll close it today

from astronomer.

ryw avatar ryw commented on May 31, 2024

@tedmiston ... only one other issue left, it's you vs. brad :)

from astronomer.

tedmiston avatar tedmiston commented on May 31, 2024

Mostly working on Kafka today so he'll probably win that one. This one is end of day for me.

from astronomer.

tedmiston avatar tedmiston commented on May 31, 2024

Closed via #39

from astronomer.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.