Code Monkey home page Code Monkey logo

screamingfrog-cloud's Introduction

Screaming Frog in the Cloud - A Super Easy Way To Automate and Download Your Crawls

Getting Started

These are some fairly basic instructions which should help you get Screaming Frog up and running in the cloud.

I don't claim that this is the best, most scalable or most efficient way of running SF in the Cloud; the real goal of this little guide is to demonstrate how easy it is to deploy SF in the Cloud, and to hopefully encourage other SEOs out there to try it!

Steps are as follows:

  1. Set up a Ubuntu VPS - Example uses Digital Ocean.
  2. Install Screaming Frog + Dependencies - This can either be done manually or by using Fili Wiese's script
  3. Install Apache - to browse your crawls
  4. Create Cron Jobs - Configure and Schedule your Crawls
  5. Sit back and Relax - Get your files using your web browser

Please note that you don't have to use Digital Ocean or any hosting provider in particular, however it's probably sensible to stick with a Ubuntu VPS to minimise any potential compatability issues with Screaming Frog.

Step 1: Set up a Ubuntu VPS

Step 2: Install Screaming Frog

Step 3: Install Apache

Step 4: Create Cron Jobs

Step 5: Get Your Files

Further Reading

Below are some resources which either inspired me or directly helped me write this guide:

screamingfrog-cloud's People

Contributors

nicksamuel avatar

Stargazers

 avatar null data avatar  avatar Will Samuel avatar Jonathan Hawley avatar

Watchers

 avatar Will Samuel avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.