Code Monkey home page Code Monkey logo

contentdruid's Introduction

contentDruid

A collection of Python scripts for various content object jobs. These are very powerful scripts, so please read the spec and use them with respect and ease. A sloth is is a passive script, finding things for you. A load requires some sort of input file. p.s. I like to call Python scripts, "Python pythons." Why? Because it is fun :)
Eveything is written in Python 3.6.5 with 3.X in mind

filesSlothRestore.py - Find and restore deleted file objects
filesDeleteLoad.py - Deletes file objects by id
urlMappingLoad.py - Bulk edit and create URL mapping objects
urlMappingSlothRestore.py - Find and restore deleted mapping objects
urlMappingPurge.py - Find and delete all url mapping objects
postsSlothRestore.py - Find and restore deleted post objects
findSetFeaturedImages.py - Find and set featured images for blog post objects
pagesSlothRestorePublish.py - Find, restore and publish deleted page objects
tagsSlothRestore.py - Find and restore deleted tag objects
moveWebsiteToLanding.py - Move all Website Pages to Landing pages
domainNullifier.py - Null out the domain field for pages on a certain domain
cmsFinder.py - Figures out which CMS a page uses and grades it in PSI (desktop and mobile)
cdn1Replacer.py - Finds cdn1 image src uri in post bodies, and replaces them with newly uploaded cdn2 files
hubDangerZoneLasso.py - Finds and replaces ALL instances of a string in page objects

filesSlothRestore.py

A Python python to find deleted file objects and restore them
REQUIRES
requests

USAGE
This Python python takes two agruments: accessToken & slothStart
accessToken - An access_token for the portal you want to filesSlothRestore
slothStart - A millisecond unix timestamp used in the deleted_at__gt request parameter to dictate the start time of file deletion timestamps to GET

$ python3 filesSlothRestore.py 1234-5678-9123-4567 1529816400000  

Runs filesSlothRestore.py finding files deleted after 1529816400000 (June 24th, 2018 0:00:00) for portal with access token 1234-5678-9123-4567

filesDeleteLoad.py

DELETES file objects by id
REQUIRES
requests

USAGE
This Python python takes one agrument: accessToken
accessToken - An access_token for the portal you want to filesDeleteLoad

It also requires a Python list of file object ids to delete, set in the filesToDelete variable, like: filesToDelete = [1234, 5678, 3658, 8573]

$ python3 filesDeleteLoad.py 1234-5678-9123-4567

Runs filesDeleteLoad.py on portal with access token 1234-5678-9123-4567, DELETING every file object id in the filesToDelete variable

urlMappingLoad.py

A Python python to bulk edit and create URL mapping objects. Regex (!DEL!).*?[\d]+ is a good way to remove the !DEL!<some number> from restored mappings
REQUIRES
requests

USAGE
This Python python takes one agrument: accessToken
accessToken - An access_token for the portal you want to urlMappingLoad
This Python python also requires a JSON file to import. This file should be called mappingsToLoad.json and should live in the "import" folder - path import/mappingsToLoad.json. This file should have a JSON object with the updated JSON of the mappings you wish to update, and that of new mappings to create, like:

[
    {  
        "id":5265745360,
        "destination":"https://www.destination.com",
        "redirectStyle":301
    },
    {  
        "id":4967273182,
        "isMatchFullUrl": true,
        "isProtocolAgnostic": false
    },
    {  
        "routePrefix":"https://www.routeprefix.com/prefix",
        "destination":"https://www.destination.com/destination",
        "isOnlyAfterNotFound":true,
        "redirectStyle":301,
        "precedence":123,
        "isPattern": false,
        "isMatchQueryString": true
    }
]

Only the included JSON keys will be updated for a given mapping id included in mappingsToLoad.json (first 2 examples). Mapping objects in mappingsToLoad.json without an id key will be created as new mappings (3rd example).

$ python3 urlMappingLoad.py 1234-5678-9123-4567  

Runs urlMappingLoad.py on portal with access token 1234-5678-9123-4567, updating each mapping id included in mappingsToLoad.json with the included keys in in the first two individual mapping JSON objects, and creating a new mapping with included keys for the third

urlMappingSlothRestore.py

A Python python to find deleted mappings and restore them. Regex (!DEL!).*?[\d]+ is a good way to remove the !DEL!<some number> from restored mappings
REQUIRES
requests

USAGE
This Python python takes two agruments: accessToken & slothStart
accessToken - An access_token for the portal you want to urlMappingSlothRestore
slothStart - A millisecond unix timestamp used in the deleted_at__gt request parameter to dictate the start time of file deletion timestamps to GET

$ python3 urlMappingSlothRestore.py 1234-5678-9123-4567 1529816400000  

Runs urlMappingSlothRestore.py finding mappings deleted after 1529816400000 (June 24th, 2018 0:00:00) for portal with access token 1234-5678-9123-4567

urlMappingPurge.py

A Python python to find and delete ALL mappings in a portal
REQUIRES
requests

USAGE
This Python python takes one agrument: accessToken
accessToken - An access_token for the portal you want to urlMappingPurge

$ python3 urlMappingPurge.py 1234-5678-9123-4567  

Runs urlMappingPurge.py finding and deleting all mappings for portal with access token 1234-5678-9123-4567

postsSlothRestore.py

A Python python to find deleted posts and restore them
REQUIRES
requests

USAGE
This Python python takes three agruments: accessToken, slothStart & contentGroupId
accessToken - An access_token for the portal you want to urlMappingSlothRestore
slothStart - A millisecond unix timestamp used in the deleted_at__gt request parameter to dictate the start time of file deletion timestamps to GET
contentGroupId - The blog id to find deleted posts in

$ python3 postsSlothRestore.py 1234-5678-9123-4567 1529816400000 2509275571  

Runs postsSlothRestore.py finding posts deleted after 1529816400000 (June 24th, 2018 0:00:00) for portal with access token 1234-5678-9123-4567 in blog 2509275571

findSetFeaturedImages.py

A Python python which goes through all posts in a blog and enables featured images, finding and setting an image from the post body as featured if one is not already set. If a post has no post body images, nothing will happen to that post.
REQUIRES
requests

USAGE
This Python python takes 2 arguments: accessToken & contentGroupId
accessToken - An access_token for the portal you want to findSetFeaturedImages
contentGroupId- The blog id of the blog you want to findSetFeaturedImages

$ python3 findSetFeaturedImages.py sdfgsdfg-5537-sdfgs-bae6-23455 6515379725

Loops through all posts in blog id 6515379725 for portal with acces token sdfgsdfg-5537-sdfgs-bae6-23455, finding and setting featured images for all posts

pagesSlothRestorePublish.py

A Python python to find deleted pages, restore, and publish them
REQUIRES
requests

USAGE
This Python python takes two arguments: accessToken, slothStart

accessToken - An access_token for the portal you want to urlMappingSlothRestore
slothStart - A millisecond unix timestamp used in the deleted_at__gt request parameter to dictate the start time of file deletion timestamps to GET

$ python3 pagesSlothRestorePublish.py 1234-5678-9123-4567 1529816400000    

Runs pagesSlothRestorePublish.py finding pages deleted after 1529816400000 (June 24th, 2018 0:00:00) for portal with access token 1234-5678-9123-4567 and publishes them

tagsSlothRestore.py

A Python python to find deleted tag objects and restore them
REQUIRES
requests

USAGE
This Python python takes two agruments: accessToken & slothStart
accessToken - An access_token for the portal you want to tagsSlothRestore
slothStart - A millisecond unix timestamp to dictate tags deleted after X timestamp to be restored

$ python3 tagsSlothRestore.py 1234-5678-9123-4567 1529816400000  

Runs tagsSlothRestore.py finding tags deleted after 1529816400000 (June 24th, 2018 0:00:00) for portal with access token 1234-5678-9123-4567

moveWebsiteToLanding.py

A Python python to move all Website Pages to Landing Pages
REQUIRES
requests

USAGE
This Python python takes one argument: accessToken

accessToken - An access_token for the portal you want to moveWebsiteToLanding

$ python3 moveWebsiteToLanding.py 1234-5678-9123-4567  

Runs moveWebsiteToLanding.py moving all website pages to landing pages for portal with access token 1234-5678-9123-4567

domainNullifier.py

A Python python to null out the domain field for pages on a certain domain. This is helpful to allow pages (ENT portals) to inherit the domain that is primary for their content type. CAREFUL this will null out the domain for every page on a domain, so refine the pagesSlothApiQuery if you only want to touch some pages
REQUIRES
requests

USAGE
This Python python takes two argument: accessToken & domain

accessToken - An access_token for the portal you want to domainNullifier
domain - The domain of pages you want to domainNullifier

$ python3 domainNullifier.py 1234-5678-9123-4567 www.domain.com  

Runs domainNullifier.py for pages on www.domain.com, nulling out the domain field for pages which have it set as the domain argument, allowing these pages to inherit the domain that is primary for their content type for portal with access token 1234-5678-9123-4567

cmsFinder.py

REQUIRES
BeautifulSoup

USAGE
This Python python figures out which CMS a page uses and grades it in PSI mobile and desktop. Requyires creating a Python list in pagesToScrub of the pages/sites to crawl, like: pagesToScrub = ["http://www.puppy.com", "http://cats.com", ...]

$ python3 cmsFinder.py

This will output the CMS a site uses based on the meta name="generator" HTML tag. If there is no generator meta tag, we will look for some other common signs of certain CMSs.

cdn1Replacer.py

REQUIRES
requests

USAGE
This Python python finds cdn1 images in post bodies, creates a cdn2 version of the file, and updates the post body to use the new cdn2 image srcs. This Python python takes two agruments: accessToken & contentGroupId
accessToken - An access_token for the portal you want to urlMappingSlothRestore
contentGroupId - The blog object Id you wish to cdn1Replacer.py

$ python3 cdn1Replacer.py 1234-5678-9123-4567  6053289841

This will look at the post bodies of all blog posts in blog id 6053289841, fnding all cdn1 image sources, creating a new cdn2 file, forumlating a new post body with the cdn2 image sources, and updating the blog post

hubDangerZoneLasso.py

THIS IS SKETCHY, ONLY USE IN DIRE SITUATIONS REQUIRES
requests

USAGE
This Python python finds ALL instances of a string, and replaces it with another STRING ANYWHERE in a page object. The string can be nested anywhere on the JSON tree of the page object and it will be replaced. The replaced page object is then PUT back and made live. This Python python takes four agruments: accessToken, stringToLasso, lassoReplace & mode
accessToken - An access_token for the portal you want to urlMappingSlothRestore
stringToLasso - The string to find
lassoReplace - The string to replace with
mode - Will not actually update anything unless this argument is equal to write

$ python3 hubDangerZoneLasso.py 1234-5678-9123-4567 findme replacewithme write

This will look at all page objects in portal with access_token 1234-5678-9123-4567, finding and replacing ALL INSTANCES OF "findme" with "replacewithme", and updating the page with the newwly replaced content

contentdruid's People

Contributors

williamspiro avatar zogcodes avatar

Stargazers

Brandon Kirschner avatar

Watchers

 avatar  avatar

Forkers

levinkeo zogcodes

contentdruid's Issues

Unpublish and archive script

We need a script to bulk unpublish and archive pages, also adding -archived to the slug of these pages to prevent slug conflicts for new pages to go live.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.