netconstructor Goto Github PK

scoring_rules

A small library that provides a simple DSL for creating scoring rules (for rankings, rating and similar uses)

scout

Government-wide search and notification website.

scout-api

A library for interacting with Scout (http://scoutapp.com), a hosted server monitoring service. Query for metric data, manage servers, and more.

scout-client

Scout is a simple web monitoring and reporting client. It can connect to a plugin server, download plugins (written in Ruby) and run them on at specified intervals.

scout-plugins

Plugins for the Scout Server Monitoring and Reporting Tool

scout_rails

Monitors a Ruby on Rails application and reports detailed metrics on performance to Scout, a hosted monitoring service.

scrapely

A pure-python HTML screen-scraping library

scrapemark

Scrapemark is a super-convenient way to scrape webpages in Python.

scraper

JS Scraper using jQuery to parse DOM tree

scraper-1

Simple web scraping for Google Chrome.

scraper-2

SkyTruth Scraper

scrapi

scrAPI is an HTML scraping toolkit for Ruby. It uses CSS selectors to write easy, maintainable scraping rules to select, extract and store data from HTML content.

scrapi-1

A Reviews' scraper for Mozilla Firefox Addons written in PHP. ScrAPI retrieves the number of users, the number of reviews and the total number of characters contained by all the reviews of an addon. It computes the probability to get a review for the addon (i.e. ratio #reviews / #users) and the average size of a review (i.e. #characters / #reviews).

scrapi-firefox-extension

Firefox extension for scrapi

scrapist

A web / screen scraper framework written in ruby that assumes scrapes should be configured, not programmed. No data is safe with the Scrapist on the loose!

scrappy

All Powerful Web Harvester, Spider, Scraper fully automated

scrappy-moose

Moose-based All Powerful Web Spidering, Scraping, Crawling Framework

scrapy

Official Github mirror of Scrapy, a fast high-level screen scraping and web crawling framework for Python.

scrapy-1

scrapy-couchdb

A scrapy pipeline for couchdb

scrapy-elasticsearch

A scrapy pipeline which send items to Elastic Search server

scrapy-googledir-mysql

scrapy's googledir example with mysql store pipeline using twisted's adbapi

scrapy-indeed-spider

Scrapy spider for pulling job listings from Indeed

scrapy-linkedin

Using Scrapy to get Linkedin's person public profile.

scrapy-mongodb

Mongodb support for scrapy

scrapy-mongodb-pipeline

MongoDB pipeline for Scrapy. It allows to update existing entries (set new values or add elements to array) when item values are spread over multiple pages

scrapy-mongodb-queue

Use scrapy with mongodb to store the request queues (FIFO or LIFO)

scrapy-proxies

Random proxy middleware for Scrapy

scrapy-proxynova

Use scrapy with a list of proxies generated from proxynova.com

scrapy-redis

Redis-based components for scrapy that allows distributed crawling