pyscrape Goto Github PK

httpbin

HTTP Request & Response Service, written in Python + Flask.

hypothesis

Hypothesis is a powerful, flexible, and easy to use library for property-based testing.

impacket

Impacket is a collection of Python classes for working with network protocols.

kivy

Open source UI framework written in Python, running on Windows, Linux, macOS, Android and iOS

kotlin-webview

Kotlin on Android tutorial series which describes how to create an Android Web Browser.

laa-fee-calculator

Fee calculator for LAA

learn_python3_spider

python爬虫教程系列、从0到1学习python爬虫，包括浏览器抓包，手机APP抓包，如 fiddler、mitmproxy，各种爬虫涉及的模块的使用，如：requests、beautifulSoup、selenium、appium、scrapy等，以及IP代理，验证码识别，Mysql，MongoDB数据库的python使用，多线程多进程爬虫的使用，css 爬虫加密逆向破解，JS爬虫逆向，分布式爬虫，爬虫项目实战实例等

licence-checker

Check which repos in your Github organisation do not have LICENCE files

locust

Scalable user load testing tool written in Python

major-scrapy-spiders

Scrapy spiders of major websites. Google Play Store, Facebook, Instagram, Ebay, YTS Movies, Amazon

maltrail

Malicious traffic detection system

material-dialogs

😍 A beautiful, fluid, and extensible dialogs API for Kotlin & Android.

mechanicalsoup

A Python library for automating interaction with websites.

mobile-security-framework-mobsf

Mobile Security Framework (MobSF) is an automated, all-in-one mobile application (Android/iOS/Windows) pen-testing, malware analysis and security assessment framework capable of performing static and dynamic analysis.

news-scraping-with-scrapy

Scraping financial news of 22 big public companies from 2011 to 2017. the result of this project will support my other big project "Sentiment Analysis on Financial News" using Machine Learning and Natural Language Processing

newspaper

News, full-text, and article metadata extraction in Python 3. Advanced docs:

newsscrapy

基于scrapy的新闻爬虫

nino-format-validation

Encapsulated utility to validate and extract various markers from a National-Insurance-Number (NINO)

paas-compose-scraper

paas-cve-notifier

phone-email-extractor

Extracting Phone numbers and email addresses from the text documents.

photon

Incredibly fast crawler designed for OSINT.

poetry

Python dependency management and packaging made easy.

pornhubbot

全球最大成人网站PornHub爬虫 （Scrapy、MongoDB）

portia

Visual scraping for Scrapy

pyautogui

A cross-platform GUI automation Python module for human beings. Used to programmatically control the mouse & keyboard.

pyinstaller

Freeze (package) Python programs into stand-alone executables

pypdf2

A utility to read and write PDFs with Python

pyspider

A Powerful Spider(Web Crawler) System in Python.

python-for-android

Turn your Python application into an Android APK