Code Monkey home page Code Monkey logo

elliotwutingfeng / tencentqqurlsec Goto Github PK

View Code? Open in Web Editor NEW
1.0 0.0 1.0 159 KB

Tencent QQ has an undocumented publicly-accessible real-time feed of malicious URLs. This repository extracts these URLs, at regular intervals, to a machine-readable .txt blocklist compatible with firewall applications like Pi-hole and pfBlockerNG. (Defunct w.e.f. 25 January 2024)

License: BSD 3-Clause "New" or "Revised" License

Python 100.00%
blocklist aiohttp dnsbl pihole pfblockerng tencent qq python

tencentqqurlsec's Introduction

TenCent QQ URLSec blocklist

Python AIOHTTP GitHub Actions

GitHub license scraper Total Blocklist URLs

Tencent QQ has an undocumented publicly-accessible real-time feed of malicious URLs.

This repository extracts these URLs, at regular intervals, to a machine-readable .txt blocklist compatible with firewall applications like Pi-hole and pfBlockerNG.

The URLs in this blocklist are compiled by Tencent QQ.

Disclaimer: This project is not sponsored, endorsed, or otherwise affiliated with Tencent.

Blocklist download

File Download
blocklist.txt 💾
blocklist_ABP.txt 💾
blocklist_UBO.txt 💾

Threat categories

Each URL is numerically categorised by threat type with the parameter evilclass. The evilclass number for each URL is provided in the blocklist after the # symbol.

Translations are provided as-follows

# evilclass
{
 '1' : '社工欺诈', # Phishing
 '2' : '信息诈骗', # Scam
 '3' : '虚假广告', # False Advertising
 '4' : '恶意文件', # Malicious Files
 '5' : '博彩网站', # Gambling
 '6' : '色情内容', # Pornographic content
 '7' : '垃圾信息', # Spam
 '8' : '非法内容' # Illegal content (likely to contain politically censored websites)
}

Source: https://github.com/flowerdown/tencent_url_safe_dump/blob/master/tencent_Dangerous_web.py

More information (in chinese) on the parameter evilclass can be found at https://urlsec.qq.com/eviltype.html and https://urlsec.qq.com/wiki/#!md/SafeQueryHttp.md

Requirements

  • Python 3.12+

Setup instructions

git clone and cd into the project directory, then run the following

python3 -m venv venv
venv/bin/python3 -m pip install --upgrade pip
venv/bin/python3 -m pip install -r requirements.txt

Usage

venv/bin/python3 scraper.py

 

These files are provided "AS IS", without warranty of any kind, express or implied, including but not limited to the warranties of merchantability, fitness for a particular purpose and noninfringement. In no event shall the authors or copyright holders be liable for any claim, damages or other liability, arising from, out of or in connection with the files or the use of the files.

Any and all trademarks are the property of their respective owners.

tencentqqurlsec's People

Contributors

actions-user avatar elliotwutingfeng avatar renovate-bot avatar renovate[bot] avatar

Stargazers

 avatar

Forkers

v1toko

tencentqqurlsec's Issues

Dependency Dashboard

This issue lists Renovate updates and detected dependencies. Read the Dependency Dashboard docs to learn more.

This repository currently has no open or pending branches.

Detected dependencies

github-actions
.github/workflows/scraper.yml
  • actions/checkout v4
  • actions/setup-python v5
pip_requirements
requirements.txt
  • aiohttp ==3.9.5
  • bandit ==1.7.8
  • black ==24.4.2
  • more-itertools ==10.2.0
  • mypy ==1.10.0
  • mypy-extensions ==1.0.0
  • pylint ==3.1.1

  • Check this box to trigger a request for Renovate to run again on this repository

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.