Code Monkey home page Code Monkey logo

jssandbox's Introduction

Simple javascript sandbox for web crawler

Motivation

Many websites use complex JavaScript protection techniques, which hinders us from developing crawlers.

We developed JsSandBox based on the idea of mimicking the browser environment, allowing you to obtain the target's complete encrypted parameters without the need for in-depth knowledge of the target site's Javascript

Feature

  • You can use tools/dump_browser_env.js to copy the browser environment with one click
  • You can use tools/vm_proxy.js Hook any object
  • JsSandBox has done the appropriate protection measures to bypass the common environmental monitoring logic of the site

Basic Usage

The first step is to copy the target site's environment.

1.copy dump_browser_env.js code to Chrome sources snippet and run snippet.

copy code to snippet

2.use dump function get object environment info.

use dump

3.copy environment info to env folder.

copy location code

4.modify env/env.js.

add location code

5.run main.js

Use Proxy

Add the object you want to proxy in env/proxy_obj.js

use proxy

Thanks

  • 寄予蓝y

jssandbox's People

Contributors

hackpython avatar

Stargazers

Jeff Lim avatar Roman avatar  avatar Ram.zhang avatar  avatar HelloCsl avatar Penny avatar Roland avatar ayuliao avatar MilesLam avatar  avatar  avatar CrazyRocks avatar laughing avatar KeepOnCode avatar Hong avatar

Watchers

ayuliao avatar  avatar

Forkers

owq-1777

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.