Code Monkey home page Code Monkey logo

duckduckgo's Introduction

DuckDuckGo URL scraper v0.0.1-beta

duckduckgo.py is a simple python module to scrape the duckduckgo search results. The ddg script can be used as a command line utility in a shell pipeline.


Warning!

This code is intended as a demonstration and, as all scraping utilities, should be used with great caution. By default the code will pause a few milliseconds each time it yields a result to avoid overloading the DDG servers.

Visitors CodeQL Semgrep Pylint Codacy Security Scan


Usage

git clone https://github.com/its0x08/duckduckgo
cd duckduckgo
python ddg.py -h
usage: ddg.py [-h] [-n MAX_RESULTS] [-t] [-o FILE_OUTPUT] keyword

DuckDuckGo URL scraper by 0x08

positional arguments:
  keyword         search string

options:
  -h, --help      show this help message and exit
  -n MAX_RESULTS  number of results (default: all)
  -t              execution time (default: False)
  -o FILE_OUTPUT  save output to file

Simple search

python ddg.py search something

Showing execution time by using -t flag and result number by using -n [Num].

python ddg.py -n 10 -t search something

Save output to file by using -o flag.

python ddg.py -n 10 -o output_file.log search something

TODO

  • Add installer script
  • Add -o to save output to file

Contributors

If you decide to make a pull request to suggest your changes to the project, please don't forget to add your name to the CONTRIBUTING.md file.

Pull Requests & Issues

You have a new feature in mind?

The code is buggy, wont run as expected and you happen to know python?

Please make a Pull Request (PR) suggesting you changes.

Otherwise you can always open an Issue to help improve this project.

duckduckgo's People

Contributors

its0x08 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

duckduckgo's Issues

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.