Code Monkey home page Code Monkey logo

dawanda-exporter's Introduction

DaWanda exporter

Export-Programm für ein Dawanda-Nutzerprofil. Es benötigt Python in Version 3.6 (oder höher).

Beim ersten Aufruf werden ggf. benötigte Abhängigkeiten installiert (siehe requirements.txt). Es werden die Zugangsdaten für DaWanda abgefragt und der Datendownload beginnt, dabei wird ein Fortschritt angezeigt.

$ python3 dawanda-exporter.py
DaWanda username: youngage
DaWanda password (not shown): 
[*] output: dawanda_2018-08-11_11-44-30.zip
[*] fetching profile ... youngage
[*] fetching ratings
    got 107
[*] fetching products
    got 711
[*] Logging out.
[+] done [711 products] [107 ratings]

Das Ergebnis ist eine ZIP-Datei mit mehreren maschinenlesbaren JSON-Dateien (Profil, Produkte sowie Bewertungen) und allen Produktbildern in einem Unterordner:

Archive:  dawanda_2018-08-11_11-44-30.zip
Zip file size: 7169920283 bytes, number of entries: 1630
?rw-------  2.0 unx     1198 b- defN 18-Aug-11 11:44 profile.json
?rw-------  2.0 unx   134380 b- defN 18-Aug-11 11:44 productlist.json
?rw-------  2.0 unx  5772448 b- defN 18-Aug-11 12:01 products.json
?rw-------  2.0 unx  5342758 b- stor 80-Jan-01 00:00 product_images/123456789.jpeg
...
?rw-------  2.0 unx   192375 b- stor 80-Jan-01 00:00 product_images/234567890.jpeg
-rw-------  3.0 unx    21031 tx defN 18-Aug-11 12:54 ratings.json
1630 files, 7175253081 bytes uncompressed, 7169687659 bytes compressed:  0.1%

Benutzung

Im Regelfall sind keine weiteren Parameter oder Einstellungen notwendig, die benötigten Zugangsdaten werden interaktiv erfragt.

Für erweitere Funktionalitäten gibt es zusätzliche Parameter, die jedoch hauptsächlich für Entwicklungs- und Problemlösungszwecke gedacht sind:

usage: dawanda-exporter.py [-h] [--exit-timeout EXIT_TIMEOUT]
                           [--session SESSION] [--output OUTPUT] [--debug]
                           [--skip-products] [--skip-images] [--skip-ratings]

Dawanda Data Extractor

optional arguments:
  -h, --help            show this help message and exit
  --exit-timeout EXIT_TIMEOUT
                        wait given number of seconds before exiting (default:
                        5s)
  --session SESSION     Dawanda-Session ID to use, don't ask for credentials
                        or log in at all
  --output OUTPUT, -o OUTPUT
                        ZIP file returning all data, defaults to
                        "dawanda_YYYY-MM-DD_HH-MM_SS.zip"
  --debug               show HTTP requests and replies
  --skip-products       do not fetch the products (nor their images)
  --skip-images         do not fetch product images
  --skip-ratings        do not fetch ratings

dawanda-exporter's People

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.