big data hackathon link.
- Python3
- mongoDB (install on Ubuntu 14.04, GUI)
Dump and restore
mongodump --db DataBaseName
mongorestore --db DataBaseName /path/to/DataBaseName
Note that /path/to/DataBaseName should be a directory filled with .json and .bson representations of your data
- pip install -r requirement.txt
##Coding Style Google Python Style Guide link.
##Usage
$ git clone https://github.com/behappycc/bdhackathon.git
$ cd bdhackathon/web
$ python3 Server.py -p 8888
$ cd bdhackathon/src
$ python3 ptt_crawler.py -b Japan_Travel -l
$ python3 topic_analyze.py -b Japan_Travel
$ python3 topic_label.py -b Japan_Travel
After training LDA model(topic_analyze.py), user need to use topic_weight.txt to set up topic.txt.