- Make sure you have Chrome browser installed.
- Download Chromedriver and put it in current folder.
- Install Selenium:
pip3 install -r requirements.txt
.
For linux,
wget https://chromedriver.storage.googleapis.com/2.37/chromedriver_linux64.zip
unzip chromedriver_linux64.zip
apt-get install chromium-browser
- Make sure you have Google Maps Platform API Key in the directory.
- Make sure variable
PATH
is properly assigned inplace_crawler.py
. - Enable or disable
headless
in chrome option. - Run by
python3 place_crawler.py {number of posts} {number of threads} {hashtag}
ex:python3 place_crawler.py 1000 10
- JSON formatted document(including
location
,link
,timestamp
,captions
,hashtags
respectively) will be created.
- Make sure to use same
hashtag
that used in the Crawler. place_{hashtag}_posts.json
should be in the directory.- Run by
python3 place_sorter.py {number of threads} {hashtag}
- Groupped places will be created in json file.
This crawler might not run properly depending on instagram's update. Argparser will be added soon. ๐
Currently sorter doesn't work properly outside of Korea. NLP or ML could be applied for solving address problem. ๐ค