Comments (4)
well, I'm using 3.6 and if you look at the errors it says the first error happens here:
File "/usr/lib/python3.6/site-packages/arachnado/options.py", line 4
once I fixed that it gave me this error upon retry:
File "/usr/lib/python3.6/site-packages/arachnado/utils.py", line 3 import urlparse ModuleNotFoundError: No module named 'urlparse'
which was renamed to urllib.parse
so, once I made that change it worked for me.. Hope that helps ya!
from arachnado.
The PyPI version doesn't include the Py3 modernisations, but in the mean time the YOLO fix for this issue is:
pip3 install --upgrade https://github.com/TeamHG-Memex/arachnado/archive/master.zip
from arachnado.
Scratch that; static assets aren't compiled if you simply pip
straight from the repo. You'll probably need to pull the git repo and build it locally, then install. Sorry!
from arachnado.
@cathalgarvey I am trying to make a few changes to the UI template and also trying to understand the API process, could you please post some details to build the repo from source (without pip/pip3) and a few details on 'js/stores/JobStore.js'.
thanks
from arachnado.
Related Issues (18)
- arachnado doesn't work for www.onet.pl HOT 1
- Ability to add seed urls HOT 2
- Storage of scraped files HOT 2
- Need to add an option to upload the scrapy project and run the spider by arachnado
- How to run custom spider? HOT 1
- "Known sites" feature is broken HOT 4
- Paused crawls are resumed after arachnado restart
- I really like this project
- Download sub pages of certain urls
- Can't run arachnado HOT 2
- Build from source HOT 1
- Signals
- bot_detector
- ModuleNotFoundError: No module named 'scrapy.xlib'
- Performance issues
- Add an option to continue crawls after restart
- log_count/DEBUG keeps increasing after job is finished
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from arachnado.