Comments (2)
Hi @xavierdurandsmet, you should use Scrapinghub API to launch a spider, there're 2 options:
- doing requests to HTTP API described here (for example with requests)
- relying on this official python client, take a look at the documentation.
Depending on whether your script should be launched locally or from Scrapy Cloud itself, in the latter case you may also need to add additional dependencies (if any) to your requirements.txt
and redeploy.
from python-scrapinghub.
I'm going to close this for now, please reopen the issue it doesn't respond to your questions.
from python-scrapinghub.
Related Issues (20)
- Long intervals during resource iteration can lead to issues
- jobs.run(spider, job_args = {arg1: val1}) can't have val1 as a list. HOT 2
- iter() not handling meta=None gracefully
- `TypeError: __init__() got an unexpected keyword argument 'encoding'` HOT 1
- Use stacklevel=2 on Connection warning about password usage HOT 1
- Encoding of serialization changed in version 2.3.1 HOT 2
- Omitting `_key` hangs `_BatchWriter`
- collections.get_store is not working as documented
- UnicodeDecodeError while fetching items HOT 8
- KeyError: 'status' when trying to schedule spider HOT 6
- Run a specific version of a spider HOT 3
- Jobs.iter() is unable to accept has_tag as a list.
- Some imports from standard lib collections are breaking on python 3.10 HOT 5
- How to get job_arguments? HOT 3
- job.items.iter() item Dict bytes keys HOT 1
- Incorrect information for Samples in Job documentation
- Add retry logic to Job Tag Update function
- Add async support HOT 8
- Unsble to fetch crawled items from ZYTE cloud.
- Add .readthedocs.yml
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from python-scrapinghub.