Comments (5)
@valentinedwv Thanks ! Finally I did
!pip uninstall -y scrapy !pip install Scrapy==2.6.3
and everything works fine !
from advertools.
Thanks a lot for reporting @valentinedwv !
I can also see the same behavior on a Mac, also on Google Colab (Linux).
Not sure if there is something I can do here?
I'll check.
Thanks again.
from advertools.
Hi, it seems that I have the same problem. I am trying to run a scraper on AWS sagemaker studio.
python version : Python 3.10.6
advertools==0.13.4
aiohttp==3.8.5
aiosignal==1.3.1
2023-08-16 16:21:18 [twisted] CRITICAL: Traceback (most recent call last): File "/opt/conda/lib/python3.10/site-packages/twisted/internet/defer.py", line 1697, in _inlineCallbacks result = context.run(gen.send, result) File "/opt/conda/lib/python3.10/site-packages/scrapy/crawler.py", line 101, in crawl self.engine = self._create_engine() File "/opt/conda/lib/python3.10/site-packages/scrapy/crawler.py", line 115, in _create_engine return ExecutionEngine(self, lambda _: self.stop()) File "/opt/conda/lib/python3.10/site-packages/scrapy/core/engine.py", line 83, in __init__ self.downloader = downloader_cls(crawler) File "/opt/conda/lib/python3.10/site-packages/scrapy/core/downloader/__init__.py", line 83, in __init__ self.middleware = DownloaderMiddlewareManager.from_crawler(crawler) File "/opt/conda/lib/python3.10/site-packages/scrapy/middleware.py", line 59, in from_crawler return cls.from_settings(crawler.settings, crawler) File "/opt/conda/lib/python3.10/site-packages/scrapy/middleware.py", line 40, in from_settings mwcls = load_object(clspath) File "/opt/conda/lib/python3.10/site-packages/scrapy/utils/misc.py", line 61, in load_object mod = import_module(module) File "/opt/conda/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/opt/conda/lib/python3.10/site-packages/scrapy/downloadermiddlewares/retry.py", line 27, in <module> from scrapy.core.downloader.handlers.http11 import TunnelError File "/opt/conda/lib/python3.10/site-packages/scrapy/core/downloader/handlers/http11.py", line 23, in <module> from scrapy.core.downloader.contextfactory import load_context_factory_from_settings File "/opt/conda/lib/python3.10/site-packages/scrapy/core/downloader/contextfactory.py", line 11, in <module> from scrapy.core.downloader.tls import DEFAULT_CIPHERS, openssl_methods, ScrapyClientTLSOptions File "/opt/conda/lib/python3.10/site-packages/scrapy/core/downloader/tls.py", line 23, in <module> METHOD_SSLv3: SSL.SSLv3_METHOD, # SSL 3 (NOT recommended) AttributeError: module 'OpenSSL.SSL' has no attribute 'SSLv3_METHOD'
Thanks a lot for your help !
from advertools.
Try running on python 3.09
from advertools.
Thanks for sharing the solution @caroheymes !
from advertools.
Related Issues (20)
- Getting NaN values for serp_goog function HOT 3
- File not found on crawl method HOT 4
- opening .jl file command doesn't show 'my_output_file.jl' HOT 7
- crawl dataFrame - jsonld objects HOT 2
- Suggestion - don't treat jsonld items in distinct script tags as distinct. HOT 8
- How to get initial url in output.jl ? HOT 2
- Bypass protection HOT 3
- Need some way to rate limit requests for sitemap_to_df HOT 3
- Scraps forever HOT 3
- Feature Request - Alternative Crawl Output HOT 5
- Advertools in Ubuntu in a Venv (Python 3.10.12 and Python 3.9.18) HOT 7
- browser can get https://zapier.com but when run scrape failed HOT 2
- logs_to_df() Limitation HOT 5
- Bypass a cookie wall HOT 4
- Pandas Futurewarning "fillna" in url_to_df() HOT 1
- request_url_df creates wide list? HOT 3
- How to get started with development? HOT 7
- Instagram Mentions Allows Periods HOT 1
- about this result in serp HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from advertools.