Comments (12)
Hi, seems like the class tag used to identify the image link has changed, which resulted in this issue. I'm working on a fix now, will update everyone soon.
from google-image-scraper.
Patch has been released. It has been tested only on Windows OS, and may not work on others.
from google-image-scraper.
Reference to Unable to get link #33
Try these packages and version
selenium==3.141.0
requests==2.25.1
pillow==9.0.1
Every second image we tried to download showed unable to get link, after updating the packages it went a bit smoother and faster. Only every 50 images or so now go into an unable to get link loop :)
from google-image-scraper.
You're a life saver @ohyicong ! Thank you for your quick response time and amazing xpath skills. Let me know if there is anywhere I can go to buy you a coffee or whatever :)!
from google-image-scraper.
@ohyicong our downloads are amazing now! No unable to get links, and the accuracy is amazing!!! Thank you so much, you genius!
from google-image-scraper.
Hi @AmirSh15, this issue was highlighted by other users before, I wanted to fix it but I can't replicate the "pop-up" behavior on my computer. If you have a solution, I don't mind merging it into my repository. I will close this thread, as this is a separate issue. Thanks!
from google-image-scraper.
Same here on Mac OS, python 3.10.9, got this output for each image iteration:
[INFO] Unable to get link
from google-image-scraper.
Even with the packages recommended, I'm getting the [INFO] Unable to get link
loop since yesterday. And I noticed starting yesterday, only around 50 images would only download, regardless of the query.
from google-image-scraper.
Even with the packages recommended, I'm getting the
[INFO] Unable to get link
loop since yesterday. And I noticed starting yesterday, only around 50 images would only download, regardless of the query.
After doing a little experimentation, Google Images has changed how their elements are structured on results. After 50 or so images, they've inserted a "Related Searches" element, and after this, they now include an element that encompasses the next 50 images. After that, the "Related Searches" element reappears, and then another parent element holding the next 50 images appears, and so on. On top of this, they have changed the class name of the image element as well, hence why it doesn't download any longer.
from google-image-scraper.
Okay so, what is the next step? Do we disable the automatic update of the chrome driver to use the latest, most stable chrome driver/version that doesn't use the "related image results" function? Or do we enable images to download from encrypted websites? Like Https? Cuz after also playing with the code and using 360 image search keys we also have 50% accurate downloads. Especially with the search keys being more than 1 word for example "Phillips coffee machine and grinder".
Please let me know because this has been driving me mad for months.
from google-image-scraper.
Thanks for your unwavering support, but I'm now facing another problem. Once I call the browser and approach Google, the 'Before you continue' pop-up window appears and won't let the remaining code run. Let me know if you know of any solution for it.
from google-image-scraper.
Hi @ohyicong, I found the solution for the cookie pop-up window once google.com is called. It seems that in the new chrome version this window appears! You only need to add the below script after this line of code.
WebDriverWait(driver, 10).until(EC.element_to_be_clickable((By.ID, "W0wltc"))).click()
from google-image-scraper.
Related Issues (20)
- stuck on consent page HOT 7
- can we save images with Default image name insted of Numbers? HOT 2
- Unable to get link HOT 13
- chrome closing HOT 1
- Does not work on Linux HOT 1
- Unable to get link HOT 5
- 2 things HOT 5
- Program loops indefinitely while trying to install chrome driver HOT 4
- Use it with local files HOT 1
- [macOS] chromedriver can't launch - "unable to download lastest chromedriver. the system will use the local version instead" HOT 4
- Looks like image URL extraction stopped working, coz of Google update. Anyone has an update? HOT 2
- Download from a specific link HOT 1
- Please accept depentabot PR to bump pillow version to 9.3
- class names changed? HOT 12
- Starting the scraper from a given point.
- Filter by licence
- Not working in the Linux HOT 2
- Issue when running the code HOT 2
- Webdriver folder missing in master
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from google-image-scraper.