Comments (6)
Was also trying out this library and had a quick look. I still get results if I use the find_past
flag, but otherwise not. To me it seems the issue is that Funda changed their CSS, because on new pages I cannot find the CSS selectors specified in config.yaml. I also noticed that on new Funda entries the ?old_ldp query parameter no longer works on new pages (I'm not sure what it means though, is it documented anywhere?). Older entries that are by now sold redirect to koop/verkocht/
pages that still have the old CSS selectors, which would explain the inconsistent results.
from funda-scraper.
I see a workaround/temporary fix was recently implemented in #41 by @mpgreg that added the ?old_ldp
query param, but it seems luck has already run out.
from funda-scraper.
And the link https://www.funda.nl/huur/amsterdam/appartement-43547656-jan-van-zutphenstraat-75/?old_ldp=true
redirects to https://www.funda.nl/detail/huur/amsterdam/appartement-jan-van-zutphenstraat-75/43547656/
which doesn't have the old CSS selectors.
from funda-scraper.
When will this be solved? Im missing a lot of data now.
from funda-scraper.
I made a patch here, feel free to pull:
#50
from funda-scraper.
Many thanks for creating this patch! For me the patch doesn't seem to work. Not sure whether I correctly applied it: I pulled the code from the repo and only changed the config.yaml file. There is a difference in that the scraper now does recognise the selling price, but the other fields are not captured. Any ideas what could cause that? Perhaps the funda CSS has changed again?
from funda-scraper.
Related Issues (20)
- List index out of range HOT 1
- Scrape data of building plot or other specific house types HOT 1
- package error HOT 3
- listed since date N/A HOT 1
- Default example from documentation returns HOT 2
- "Verkocht onder voorbehoud"
- Improvement: allow filtering on property type
- Changing keep_cols in preprocessing HOT 1
- Aiohttp fails for captcha HOT 1
- RuntimeError: An attempt has been made to start a new process before the current process has finished its bootstrapping phase. HOT 2
- Floor area filter HOT 1
- URL construction faulty for sold houses HOT 1
- CSS scraping no longer works with beta website HOT 2
- Scraping does not work HOT 1
- ModuleNotFoundError: No module named 'urllib3.packages.six.moves' HOT 1
- scraper return only NA result HOT 3
- Fetched dataframe without any records HOT 6
- pandas import error
- Data scraping is not working for sold listings
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from funda-scraper.