Comments (7)
I noticed this as well. Unfortunately Funda changed the layout of their website, it seems that the scraper has to be updated in order to work with this new layout.
Good news is that the bs4 still returns the page content. Let's hope someone has the time to update the scripts accordingly.
from funda-scraper.
Hi @BTuyn @light-bit @PieterK123 @dadadima94
I just updated the new version of funda_scraper. If you can install the latest version (v1.0.0), the scraping should work without problems now. Please let me know if you encounter anything unusual. All the feedback would be appreciated!
from funda-scraper.
Same here. Would indeed be great if we can still get the script working.
from funda-scraper.
You managed to get it working @BTuyn?
from funda-scraper.
Same here!
from funda-scraper.
Sorry for the late response. Seems like the problem is fixed indeed, but after checking the update, I did notice some other bugs.
The raw dataframe seems fine, however, the clean dataframe is missing quite a lot of rows and isn't processing data properly for a few columns such as 'has_balcony' and 'has_garden'. This is a different issue than the previous issue though and I see somebody else already raised a issue ticket for it.
from funda-scraper.
Hi @BTuyn
Yes, you are correct. I removed the columns 'has_balcony' and 'has_garden' from the clean data frame. Funda changes how they describe these exteriors, so the original preprocessing script needs to be revised. I will include the new preprocessing logic in the next release.
from funda-scraper.
Related Issues (20)
- Extract all the links, but get a smaller number of results and not from the selected city HOT 2
- No data scraped (0 houses found in 0 pages) HOT 5
- Adding a different starting page HOT 1
- Multiple neighbourhoods HOT 2
- Pull total number of pages for a query
- neighbourhood name = na HOT 2
- Range of prices HOT 1
- List index out of range HOT 1
- Scrape data of building plot or other specific house types HOT 1
- package error HOT 3
- listed since date N/A HOT 1
- Default example from documentation returns HOT 2
- "Verkocht onder voorbehoud"
- Improvement: allow filtering on property type
- Changing keep_cols in preprocessing HOT 1
- Aiohttp fails for captcha HOT 1
- RuntimeError: An attempt has been made to start a new process before the current process has finished its bootstrapping phase. HOT 2
- Floor area filter HOT 1
- Error '3 weken' on feature/funda_update branch HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from funda-scraper.