Comments (1)
"It runs for the first time as it is not cached and prints all the results, The second time nothing is printed"
That is expected behavior. On the second run the data is cached but not displayed. This is because of the use case of newspaper as typically you don't want duplicate articles, with memoization on, you can extract from CNN freely without worrying about if you extracted the same article twice in a row.
If you don't like this behavior you have two options:
1.) Turn memoization off, nothing is cached but you get all the data every time.
2.) Go a step lower, instead of using newspaper.build
, import Article
objects directly
and choose which articles you want to cache & keep or etc.
Reference:
http://newspaper.readthedocs.org/en/latest/user_guide/quickstart.html#article-caching
from newspaper.
Related Issues (20)
- δΈε½εε²
- There seem to be complaints related to the user agent scraping permission issue HOT 3
- Downloaded article from Google RSS News only return Google Images
- can't start new thread HOT 2
- the API doesn't work HOT 10
- Is there any optimization in the configuration of newspaper?
- download() halts/stuck forever with a specific URL
- download() halts/stuck forever with a specific URL
- suggestions for calculate_best_node
- Date extraction is faulty HOT 2
- not working for gnews.org
- TIPS FOR FAST IMPROVEMENT
- Project status HOT 4
- Parsing Problem HOT 6
- Consider switching from lxml's clean_html for enhanced security (and possibly performance) HOT 2
- Getting Older News Articles HOT 4
- gnews with user agent returns empty text HOT 1
- Can I get the CSS Selectors ? HOT 2
- TIPS FOR IMPROVEMENT HOT 5
- Questions about Copilot + Open Source Software Hierarchy
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
π Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. πππ
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google β€οΈ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from newspaper.