netbreeze-gmbh / boilerpipe Goto Github PK

I am using the following code to extract the main HTML code from a site:

final BoilerpipeExtractor extractor = CommonExtractors.ARTICLE_EXTRACTOR;
final HtmlArticleExtractor htmlExtr = HtmlArticleExtractor.INSTANCE;
html = htmlExtr.process(extractor, url);
System.out.println("Unprocessed HTML: " + html);

When I run it for example on http://www.bbc.co.uk/sport/0/formula1/22231116 . I get the following result:

`Bahrain GP: Mercedes' Nico Rosberg on pole position By Andrew BensonChief F1 writer in Bahrain  Mercedes driver Nico Rosberg took pole position for the Bahrain Grand Prix from Red Bull's Sebastian Vettel and Ferrari's Fernando Alonso.

As you can see no opening HTML tags. Is this supposed to happen? And is there a work around? Thanks

I am working on a command line utility to help with execution of boilerpipe in a pipeline as well as creating a web api (likely a separate project). I was going to upload my own fork of 2.2.0 from the subversion repo however, if this project is alive and well, I'd rather work off/with others than just drop another fork.

Is this fork/project still maintained?

I am trying to include version 1.2.2 in my project, but it seems that maven is not able to find it!
I am able to find version 1.1.0, which doesn't have MediaExtractor.
do I need to add another repository than maven?