Package: boilerpipeR 1.3.2

boilerpipeR: Interface to the Boilerpipe Java Library

Generic Extraction of main text content from HTML files; removal of ads, sidebars and headers using the boilerpipe <https://github.com/kohlschutter/boilerpipe> Java library. The extraction heuristics from boilerpipe show a robust performance for a wide range of web site templates.

Authors:See AUTHORS file.

boilerpipeR_1.3.2.tar.gz
boilerpipeR_1.3.2.zip(r-4.7)boilerpipeR_1.3.2.zip(r-4.6)boilerpipeR_1.3.2.zip(r-4.5)
boilerpipeR_1.3.2.tgz(r-4.6-any)boilerpipeR_1.3.2.tgz(r-4.5-any)
boilerpipeR_1.3.2.tar.gz(r-4.7-any)boilerpipeR_1.3.2.tar.gz(r-4.6-any)
boilerpipeR_1.3.2.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
DESCRIPTION |NEWS
card.svg |card.png
boilerpipeR/json (API)

# Install 'boilerpipeR' in R:

install.packages('boilerpipeR', repos = c('https://mannau.r-universe.dev', 'https://cloud.r-project.org'))

Bug tracker:https://github.com/mannau/boilerpiper/issues

Uses libs:

openjdk– OpenJDK Java runtime, using Hotspot JIT

Datasets:

content - Wordpress generated Webpage (retrieved from Quantivity Blog <https://quantivity.wordpress.com>). Content is saved as character and ready to be extracted.

On CRAN:

openjdk

5.54 score 21 stars 33 scripts 279 downloads 8 exports 1 dependencies

Last updated from:5cbc092cac. Checks:7 NOTE, 2 OK. Indexed: yes.

Target	Result	Time
linux-devel-x86_64	NOTE	127
source / vignettes	OK	176
linux-release-x86_64	NOTE	101
macos-release-arm64	NOTE	132
macos-oldrel-arm64	NOTE	215
windows-devel	NOTE	68
windows-release	NOTE	97
windows-oldrel	NOTE	70
wasm-release	OK	109

Exports:ArticleExtractor ArticleSentencesExtractor CanolaExtractor DefaultExtractor Extractor KeepEverythingExtractor LargestContentExtractor NumWordsRulesExtractor

Dependencies:rJava

Introduction to the tm.plugin.webmining Package

Getting Started | Implemented Extractors | Conclusion

Rendered fromShortIntro.Rnwusingutils::Sweave

Last update: 2021-05-19
Started: 2013-12-31

Citation

Development and contributors

Readme and manuals

Help Manual

Help page	Topics
Extract the main content from HTML files	boilerpipeR-package boilerpipe
A full-text extractor which is tuned towards news articles.	ArticleExtractor
A full-text extractor which is tuned towards extracting sentences from news articles.	ArticleSentencesExtractor
A full-text extractor trained on a 'krdwrd' Canola (see 'https://krdwrd.org/trac/attachment/wiki/Corpora/Canola/CANOLA.pdf'.	CanolaExtractor
Wordpress generated Webpage (retrieved from Quantivity Blog <https://quantivity.wordpress.com>). Content is saved as character and ready to be extracted.	content
A quite generic full-text extractor.	DefaultExtractor
Generic extraction function which calls boilerpipe extractors	Extractor
Marks everything as content.	KeepEverythingExtractor
A full-text extractor which extracts the largest text component of a page.	LargestContentExtractor
A quite generic full-text extractor solely based upon the number of words per block (the current, the previous and the next block).	NumWordsRulesExtractor