Name: Helge Holzmann
Type: User
Company: Internet Archive
Bio: Software developer, researcher and consultant with a PhD in Computer Science, Web Data Engineer at Internet Archive, working on better access to web archives.
Location: Hannover, Germany
Blog: http://www.HelgeHolzmann.de
Helge Holzmann's Projects
An Apache Pig framework that facilitates access to Web Archives, enables easy data extraction as well as derivation.
An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.
The compatibility layer between ArchiveSpark and The Archives Unleashed Toolkit (AUT)
ArchiveSpark on Docker
A server application that provides a Web service API for ArchiveSpark to be used by third-party applications to integrate temporal Web archive data with a flexible, easy-to-use interface.
ArchiveSpark with Zeppelin as ready-to-use Docker image
Convert web archives to RDF triples with ArchiveSpark
The Archives Unleashed Toolkit is an open-source platform for analyzing web archives.
An Awesome List for getting started with web archiving
English Part-of-Speech Tagger Library; a Ruby port of Lingua::EN::Tagger
Don't write specs anymore, just save 'em while testing your code interactively. Specs will become a byproduct.
Yahoo's Fast Entity Linker for ArchiveSpark
A Splitable Hadoop InputFormat for Concatenated GZIP Files and *.(w)arc.gz
A Hadoop input format to use gaphs in WebGraph's BV format with Hadoop and Spark.
My personal website
Analyze digitized books from the Internet Archive remotely with ArchiveSpark
Scripts to transfer archive.org collections, using https://github.com/jjjake/internetarchive
A lecture on MapReduce with example code
Work with Medical Heritage Library collections using ArchiveSpark
Create and cite micro Web archives with semantics as temporal representations of objects / entities / concepts on the Web
PHP Proxy for Cross Domain Requests
A simple way to run jobs, wether simple scripts or experiments for your research. You can log results and progress without a hassle and experiment with different configurations.
Mirror of Apache Spark
ArchiveSpark DataSpec to analyze the Internet Archive's Web archive through temporal search results returned by Tempas (v2)
Partition (W)ARC Files by MIME Type and Year
An easy-to-use and highly customizable crawler that enables you to create your own little Web archives (WARC/CDX)
JNI binding for Zstd