Skip to content

DEF CON 34 talks are here: 354 talks, summarized and searchable.

Browse DEF CON 34

Why Building Digital Libraries Matters

Davide Semenzin

PolicyTalks53 minBeginnerOpen on YouTube ↗

Where

Talks
A New HOPE

Duration

53 min

Explains why digital libraries matter and how a large-scale book digitization pipeline works behind the scenes.

Summary

The talk opens by asking what a library is, settling on an accessible, organized collection of materials with real value, and then asks who builds them, from national libraries to private firms. The speaker draws on about five years spent building the platform that digitizes books at the Internet Archive.

The pipeline runs from camera-based scanning stations spread across several sites, through upload and automated preprocessing, to a human review stage where operators check and correct the results before derived formats such as PDF, EPUB and text are generated. The hardest problems were mostly operational: catching errors quickly, keeping the service usable for scanning staff during outages, handling network failures with retries and caching, and dealing with physical logistics and unreliable consumer hardware and drivers. Human operators stay in the loop because books vary enormously in format and condition, so automation mainly reduced cost rather than improving quality.

The second half argues that digital copies matter because availability drives preservation, and that features such as full-text search, deep links into citations and embedded media add value beyond print. Free access is presented as essential to equality and trust, with digital originals serving as a lender of last resort. The talk closes by encouraging listeners to use, support and contribute to digital libraries.

Related talks