What Pay-Per-Crawl Means for the Future of Web Data Access

For most of the internet’s history, crawling was treated as part of how the web worked.