feat: expand test corpus from 2 to 7 formats with 1,794 documents#147

Merged

StephanMeijer merged 14 commits into

mainfrom

feature/new-formats

Apr 1, 2026

Commits on Apr 1, 2026

fix(tooling): add .doc, .html, .rtf extensions to check-duplicates.sh
StephanMeijer
committed
docs: add new format examples to README and CONTRIBUTING
StephanMeijer
committed
feat(scrape): add scraper infrastructure with shared utilities
StephanMeijer
committed
feat(rtf): add RTF corpus from test suites and archives
StephanMeijer
committed
feat(doc): add legacy .doc (WW8) corpus from test suites
StephanMeijer
committed
feat(epub): add EPUB corpus from Standard Ebooks
StephanMeijer
committed
feat(html): add HTML corpus from open sources
StephanMeijer
committed
feat(markdown): add Markdown corpus from open-source repositories
StephanMeijer
committed
chore: regenerate ATTRIBUTION.md from updated JSON
StephanMeijer
committed
fix(scrape): enforce 2s rate limit in html scraper; add main guard to epub scraper
StephanMeijer
committed
fix(attribution): correct 4 license mismatches found during audit
StephanMeijer
committed
feat(odt): expand ODT corpus from 52 to 944 files
StephanMeijer
committed
fix(ci): replace unzip with Python zipfile for cross-platform ZIP validation
StephanMeijer
committed
chore: remove scrape scripts from repository
StephanMeijer
committed