docs: Add page on Large data uploads

[jessiemongeon1]

Description

Describe the changes or additions included in this PR.

Test plan

How did you test the new or updated feature?

---

Release notes

Check each box that your changes affect. If none of the boxes relate to your changes, release notes aren't required.
For each box you select, include information after the relevant heading that describes the impact of your changes that
a user might notice and any actions they must take to implement updates. (Add release notes after the colon for each item)

• Storage node:
• Aggregator:
• Publisher:
• CLI:

[github-actions]

PR Preview Action v1.8.1
Preview removed because the pull request was closed.
2026-03-31 23:02 UTC

[github-actions]

📋 afdocs check results

URL: https://MystenLabs.github.io/walrus/pr-preview/pr-3204/

Running checks on mystenlabs.github.io...

Agent-Friendly Docs Check: https://MystenLabs.github.io/walrus/pr-preview/pr-3204/
Timestamp: 2026-03-31T22:16:41.289Z

llms-txt
  ✓ llms-txt-exists: llms.txt found at 1 location(s)
  ✓ llms-txt-valid: llms.txt follows the proposed structure (H1, blockquote, heading-delimited link sections)
  ✓ llms-txt-size: llms.txt is 25,724 characters (under 50,000 threshold)
  ⚠ llms-txt-links-resolve: 74/76 links resolve (97%); 2 broken
      Learn more: https://agentdocsspec.com/spec/#llms-txt-links-resolve
  ✓ llms-txt-links-markdown: 76/76 links point to markdown content (100%)

markdown-availability
  ✓ markdown-url-support: 74/76 pages support .md URLs (97%)
  ✓ content-negotiation: 73/76 pages support content negotiation (96%)

page-size
  ✓ rendering-strategy: All 76 pages contain server-rendered content
  ✓ page-size-markdown: All 74 pages under 50K chars (median 5K, max 38K)
  ✓ page-size-html: All 76 pages convert under 50K chars (median 5K, 2% boilerplate)
  ✗ content-start-position: 2 of 76 pages have content starting past 50% (worst 72%)
      Learn more: https://agentdocsspec.com/spec/#content-start-position

content-structure
  ✓ tabbed-content-serialization: 30 tab group(s) across 17 of 76 pages; all serialize under 50K chars
  ✓ section-header-quality: 0 page(s) with tab headers checked; headers include variant context
  ✓ markdown-code-fence-validity: All 385 code fences properly closed across 75 pages

url-stability
  ✓ http-status-codes: All 76 pages return proper error codes for bad URLs
  ✗ redirect-behavior: 3 JavaScript redirect(s) detected across 76 pages
      Learn more: https://agentdocsspec.com/spec/#redirect-behavior

agent-discoverability
  ✓ llms-txt-directive: llms.txt directive found in all 73 pages, near the top of content; 3 failed to fetch

observability
  ○ llms-txt-freshness: Sitemap has 153 URLs but none are under the docs path prefix (/walrus/pr-preview/pr-3204)
  ✗ markdown-content-parity: 10 of 74 pages have substantive content differences between markdown and HTML (avg 10% missing)
      Learn more: https://agentdocsspec.com/spec/#markdown-content-parity
  ✗ cache-header-hygiene: 2 of 77 endpoints have aggressive caching or missing cache headers
      Learn more: https://agentdocsspec.com/spec/#cache-header-hygiene

authentication
  ✓ auth-gate-detection: All 76 pages are publicly accessible
  ○ auth-alternative-access: All docs pages are publicly accessible; no alternative access paths needed

Summary
  15 passed, 1 warnings, 4 failed, 2 skipped (22 total)

Full spec: https://agentdocsspec.com/spec/