Skip to content

Add external validity transfer assistant#361

Open
taherdhanera wants to merge 2 commits into
SCIBASE-AI:mainfrom
taherdhanera:taherdhanera/scibase-16-external-validity-transfer-assistant
Open

Add external validity transfer assistant#361
taherdhanera wants to merge 2 commits into
SCIBASE-AI:mainfrom
taherdhanera:taherdhanera/scibase-16-external-validity-transfer-assistant

Conversation

@taherdhanera
Copy link
Copy Markdown

@taherdhanera taherdhanera commented May 22, 2026

/claim #16

Summary

  • Adds a dependency-free external-validity transfer assistant for the AI-Powered Research Assistant Suite.
  • Compares manuscript claims against linked evidence for population, setting, assay/instrument, runtime environment, subgroup coverage, and external validation support.
  • Emits peer-review suggestions, reproducibility actions, research-gap prompts, and deterministic JSON/Markdown/SVG review artifacts from synthetic data.
  • Includes a reproducible short demo video artifact for reviewer verification.

Non-overlap

This is not another broad assistant suite, preregistration checker, retraction sentinel, prompt-safety guard, statistical review, benchmark-leakage auditor, figure/table checker, supplement-readiness module, funding/COI checker, or evidence-trace assistant. It focuses specifically on whether manuscript claims transfer beyond the exact population, setting, assay, and runtime contexts represented by linked evidence.

Demo Artifact

  • external-validity-transfer-assistant/reports/demo.webm
  • Reproducible with npm run demo:video

Validation

  • npm run check -> passed
  • npm test -> external-validity-transfer-assistant tests passed
  • npm run demo -> generated reports/summary.json, reports/reviewer-packet.md, and reports/summary.svg
  • npm run demo:video -> generated reports/demo.webm
  • git diff --check -> passed
  • git diff --cached --check -> passed

Synthetic data only. No credentials, private manuscripts, protected health information, payment data, external APIs, or network calls are used by the module.

AI-assisted with OpenAI Codex; I reviewed and locally verified the diff before submitting.

@taherdhanera
Copy link
Copy Markdown
Author

Added the short demo video artifact required by the issue guidelines in commit

@taherdhanera
Copy link
Copy Markdown
Author

Correction to the previous truncated note: commit 032f328 adds the short demo video artifact required by the issue guidelines.

New artifact: external-validity-transfer-assistant/reports/demo.webm

Video generation is reproducible with: npm run demo:video

Validation refreshed after the video follow-up:

  • npm run check: passed
  • npm test: passed
  • npm run demo: generated JSON/Markdown/SVG artifacts
  • npm run demo:video: generated reports/demo.webm
  • git diff --cached --check: passed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant