Skip to content

Validate lecturer quality metrics accuracy #39

@dcasota

Description

@dcasota

Task Description

Human validation that lecturer-reported quality metrics match reality.

Validation Areas

  1. Grammar Issues: Spot-check 10-20 reported grammar issues

    • Are they real issues?
    • False positive rate?
  2. Markdown Issues: Verify markdown violations

    • Heading hierarchy correct?
    • Code block detection accurate?
  3. Link Issues: Verify orphan link detection

    • Are 404s real?
    • Any false positives?
  4. Quality Score: Validate overall quality score calculation

    • Does 85% → 95% improvement seem reasonable?
    • Are weightings appropriate?

Decision Points

  • Are metrics trustworthy for quality gates?
  • Should we adjust thresholds?
  • Ready for auditor integration?

Acceptance Criteria

  • ✅ Spot-checked sample issues
  • ✅ False positive rate <5%
  • ✅ Quality score methodology validated
  • ✅ Decision made on proceeding

Related

Labels

lecturer-integration, validation, decision-needed, high

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions