Design-Based Research Capstone

Assessment Observatory

Reworking the OCS and GitHub analytics pages so they show real progress and improvement, plus new self-assessment categories that give a fuller picture of each student for grading.

Team · Katherine, Jacob, Bridget

Identity Forge
Persona Hall
Wayfinding World
Hub
Mission Tools
Sprint + Code Hub
Assessment Observatory
Analytics
Self-Assessment & Growth
🎯

Student Self-Assessment

Structured reflection each sprint.

  • Quick slider ratings paired with a short written reflection (4:1 quantitative-to-qualitative)
  • Four categories: Organization, Technical Sense, Communication, Collaboration
  • Sets a baseline to measure growth against later
Forms Slider UI Database
👥

Peer & Teacher Assessment

Self-perception vs. outside view.

  • Self scores shown side-by-side with teacher and peer scores per skill
  • Flags the skill areas where perceptions differ the most
  • Turns the perception gap into targeted mentoring conversations
Comparative Analysis Feedback UI Charts
📈

Growth Tracking Over Time

Skill development across trimesters.

  • Trendlines showing how each skill rating shifts sprint to sprint
  • Cross-references self-reported growth with peer and teacher feedback
  • Makes progress visible that a single snapshot would miss
Time-Series Trendlines D3.js
Analytics & Data Visualization
📊

GitHub Contribution Tracking

Who did what, and when.

  • Commit and activity heatmap across the project timeline
  • Isolates each student's contribution within a group repo
  • Helps teachers see how work is distributed across a team
GitHub API Heatmap React
📉

Content-Specific Analytics

Metrics that match the work.

  • College Board progress broken down unit by unit
  • Separate progress views for projects and sprints
  • Replaces generic page-view stats with context that matters
OCS Integration Progress Metrics Dashboard
🔥

Progress Visualization

Progress readable at a glance.

  • Relative bar charts for unit and project completion
  • Pie charts for work distribution and contribution share
  • Side-by-side comparisons across students and teams
D3.js SVG Charts
How the Data Travels

Every metric on this page follows the same path — from raw activity in five source systems to a chart a student or teacher can act on.

1

Sources

GitHub commits & pull requests · OCS site activity · College Board unit progress · Self-assessment form submissions · Peer & teacher reviews

2

Collection

GitHub GraphQL API (batched and cached to stay under rate limits) · form endpoints write directly to the database · OCS progress pulled through the existing integration

3

Processing & Aggregation

Normalize every source to a common schema · pre-compute monthly summaries at write time · align self scores against peer / teacher scores for the same skill and period

4

Storage

Numeric ratings (0–5) stored apart from reflection text · every record time-stamped so trend history can be rebuilt on demand

5

Visualization

Activity heatmaps · completion bar & pie charts · growth trendlines · self-vs-peer perception-gap comparison

Audiences

Students get self-awareness and concrete evidence of growth · Teachers get earlier signals for support, insight into team dynamics, and richer context for grading

Open Issues