Study Design
flowchart LR pre_test[Pre Test] --> teaching_start[Start learning] teaching_start -->|Control Group| written_ass[Written Formative Assessments] teaching_start -->|Treatment Group| oral_ass[AI-based Oral Formative Assessments] written_ass --> teaching_finish[Finish learning] oral_ass --> teaching_finish teaching_finish --> post_test[Post Test - Summative Assessment]
**
flowchart LR
pre["Pre-test (both topics)"] --> assign["Group assignment (Counterbalanced)"]
subgraph Seq_A["Sequence A"]
A1["Topic 1 • Oral (AI) Assessment"] --> A2["Post-test 1"]
A2 --> A3["Topic 2 • Written Assessment"]
A3 --> A4["Post-test 2"]
end
subgraph Seq_B["Sequence B"]
B1["Topic 1 • Written Assessment"] --> B2["Post-test 1"]
B2 --> B3["Topic 2 • Oral (AI) Assessment"]
B3 --> B4["Post-test 2"]
end
assign -->|Group A| A1
assign -->|Group B| B1
A4 --> analysis["Compare learning gains"]
B4 --> analysisflowchart TD
W0["Week 0: Pre-test on both topics"] --> W1_2["Weeks 1–2: Topic 1 learning with formative assessments (≥2 per week)"]
W1_2 --> W3["Week 3: Post-test for Topic 1"]
W3 --> W4_5["Weeks 4–5: Topic 2 learning with formative assessments (≥2 per week)"]
W4_5 --> W6["Week 6: Post-test for Topic 2"]
W6 --> analysis["Analysis: Compare learning gains across assessment types"]Notes
Preliminary protocol
- How are students perceiving the pre-test?
How to check for learning gains?
-
Normalized gains (It is not considered perfect)
-
There are also other options
**
flowchart LR
pre["Pre-test (both sections)"]
subgraph Section_1["Section 1"]
S1["Instruction + Written Formative Assessments"] --> S2["Post-test"]
end
subgraph Section_2["Section 2"]
S3["Instruction + AI-based Oral Formative Assessments"] --> S4["Post-test"]
end
pre --> S1
pre --> S3
S2 --> analysis["Compare learning gains between sections"]
S4 --> analysis