Research questions
What would count as evidence that PrepTalk helps?
A learner completes a reply after receiving several hints. That tells us they finished this activity with support. To ask whether the activity helped them learn, we need to look at what they can do afterwards.
Give the learner another writing problem
One question worth studying is whether learners can use the same skills in a new task without the same support. Can they develop a reason, choose a relevant example and address another writer’s position?
A later task could also help distinguish something remembered briefly from something the learner can still use. These are directions for study design, not a description of a trial that has already taken place.
Decide what a comparison would mean
Comparing a supported group with an unsupported group sounds simple, but the tasks, time available and starting differences between learners all matter. A study would need to make those choices explicit before interpreting a difference in the final texts.
The way writing is judged matters too. If the question is whether people develop arguments more effectively, counting grammatical errors alone will not answer it. The outcome measures need to match the question.
Use the activity records to ask better questions
Attempts, hints and completion can show where the activity is difficult. They might help explain why an overall result differs between tasks or learners. They cannot replace an outcome measure of writing.
Learners’ accounts of the experience would also be useful. A hint can look sensible to its designer while feeling confusing or intrusive to the person receiving it. Any additional research data would need its own agreed collection and consent arrangements.
Where PrepTalk stands
The current research section presents the teaching model, activity designs and questions we want to investigate. It does not report a completed effectiveness study. The dashboard uses example data.
Before treating the pilot as production-ready, curriculum and validation review must be completed. A public study description should then state its actual methods and status. When findings are available, they should include the limits as well as the results.
This page sets out questions for future research. It is not a registered protocol, recruitment notice or report of findings.