Training activity information
Details
Design and perform a repeatability study for a clinical measurement or group of devices
Type
Developmental training activity (DTA)
Evidence requirements
Evidence the activity has been undertaken by the trainee.
Reflection on the activity at one or more time points after the event including learning from the activity and/or areas of the trainees practice for development.
An action plan to implement learning and/or to address skills or knowledge gaps identified.
Considerations
- Aims of the study
- Study design, including tools, methodology, and sample size
- Significance and interpretation of results
Reflective practice guidance
The guidance below is provided to support reflection at different time points, providing you with questions to aid you to reflect for this training activity. They are provided for guidance and should not be considered as a mandatory checklist. Trainees should not be expected to provide answers to each of the guidance questions listed.
Before action
- What is the purpose of a repeatability study?
- What statistical measures are used to assess repeatability?
- What clinical measurement or device will you be studying?
- What protocol will you follow for taking repeated measurements?
- What are the potential sources of variability in the measurements?
- What statistical methods will you use to analyse the data?
- What insights do you hope to gain about the practical aspects of designing and conducting a measurement study, and interpreting the results?
- What do you already know about measurement theory and statistics?
- Will you develop a detailed protocol for your repeatability study?
- Will you identify the necessary equipment and ensure it is calibrated?
- Have you discussed your study design and analysis plan with your training officer or a statistician?
In action
- When designing the study, what factors are you considering to ensure the repeatability of the measurements (e.g., sample size, measurement intervals)? What’s your rationale?
- As you perform the measurements, how are you ensuring consistency in your technique? Are you adapting your approach based on any observed variations?
- During the data collection, are you noticing any potential sources of error that might affect repeatability? How are you addressing these in the moment?
On action
- Summarise the design of your repeatability study, the measurements you performed, and your key findings.
- What did you learn about designing a repeatability study?
- How did you consider factors like sample size and measurement frequency?
- How did you ensure consistency in your measurement technique?
- Were there any unexpected sources of variation or challenges in obtaining repeatable measurements?
- Why is assessing repeatability important for clinical measurements and medical devices?
- What aspects of designing and performing repeatability studies could be improved?
- How will you approach future studies involving the assessment of measurement variability?
- What are your next steps in learning more about statistical methods for assessing repeatability?
- What resources (e.g., statistical software, guidelines on repeatability studies) would be helpful?
Beyond action
- Have you designed or performed other repeatability studies since this DTA?
- Have you compared the design and results of this study with other repeatability assessments you have encountered?
- Have you considered the implications of your findings for the reliability of the clinical measurement or devices?
- How has this experience influenced your understanding of the principles of measurement reliability and repeatability?
- Have you applied the skills of designing and conducting studies in other areas of your work?
- Has your appreciation for the importance of measurement validity and reliability in clinical practice changed?
- What skills related to experimental design, data collection, statistical analysis (if applicable), and understanding of measurement science did you develop?
- How has this experience informed your approach to evaluating the performance of clinical measurements and devices?
- What actions will you take to further develop your expertise in study design and measurement analysis?
Relevant learning outcomes
| # | Outcome |
|---|---|
| # 7 |
Outcome
Use suitable tools for measurement and analysis. |
| # 8 |
Outcome
Plan and perform verification and validation of solutions. |