A think aloud protocol has an advantage over simple observation as an evaluator may gain valuable insights into what the participant is thinking on the spot.
There would be less discrepancy in the verbal response of the participant and what he or she actually thinks about the e-learning program because in the e-learning program, the learner does not need to recall from long-term memory events that have taken place earlier. Ideally, a think aloud protocol provides rapid, high-quality, qualitative user feedback compared with questionnaire.
During a think aloud protocol, data is obtained from two primary sources:
Direct observation of what the learner is doing.
Hearing what the learner wants, or is trying, to do.
Another advantages stems from the fact that if the learner gets into difficulties, the evaluator has the chance to clarify the situation.
Limitations
A think aloud protocol is designed to tap into certain types of thinking but not all. A think aloud protocol may not help an evaluator gather sufficient information to diagnose a problem in an e-learning program without the use of probing.
Another limitation is that a think aloud protocol may modify the way learners engage in the interactive learning activities because they may feel uneasy hearing their own voice throughout the whole process.
In view of the limitations, think aloud protocol has evolved over the years and probing is now commonly used to gather more information form learners although probing may influence the reliability of the verbal protocol. The think aloud protocol is often used with other methodologies to gather more in depth response from participants.
Advantages and Limitations
Advantages
A think aloud protocol has an advantage over simple observation as an evaluator may gain valuable insights into what the participant is thinking on the spot.
There would be less discrepancy in the verbal response of the participant and what he or she actually thinks about the e-learning program because in the e-learning program, the learner does not need to recall from long-term memory events that have taken place earlier. Ideally, a think aloud protocol provides rapid, high-quality, qualitative user feedback compared with questionnaire.
During a think aloud protocol, data is obtained from two primary sources:
Another advantages stems from the fact that if the learner gets into difficulties, the evaluator has the chance to clarify the situation.
Limitations
A think aloud protocol is designed to tap into certain types of thinking but not all. A think aloud protocol may not help an evaluator gather sufficient information to diagnose a problem in an e-learning program without the use of probing.
Another limitation is that a think aloud protocol may modify the way learners engage in the interactive learning activities because they may feel uneasy hearing their own voice throughout the whole process.
In view of the limitations, think aloud protocol has evolved over the years and probing is now commonly used to gather more information form learners although probing may influence the reliability of the verbal protocol. The think aloud protocol is often used with other methodologies to gather more in depth response from participants.