Methodology
Validity
100
Were focus groups the only method?
No, the researchers built a survey to use on a larger sample using themes which came from the focus groups (i.e., multimethods approach)
100
Was Internal Validity affected?
Yes. Participants from the same company: - unique culture could influence how they give experiences (i.e., organizational culture, ethnic culture) - the potential risk of crossing paths with each other or with superiors/managers may reduce response rate to questions, altering the themes which may be relevant
200
Are future researchers able to replicate this focus group methodology? If yes/no, why?
No, or not well. Only some of the list of scripted questions were provided casually in the article. But not all questions, as well as any probes they may have used.
200
Was External Validity affected?
Yes. All participants were from the same company. The potential for this company to have a unique culture which may not allow for generalizability to other companies is a possibility.
300
How did they record the experiences of the participants?
Anonymous Transcription
300
Was Construct Validity affected?
Yes. Not all questions asked in focus groups were provided in the article, thus not allowing us to fully evaluate whether the questions posed were relevant to the research. However, from the several they did provide, is this enough?
400
What part of the framework analysis did they primarily use?
Thematic Analysis - created/noted themes from participant discussion for survey development
400
Was Descriptive Validity affected?
Yes, potentially. The anonymous transcription was the only method of data collection conducted by the researcher.
500
What level of analysis was conducted?
Individual - collected experiences from each participant
500
Was Interpretative Validity affected?
Yes, partially. There was some mild discrepancy in meanings between gratitude and feedback. The researcher eventually asked the groups to define each, but when was this done? And did all groups agree? And did the researcher use material from themes given related to feedback or gratitude for the survey?
M
e
n
u