Has there been any change in the area of concern?
or
Is there a functional relationship between the intervention and the observed change?
Measurable
Attainable
Realistic
Timely
Is the measure measuring what it is supposed to measure as opposed to something else?
If reliability is the consistency of an instrument, the validity is the accuracy of that instrument.
The relationship must be non-spurious
There should be a time interval between one variable and the other
Reliability is the degree to which a research instrument produces consistent results
Consistency in measurement: are the measurements repeatable?
Maturation
Testing
Instrumentation
Statistical regression
Clear conceptualization: what is exactly the construct that we are trying to measure and make it as specific as possible.
Standardization: a process by which we make sure that there is consistency across different items of an instrument: e.g. train multiple raters/ judges, use consistent rubrics for grading, etc.
Increase the number of items on an instrument (survey): trying to measure intelligence by asking people 10 questions vs. just one question.
Use more precise instrument: ratio rather than interval or ordinal.
Use multiple measures: e.g. anxiety: self report, report by someone else, measuring the heart rate (direct observation).
Pilot testing and replication: use the instrument, then adjust it and retest: e.g. GRE, SAT