Requests for proposals for testing services often reference the desire that the sponsoring organization will have a “reliable and valid test.” From a measurement perspective, this request cannot be met because reliability as a concept is somewhat different from the popular perspective. Reliability refers to the level of precision or consistency of test scores, not the test itself. As an example, the reliability of scores would likely be different if calculated on two groups of examinees who have a different range of ability.
Read more.