resolution error in measurement