What To Measure Before You Automate