A Pipeline That Runs Is Not a Pipeline You Can Trust