End-to-End Latency Budgeting for Agents