Eval Suite Contracts and Signals

Eval Suite Contracts and Signals

Path Outline

Progress0%

1The Applied AI Engineer Interview Loop 2A Minimal Claude Messages Client

3Decomposing Multi-Level Build Specs 4Refactor-Safe Design Under Change 5High-Leverage Python Under Timer 6Ninety-Minute Mock and Post-Mortem

7Support Prompt Contract and Regression Set 8Context Packing, Budgets, and Caching 9Diagnosable RAG With Citations 10Schema-Validated Support Responses 11PDF and Image Intake With Scoring

12From-Scratch Tool-Use Loop 13Secure Local MCP Boundary 14Sub-Agents and an Agent Skill 15Prompt Injection Guardrails

16Eval Suite Contracts and Signals

17CI Regression Gates and Model Rollback 18Latency, Rate Limits, and Cost Levers 19LLM System Design Under Constraints 20Three System Design Mock Prompts

21Customer Discovery Under Constraints 22Take-Home Submission as Evidence 23Values Story Bank With Tradeoffs 24Full Mock Loop and Gap Plan

Hide outline

Home
Paths
Hands-On Anthropic Applied AI Engineer Interview
Eval Suite Contracts and Signals