LLM System Design Under Constraints