What Makes an LLM App Hackable