Structured system prompts that define the model's role, hard constraints, output format requirements, and domain context. Prompts designed to be consistent across diverse user inputs, not optimised for the examples you thought of. Modular prompt architecture that separates role definition, task instructions, format requirements, and domain grounding so each can be updated independently.
System prompt architecture decisions that are not obvious: (1) Role definition tone affects output register, "you are a helpful assistant" produces different output formality from "you are a senior analyst at a regulated financial institution." (2) Hard constraints expressed as negatives require different treatment from positive instructions, "never recommend specific investments" needs explicit wording to survive paraphrase attacks and adversarial inputs. (3) Output format instructions expressed as JSON Schema or XML with field descriptions produce more reliable structured output than natural language format descriptions, especially for optional fields and nested structures. (4) Domain grounding injected into the system prompt keeps the model from defaulting to generic internet knowledge, for a support assistant for a specific software product, every entity the model needs to reference is defined in the system prompt context. Prompt length management: large context costs more to process on every call. We audit system prompts for redundancy and compress domain grounding using retrieval (RAG) rather than static injection where the context volume is large.