State and memory

Language models rely on the context they receive. Managing state and memory ensures decisions remain grounded and consistent over time.

• Providing state to an LLM — Supplying relevant context in requests.
• Updating state from model output — Applying model decisions to program state.
• Persisting memory across runs — Saving and restoring long-term information.