A model gateway inside a wider AI platform (illustrative)

A model gateway inside a wider AI platform (illustrative) An architecture diagram generated by Archify. Internal apps · nine AI applications · AI platform, many owners Internal apps nine AI applications Agent runtime · state, orchestration · AI platform, many owners Agent runtime state, orchestration Model gateway · keys, routing, budgets · AI platform, many owners · one control point Model gateway keys, routing, budgets one control point Model providers · hosted and self-hosted · Architecture component Model providers hosted and self-hosted Tools and MCP · systems of record · AI platform, many owners Tools and MCP systems of record Memory · governed store · AI platform, many owners Memory governed store Evaluation · datasets, gates · AI platform, many owners Evaluation datasets, gates Observability · traces, cost, prompts? · AI platform, many owners Observability traces, cost, prompts? Direct SDK call · a team shortcut · Architecture component · bypass Direct SDK call a team shortcut bypass Vendor SaaS AI · embedded features · Architecture component · bypass Vendor SaaS AI embedded features bypass tasks inference routed act recall samples results unseen unseen AI platform, many owners Legend Frontend Backend Database Cloud Security Message bus External