Infrastructure, Observability & Security
US client deployments prefer regions and accounts that match existing controls. The control plane you already trust should host identity, secrets, and logs for the bot as well. Network rules restrict egress to approved model endpoints when contracts require private connectivity. Encryption stays on at rest and in transit with keys under your KMS. These defaults pass most Arlington contractor checklists without special pleading.
We monitor saturation signals first. Queue depth, p95 latency, tool error rate, and retrieval empty rate tell more than vanity containment charts. Drift detection compares live answer embeddings to the gold set weekly. Cost monitors track tokens by intent so expensive paths get caps. Incident response playbooks name severity, customer notice rules, and freeze conditions. Practice drills beat unread PDFs.
Compliance paths depend on data classes. SOC2 aligned logging and access reviews cover most B2B chatbots. HIPAA relevant traffic needs BAAs, stricter redaction, and extra audit fields. We never mix those environments casually. Separate projects and separate keys keep a marketing bot from blooming into a clinical risk. Mapping starts in discovery so build script includes the right controls from commit one.
Post-launch ops cover version pins, dependency scans, and prompt change windows. Models drift under vendor updates. We freeze versions for regulated flows and batch upgrades after full eval. Dependency scanners block known CVEs in adapters. Prompt change windows prevent Friday night experiments on paid traffic. These habits keep MTTR low when something does break.
Handover includes a security summary for your assessor. Data flow diagrams, retention tables, and third party lists drop into your evidence folder. Arlington programs that resell to federal primes routinely need these packets within days of go-live. Preparing them during build costs less than scrambling after a request arrives.