A B2B services firm, US Southeast
An agent-in-the-loop operations desk that triages every inbound, drafts the first reply, and never acts without a human holding the last word.
- Inbound triaged without human touch
- 70%
- Median first-response time
- 4 hr → 18 min
- Outbound actions human-approved
- 100%
The firm's two-person operations team had become the bottleneck on its own growth: every inbound enquiry, scheduling request, and document hand-off ran through the same two inboxes, and the backlog grew faster than they could hire. They did not want a chatbot bolted to the website — they wanted the repetitive judgement work handled and the human judgement preserved. The engagement was a custom agent that plugs into the tools they already run — mailbox, calendar, and document store — triaging inbound, drafting context-aware replies, and preparing scheduling, with every outbound action staged for a one-click human approval.
- 01Tool boundaries written before prompts
We enumerated exactly which systems the agent may read and which actions it may take — and, more importantly, the ones it may never take unattended. The boundary is enforced in code, not asked for politely in a prompt.
- 02Agent in the loop, not human out of it
Every outbound email, calendar invite, and document edit lands in an approval queue with the agent's reasoning attached. A person approves, edits, or rejects in one click. Nothing reaches a client without a human signing off.
- 03Model selection against a cost and privacy posture
Routine triage runs on a smaller, cheaper model; only genuinely ambiguous cases escalate to a frontier model. Client data stays inside boundaries the firm controls, with no training on their correspondence.
- 04Adversarial testing before production
We red-teamed the agent against prompt injection in inbound mail and malformed attachments before it touched a live inbox, so a hostile message can't talk it past its own guardrails.
The agent does the repetition. The team keeps the judgement.
Source notes redacted · Client identification withheld by agreement