01Support · Cross-industry
Independent evalSupport ticket routing
Every ticket to the right queue in one call. The unsure ones go to a person, not a guess.
- Jev decides
- Choice over 5-50 queues + Noul 'needs a human now' in one call; auto-route above 0.9 confidence
- The LLM does
- LLM drafts the reply only after routing
about $0.021 per 1,000 decisions, estimated
Details
- Confidence rule
- Act at 0.90 confidence or higher. Below that, a person or a larger model. Act at 0.85 or higher. Block at 0.15 or lower. Between 0.35 and 0.65, a person decides.
- Watch out
- Write your house rules into the request. When rules were left out, Jev got 5 of 24 right with high confidence (Huryn). Validate thresholds on labelled samples.
- Builder's figure. Not reproduced by us.
- 40 tickets across 9 desks for about $0.0016; TypeSafe eval: customer service 76.0 vs 78.3 best comparator
- apimodels.app/jev-use-cases
