Hybrid AI Systems
Synonyms: hybrid AI, neuro-symbolic AI, compound AI systems, rules plus ML, hybrid intelligence
Definition
Use cases
- The chatbot that invented a policy: In 2024, a Canadian tribunal made Air Canada honor a bereavement refund its chatbot made up. Nothing checked the answer against the written policy.
- Rules that can't read: A help desk routes tickets by keyword. "I got charged twice" lands in the new-orders queue, and the customer waits 3 days.
- The silent cloud trip: A photo app sends bigger edits to a server without saying so. The user uploads a private photo without knowing it left the phone.
How it's used in practice
- Tag every step as "must be exact" or "can be fuzzy": Rules own pricing and eligibility. The model owns reading and drafting.
- Check the model's output before users see it: Compare numbers and claims to source data. AWS's Automated Reasoning checks mark each claim Valid, Invalid, or No Data.
- Show which part answered: Label rule results ("From your plan terms") apart from model output ("Suggested by AI").
- Send low-confidence cases to a person: Anything under your threshold goes to human review with the model's draft attached.
- Say when data leaves the device: Tell users before a request goes to the cloud.
Challenges & limitations
- Two ways to fail: Rules break on input nobody planned for. Models break by sounding sure when they're wrong. Test both, plus the handoff.
- Rule sprawl: Every edge case adds a rule. A year in, nobody knows which rule fired.
- Uneven feel: Users notice when one screen is precise and the next improvises.
Free resources
- Human-In-The-Loop (HITL) — The definitions, with use cases and how it's used in practice
- Humans in the Loop: The Design of Interactive AI Systems (Stanford HAI) — Ge Wang on automating parts of a task while keeping people involved.
- The First Rule of Machine Learning: Start without Machine Learning (Eugene Yan) — real cases where simple rules beat a model on cost and accuracy.
