Built a real-time voice AI appointment scheduling agent using Twilio Voice, OpenAI Realtime API, Python/FastAPI, WebSockets, and DigitalO...
Built a real-time voice AI appointment scheduling agent using Twilio Voice, OpenAI Realtime API, Python/FastAPI, WebSockets, and DigitalOcean. The system handles inbound phone calls end-to-end: webhook routing, streaming audio, realtime LLM conversation, structured intake, scheduling logic, and appointment confirmation.
Implemented structured data extraction for patient name, DOB, address, phone, email, insurance/referral details, and chief complaint using OpenAI function calling with session-based state management. Added simulated provider availability, safe turn-taking behavior, fallback handling, and automated confirmation emails via Resend API after call completion.
Designed the project to mirror production voice-agent concerns: low-latency audio streaming, call state management, interruption handling, external API integration, deployment, and reliable completion of user-facing workflows.
Python
WebSocket
Twilio
View more
Python
WebSocket
Twilio
SendGrid
DigitalOcean
API Integration
OpenAI
Fastapi
LLM
View more