WhatsApp AI Voice Agent | VideoSDK

This project is designed to be a streamlined alternative to complex setups, removing the need for middleware like n8n by connecting Twilio directly to the VideoSDK SIP Gateway using a TwiML Bin.

Before you begin, ensure you have the following:

• Python 3.12+
• Docker installed and running on your local machine.
• A VideoSDK Account. Sign up here.
• A Twilio Account with a phone number that is approved for WhatsApp Business.
• A Google AI Studio API Key for the Gemini model.

Follow these steps to get your AI WhatsApp agent live.

git clone https://github.com/videosdk-community/videosdk-whatsapp-agent.git
cd videosdk-whatsapp-agent

Create a virtual environment and install the required Python packages.

# Create and activate virtual environment
python3 -m venv .venv
source .venv/bin/activate  # On Windows, use: .venv\Scripts\activate

# Install dependencies
pip install -r requirements.txt

This project includes a sample HTTP request file in the http-req/ directory. You can use the popular VS Code extension REST Client to run this request directly from your editor. Request File: http-req/create-deployment-id.http

POST https://api.videosdk.live/ai/v1/ai-deployments
Authorization: VIDEOSDK_TOKEN
Content-Type: application/json

{
    "name": "AI Whatsapp Agent",
    "description":"AI Telephony Agents - Inbound/Outbound Calls"
}

Open the videosdk.yaml file. You only need to set your deployment.

# videosdk.yaml
version: "1.0"
deployment:
  id: "your-unique-deployment-id-goes-here" # <-- CHANGE THIS
  entry:
    path: main.py
secrets:
  VIDEOSDK_AUTH_TOKEN: "specify-your-videosdk-token"

Note: After deployment VIDEOSDK_TOKEN & VIDEOSDK_ROOM_ID are loaded from your environment, Room Id is generated dynamically and will be automatically added to main.py

Now, deploy your agent to the VideoSDK cloud with a single command:

videosdk deploy

Once the deployment is successful, the CLI will confirm the Deployment ID. This is the unique ID you set in the videosdk.yaml file. Keep it handy for the final step!

This is where we connect the public phone number to your deployed agent.

1. Go to your VideoSDK Dashboard.
2. Navigate to Telephony -> Inbound Gateways and click "Add Inbound Gateway".
3. Give it a name (e.g., WhatsApp Agent Gateway).
4. VideoSDK will generate a unique SIP URI. Copy this URI.

1. Go to your Twilio Console.

2. Navigate to Develop -> TwiML Bins and create a new bin.

3. Give it a "Friendly Name" (e.g., Forward to VideoSDK).

4. In the TwiML code section, paste the following XML, replacing YOUR_VIDEOSDK_SIP_URI with the URI you copied from the VideoSDK dashboard:

   <Response>
     <Dial>
       <Sip>YOUR_VIDEOSDK_SIP_URI</Sip>
     </Dial>
   </Response>

5. Save the TwiML Bin.

6. Navigate to Phone Numbers -> Manage -> Active numbers and select your WhatsApp-enabled number.

7. Under the "A Call Comes In" section, select TwiML Bin and choose the bin you just created. Save the configuration.

1. Go back to your VideoSDK Dashboard.
2. Navigate to Telephony -> Routing Rules and create a new rule.
3. Configure the rule as follows:
   • Direction: Inbound
   • Gateway: Select the WhatsApp Agent Gateway you created.
   • Room Type: Dynamic (This is crucial for handling multiple calls).
   • Agent Type: Cloud
   • Deployment ID: Select the unique ID of the agent you deployed.
4. Save the Routing Rule.

That's it! Your AI voice agent is now live. Make a voice call to your number from WhatsApp to see it in action.