Skip to content

GetStream/gemini-demo-frontend

Repository files navigation

repo-cover

Selling Assistant Frontend with Gemini 3.1 Flash Live and Vision Agents

This is a project to demonstrate the capabilities of Google Deepmind's Gemini 3.1 Flash Live model, integrated into the Vision Agents SDK.

An agent takes the user through creating a product page for selling a used item, giving you a polished product image, a clear description and title, together with a price suggestion.

The user is guided through the entire process without interruption, which is all made possible by:

  • the instruction following capabilities of the Gemini 3.1 Flash Live model
  • Stream's low-latency edge infrastructure
  • seamless function calling integration of the Gemini model
  • the natural and low-latency dialogue functionality

The accompanying backend repository (required to run the sample) can be found here.

Get started today by setting up an account for Stream and creating your first Vision Agent application today!

Requirements

  • Node.js 20+
  • npm
  • A Stream app with valid API credentials
  • The companion backend running locally or reachable over HTTP

Setup

  1. Install dependencies:
npm install
  1. Create your local environment file from ./.env.example:
cp .env.example .env
  1. Fill in the required values in .env:
  • NEXT_PUBLIC_STREAM_API_KEY: Stream API key used by the frontend
  • STREAM_API_SECRET: Stream API secret used by related local tooling/backend flows
  • NEXT_PUBLIC_STREAM_USER_ID: Stream user id for the local demo user
  • NEXT_PUBLIC_STREAM_USER_TOKEN: Stream user token for that user
  • NEXT_PUBLIC_STREAM_CALL_ID: Call id the app should join
  1. Review the optional values if you need to customize local development:
  • NEXT_PUBLIC_BASE_URL: backend base URL. Defaults to http://localhost:8000
  • NEXT_PUBLIC_STREAM_USER_NAME: display name for the local user
  • NEXT_PUBLIC_STREAM_CALL_TYPE: Stream call type. Defaults to default
  • NEXT_PUBLIC_STREAM_WORKFLOW_CHANNEL_TYPE: Stream chat channel type. Defaults to messaging

Running The App

  1. Start the companion backend so the frontend can create and delete agent sessions through NEXT_PUBLIC_BASE_URL.
  2. Start the Next.js dev server:
npm run dev
  1. Open http://localhost:3000.

If the backend is not running, the UI may load but agent session creation will fail when the app calls the session endpoints.

Available Scripts

  • npm run dev: start the local development server
  • npm run build: build the app for production
  • npm run start: run the production build
  • npm run lint: run ESLint
  • npm run test: run the Vitest test suite

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors