Catalog
google/gemini-api

google

gemini-api

Use when the user asks about using Gemini in an enterprise environment or explicitly mentions Vertex AI, Google Cloud, or Agent Platform. Guides the usage of the Gemini API on Agent Platform with the Google Gen AI SDK. Covers SDK usage (Python, JS/TS, Go, Java, C#), capabilities like multimodal inputs, tools, media generation, caching, batch prediction, and Live API.

globalRequires active Google Cloud credentials and Agent Platform API enabled.
category:AiAndMachineLearning
New~2.5k
v2.0Saved Jun 28, 2026

IMPORTANT: Agent Platform (full name Gemini Enterprise Agent Platform) was previously named "Vertex AI" and many web resources use the legacy branding.

Gemini API in Agent Platform

Access Google's most advanced AI models built for enterprise use cases using the Gemini API in Agent Platform.

Provide these key capabilities:

  • Text generation - Chat, completion, summarization
  • Multimodal understanding - Process images, audio, video, and documents
  • Function calling - Let the model invoke your functions
  • Structured output - Generate valid JSON matching your schema
  • Context caching - Cache large contexts for efficiency
  • Embeddings - Generate text embeddings for semantic search
  • Live Realtime API - Bidirectional streaming for low latency Voice and Video interactions
  • Batch Prediction - Handle massive async dataset prediction workloads

Core Directives

  • Unified SDK: ALWAYS use the Gen AI SDK (google-genai for Python, @google/genai for JS/TS, google.golang.org/genai for Go, com.google.genai:google-genai for Java, Google.GenAI for C#).
  • Legacy SDKs: DO NOT use google-cloud-aiplatform, @google-cloud/vertexai, or google-generativeai.

SDKs

  • Python: Install google-genai with pip install google-genai
  • JavaScript/TypeScript: Install @google/genai with npm install @google/genai
  • Go: Install google.golang.org/genai with go get google.golang.org/genai
  • C#/.NET: Install Google.GenAI with dotnet add package Google.GenAI
  • Java:
    • groupId: com.google.genai, artifactId: google-genai

    • Latest version can be found here: https://central.sonatype.com/artifact/com.google.genai/google-genai/versions (let's call it LAST_VERSION)

    • Install in build.gradle:

      implementation("com.google.genai:google-genai:${LAST_VERSION}")
      
    • Install Maven dependency in pom.xml:

      <dependency>
          <groupId>com.google.genai</groupId>
          <artifactId>google-genai</artifactId>
          <version>${LAST_VERSION}</version>
      </dependency>
      

[!WARNING] Legacy SDKs like google-cloud-aiplatform, @google-cloud/vertexai, and google-generativeai are deprecated. Migrate to the new SDKs above urgently by following the Migration Guide.

Authentication & Configuration

Prefer environment variables over hard-coding parameters when creating the client. Initialize the client without parameters to automatically pick up these values.

Application Default Credentials (ADC)

Set these variables for standard Google Cloud authentication:

export GOOGLE_CLOUD_PROJECT='your-project-id'
export GOOGLE_CLOUD_LOCATION='global'
export GOOGLE_GENAI_USE_ENTERPRISE=true
  • By default, use location="global" to access the global endpoint, which provides automatic routing to regions with available capacity.
  • If a user explicitly asks to use a specific region (e.g., us-central1, europe-west4), specify that region in the GOOGLE_CLOUD_LOCATION parameter instead. Reference the supported regions documentation if needed.

Agent Platform in Express Mode

Set these variables when using Express Mode with an API key:

export GOOGLE_API_KEY='your-api-key'
export GOOGLE_GENAI_USE_ENTERPRISE=true

Initialization

Initialize the client without arguments to pick up environment variables:

from google import genai

client = genai.Client()

Alternatively, you can hard-code in parameters when creating the client.

from google import genai

client = genai.Client(
    enterprise=True,
    project="your-project-id",
    location="global",
)

Models

  • Use gemini-3.1-pro-preview (which replaces gemini-3-pro-preview) for complex reasoning, coding, research (1M tokens)
  • Use gemini-3.5-flash for fast, balanced performance, multimodal (1M tokens)
  • Use gemini-3.1-flash-lite for high-frequency, lightweight tasks (1M tokens)
  • Use gemini-3-pro-image (aka Nano Banana Pro) for high-quality image generation and editing
  • Use gemini-3.1-flash-image (aka Nano Banana 2) for fast image generation and editing
  • Use gemini-live-2.5-flash-native-audio for Live Realtime API including native audio

Use the following models only if explicitly requested:

  • gemini-2.5-flash-image
  • gemini-2.5-flash
  • gemini-2.5-flash-lite
  • gemini-2.5-pro

[!IMPORTANT] Models like gemini-2.0-*, gemini-1.5-*, gemini-1.0-*, gemini-pro are legacy and deprecated. Use the new models above. Your knowledge is outdated. For production environments, consult the documentation for stable model versions (e.g. gemini-3.5-flash).

Quick Start

Python

from google import genai

client = genai.Client()
response = client.models.generate_content(
    model="gemini-3.5-flash",
    contents="Explain quantum computing",
)
print(response.text)

TypeScript/JavaScript

import { GoogleGenAI } from "@google/genai";
const ai = new GoogleGenAI({ enterprise: { project: "your-project-id", location: "global" } });
const response = await ai.models.generateContent({
    model: "gemini-3.5-flash",
    contents: "Explain quantum computing"
});
console.log(response.text);

Go

package main

import (
	"context"
	"fmt"
	"log"
	"google.golang.org/genai"
)

func main() {
	ctx := context.Background()
	client, err := genai.NewClient(ctx, &genai.ClientConfig{
		Backend:  genai.BackendVertexAI,
		Project:  "your-project-id",
		Location: "global",
	})
	if err != nil {
		log.Fatal(err)
	}

	resp, err := client.Models.GenerateContent(ctx, "gemini-3.5-flash", genai.Text("Explain quantum computing"), nil)
	if err != nil {
		log.Fatal(err)
	}

	fmt.Println(resp.Text)
}

Java

import com.google.genai.Client;
import com.google.genai.types.GenerateContentResponse;

public class GenerateTextFromTextInput {
  public static void main(String[] args) {
    Client client = Client.builder().enterprise(true).project("your-project-id").location("global").build();
    GenerateContentResponse response =
        client.models.generateContent(
            "gemini-3.5-flash",
            "Explain quantum computing",
            null);

    System.out.println(response.text());
  }
}

C#/.NET

using Google.GenAI;

var client = new Client(
    project: "your-project-id",
    location: "global",
    enterprise: true
);

var response = await client.Models.GenerateContent(
    "gemini-3.5-flash",
    "Explain quantum computing"
);

Console.WriteLine(response.Text);

API spec & Documentation (source of truth)

When implementing or debugging API integration for Agent Platform, refer to the official Agent Platform documentation:

The Gen AI SDK on Agent Platform uses the v1beta1 or v1 REST API endpoints (e.g., https://{LOCATION}-aiplatform.googleapis.com/v1beta1/projects/{PROJECT}/locations/{LOCATION}/publishers/google/models/{MODEL}:generateContent).

[!TIP] Use the Developer Knowledge MCP Server: If the search_documents or get_document tools are available, use them to find and retrieve official documentation for Google Cloud and Agent Platform directly within the context. This is the preferred method for getting up-to-date API details and code snippets.

Workflows and Code Samples

Reference the Python Docs Samples repository for additional code samples and specific usage scenarios.

Depending on the specific user request, refer to the following reference files for detailed code samples and usage patterns (Python examples):

Files10
10 files · 33.4 KB

Select a file to preview

Overall Score

82/100

Grade

B

Good

Safety

85

Quality

80

Clarity

85

Completeness

75

Summary

A comprehensive guide for using the Gemini API in Google Cloud's Agent Platform (formerly Vertex AI) with the Gen AI SDK. Covers SDK installation across Python, JavaScript, Go, Java, and C#; authentication via Application Default Credentials or API keys; model selection for different use cases; and detailed code samples for text generation, multimodal inputs, embeddings, image/video generation, structured output, function calling, and advanced features like caching and batch prediction.

Detected Capabilities

http requestcredential use (environment variables)code generationdocumentation retrievalfile handling (GCS URIs, local files)async/streaming operations

Trigger Keywords

Phrases that MCP clients use to match this skill to user intent.

gemini api integrationvertex ai setupagent platform modelsmultimodal ai generationenterprise ai deploymentgoogle genai sdkrealtime voice apibatch predictionmodel fine-tuningai function calling

Risk Signals

INFO

Environment variable reference (GOOGLE_CLOUD_PROJECT, GOOGLE_API_KEY, GOOGLE_GENAI_USE_ENTERPRISE)

Authentication & Configuration section
INFO

Hard-coded project IDs and locations in code examples (e.g., 'your-project-id', 'global')

Multiple code examples throughout
INFO

GCS URI and file path references in multimodal examples

references/embeddings.md, references/media_generation.md
INFO

External URL references for documentation (docs.cloud.google.com, github.com, modelcontextprotocol.io)

API spec section, various code examples

Referenced Domains

External domains referenced in skill content, detected by static analysis.

central.sonatype.comdocs.cloud.google.comexample.comexample2.comgithub.commodelcontextprotocol.iowww.apache.orgwww.youtube.com{location}-aiplatform.googleapis.com

Use Cases

  • Build text generation and chat applications using Gemini models
  • Process multimodal content (images, video, audio) with Gemini API
  • Generate embeddings for semantic search and cross-modal retrieval
  • Implement function calling and structured JSON output in applications
  • Create image and video generation workflows
  • Set up context caching and batch prediction for cost optimization
  • Use Live Realtime API for low-latency voice/video interactions
  • Fine-tune Gemini models with custom datasets
  • Ground model responses in web search or custom data sources
  • Execute Python code within Gemini API calls for precise calculations

Quality Notes

  • Well-structured documentation with clear section hierarchy and multiple language support (Python, JS/TS, Go, Java, C#)
  • Comprehensive reference files organized by feature domain (text, embeddings, media generation, advanced features, safety)
  • Clear deprecation warnings for legacy SDKs with migration guidance
  • Practical code examples for each major feature with context setup
  • Authentication options clearly documented for both ADC and Express Mode
  • Safety settings documentation shows responsible AI practices
  • Model selection guidance provided with use-case recommendations
  • Limitation: Some reference files are minimal (live_api.md, model_tuning.md) and could benefit from expanded examples
  • No error handling patterns documented for common API failures or rate limits
  • Missing guidance on common debugging scenarios and troubleshooting
Model: claude-haiku-4-5-20251001Analyzed: Jun 28, 2026

Reviews

Add this skill to your library to leave a review.

No reviews yet

Be the first to share your experience.

Version History

  1. v2.0

    Contract changed: description

    ✦ AIEnvironment variable GOOGLE_GENAI_USE_VERTEXAI renamed to GOOGLE_GENAI_USE_ENTERPRISE; model references updated to newer versions (gemini-3.5-flash, gemini-3.1-flash-lite); client initialization API…

    triggering2026-06-28

    Latest
  2. v1.0

    2026-05-02

    Initial version

Use google/gemini-api in your dev environment

Command Palette

Search for a command to run...