AI proxy

The AI proxy lets your app call Anthropic, OpenAI, and Gemini through Major. You use each provider’s official SDK as usual, but point it at the proxy and authenticate with the app’s Major token instead of a provider API key. Usage is billed at cost against your organization’s credits and shows up in the usage dashboard.

On the Enterprise plan, admins can add the organization’s own provider API keys in Settings > Models. Calls to a provider with an organization key run on that key and don’t use credits. Your code doesn’t change: keep using MAJOR_JWT_TOKEN, never the provider key.

Example requests

“Add a Summarize button that uses Claude to summarize the selected ticket.”
“Classify each new lead as hot, warm, or cold with GPT and store the label.”
“Generate a product image from the description field with Gemini.”

Enable it for an app

The proxy is enabled per app. When you enable it, the app gets a default monthly spending limit of $10.

Editor
CLI
Platform Agent

Open the app in the editor, go to the Settings tab, and turn on Enable AI proxy for this app in the AI Proxy section. You can change the monthly spending limit there.

From the app’s directory:

major app ai-proxy status   # enabled? and this month's spend
major app ai-proxy enable   # enable with the default $10/month limit

See major app.

Use it in your code

Two environment variables are available in the app’s runtime, in the editor preview, and after deploy:

Variable	Use
`MAJOR_AI_PROXY_URL`	Base URL of the proxy. Append the provider prefix: `/anthropic`, `/openai`, or `/genai`.
`MAJOR_JWT_TOKEN`	The app’s token. Pass it as the SDK’s `apiKey`. Requests without it are rejected.

Call the proxy from server code only, so the token never reaches the browser. Use the provider’s own SDK, not a unified SDK, and never hard-code keys or proxy URLs.

The proxy only accepts requests that come from Major’s network: the editor preview, deployed apps, and Major sandboxes. Requests from anywhere else, such as an app you run on your own machine, are rejected with 403.

import Anthropic from "@anthropic-ai/sdk";

const client = new Anthropic({
  baseURL: process.env.MAJOR_AI_PROXY_URL + "/anthropic",
  apiKey: process.env.MAJOR_JWT_TOKEN,
});

const message = await client.messages.create({
  model: "claude-sonnet-4-6",
  max_tokens: 1024,
  messages: [{ role: "user", content: "Summarize this ticket: ..." }],
});

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: process.env.MAJOR_AI_PROXY_URL + "/openai",
  apiKey: process.env.MAJOR_JWT_TOKEN,
});

const completion = await client.chat.completions.create({
  model: "gpt-4.1",
  messages: [{ role: "user", content: "Classify this lead: ..." }],
});

import { GoogleGenAI } from "@google/genai";

const ai = new GoogleGenAI({
  apiKey: process.env.MAJOR_JWT_TOKEN,
  httpOptions: { baseUrl: process.env.MAJOR_AI_PROXY_URL + "/genai" },
});

const response = await ai.models.generateContent({
  model: "gemini-2.5-flash",
  contents: "Write a product description for ...",
});

For Gemini, set httpOptions.baseUrl to the /genai prefix only. The SDK adds /v1beta/models/... itself. Streaming (generateContentStream) and token counting (countTokens) use the same client.

Images and audio

// OpenAI: text to image, image edit
const image = await openai.images.generate({ model: "gpt-image-1", prompt: "A white siamese cat", size: "1024x1024" });
const edited = await openai.images.edit({ model: "gpt-image-1", image: fs.createReadStream("input.png"), prompt: "Add a top hat" });

// OpenAI: text to speech, speech to text
const speech = await openai.audio.speech.create({ model: "tts-1", voice: "alloy", input: "Hello!" });
const transcript = await openai.audio.transcriptions.create({ model: "whisper-1", file: audioFile });

// Gemini: image model through generateContent; the image comes back as inlineData parts
const res = await ai.models.generateContent({ model: "gemini-2.5-flash-image", contents: "A banana dish in a fancy restaurant" });

// Gemini: Imagen through generateImages
const imagen = await ai.models.generateImages({ model: "imagen-3.0-generate-002", prompt: "Robot holding a red skateboard", config: { numberOfImages: 1 } });

Image endpoints are stateless: input images live only in that request’s body, and nothing is stored on the server.

Supported endpoints

Only these endpoints are available. Requests to any other path are rejected.

Provider	Endpoints
Anthropic	`/v1/messages`, `/v1/messages/count_tokens`
OpenAI	`/v1/chat/completions`, `/v1/responses`, `/v1/audio/speech`, `/v1/audio/transcriptions`, `/v1/images/generations`, `/v1/images/edits`, `/v1/images/variations`
Gemini	`/v1beta/models/{model}:generateContent`, `:streamGenerateContent`, `:countTokens`, `:generateImages`

Not supported: embeddings, video generation, file uploads, the OpenAI Assistants API, and Gemini cached contents, tuning, and the Live API.

Spending limits and errors

Each request is checked before it reaches the provider:

Error	Status	Meaning
`missing_authorization`	401	No token was sent. Pass `MAJOR_JWT_TOKEN` as `apiKey`.
`invalid_token`	401	The token is invalid or expired.
`proxy_disabled`	403	The proxy isn’t enabled for this app.
`spending_limit_exceeded`	403	The app reached its monthly spending limit. Raise the limit or wait for the next month.
`insufficient_balance`	403	Your organization is out of credits. See Billing.

The monthly limit counts only this app’s proxy usage and resets at the start of each month. Calls that run on your organization’s own provider keys count toward it at the provider’s list price. If your organization uses its own key for a provider, two more cases can fail a request:

The provider rejected the organization’s key (invalid, out of credits, over a spend limit, or suspended). The error names the provider and asks you to contact your organization admin. Requests on your own key never fall back to Major’s keys.
An admin turned off the provider. Requests to a turned-off provider are refused.

Agents and the Platform Agent choose their models separately. See agent models and Settings > Models.

Get Started

Learn

Build

Settings

Reference

Example requests

Enable it for an app

Use it in your code

Images and audio

Supported endpoints

Spending limits and errors