Baseten's Mammoth-1 and Elephant-1 now available on AI Gateway for free

Mammoth-1 and Elephant-1 from Baseten are now available for free on AI Gateway for one week. Free access is available through October 27. These decision models classify text, route requests, and score content against criteria you define.

Mammoth-1 is the larger, 27B model, while Elephant-1 is a smaller, 9B option. Mammoth-1 is #1 on the Jev Decision Index and Elephant-1 is tied for #1 on the Artificial Analysis Decision Index.

Both support a 16k-token context window and return choices, probabilities, and scores. Ask several questions about the same input in one request: select a support team with a Choice question, check for a refund request with a Boolean question, or rate urgency with a Score question. Your application chooses the probability threshold for acting automatically or sending a result for review.

Use baseten/mammoth-1 or baseten/elephant-1 as the model name:

1
import { experimental_decide as decide } from 'ai';
2

3
const result = await decide({
4
  model: 'baseten/mammoth-1',
5
  state: 'I was charged twice. Please refund the duplicate.',
6
  questions: {
7
    refund: {
8
      type: 'boolean',
9
      instructions: 'Is the customer asking for a refund?',
10
    },
11
  },
12
});
13

14
console.log(result.answers.refund);

See the decision models documentation for question types and additional usage details.

AI Gateway provides a unified API for accessing models and tracking usage and cost. Decision calls appear in logs and count toward budgets alongside other model requests.

Browse all decision models available on AI Gateway.