language-models
Unified interface for working with LLMs
npm install language-modelsProvider-agnostic interface for text generation and embeddings.
import { llm, models } from 'language-models'
const response = await llm.generate({
model: 'claude-sonnet-4-20250514',
messages: [{ role: 'user', content: 'Hello!' }],
})
const embedding = await llm.embed({
model: 'text-embedding-3-small',
input: 'Hello world',
})Model Resolution
import { resolve } from 'language-models'
// Resolve model by capability
const model = resolve({ capability: 'fast' }) // Gets fastest model
const model = resolve({ capability: 'smart' }) // Gets smartest model
const model = resolve({ capability: 'vision' }) // Gets vision modelSupported Providers
| Provider | Models | Embeddings |
|---|---|---|
| Anthropic | Claude 4, Sonnet, Haiku | — |
| OpenAI | GPT-4, GPT-3.5 | text-embedding-3 |
| Gemini Pro, Flash | — | |
| Cloudflare | Workers AI | bge-* |
| Ollama | Local models | Local |
Exports
| Export | Description |
|---|---|
llm | Unified LLM interface |
models | Model registry |
resolve | Resolve by capability |
embed | Generate embeddings |
Related
- ai-providers — Provider implementations
- ai-functions — Higher-level abstractions
Was this page helpful?