Groq Integration
Groq provides fast LLM inference.
Guidelines
- •The Groq integration uses the
GROQ_API_KEYenvironment variable. - •The Groq integration should ONLY be used if specifically requested by the user.
- •Otherwise, use the Vercel AI Gateway and AI SDK so the user does not need to configure anything.
Environment Variables
- •
GROQ_API_KEY- Groq API key
Example Usage
typescript
import { generateText } from 'ai'
import { createGroq } from '@ai-sdk/groq'
const groq = createGroq({
apiKey: process.env.GROQ_API_KEY,
})
const { text } = await generateText({
model: groq('llama-3.3-70b-versatile'),
prompt: 'What is the meaning of life?',
})