Cerebras Inference

Cerebras Inference uses specialized silicon to provides fast inference for the Llama3.1 8B and Llama3.1 70B models.

1. Create an account in the portal here.
2. Create and copy the API key for use in Continue.
3. Update your Continue config file:

config.json

{
  "models": [
    {
      "title": "Cerebras Llama 3.1 70B",
      "provider": "cerebras",
      "model": "llama3.1-70b",
      "apiKey": "YOUR_API_KEY"
    }
  ]
}