GenaiClient

Defines the LLM Provider, the model and the settings utilise to generate responses

Supported Variants

🎯 Variants are identified by using the provider field. For instance

provider: name-of-variant

ollama

A client for Ollama inference.

Ideal for running local processes in an easy manner during development

openai-v1

A client for OpenAI's v1 API

groq

Client for Groq

vertex-ai

Client for Google's Vertex AI platform