Skip to content
Ollama Client

ChatRequest

Defined in: lib/providers/types.ts:44

Properties

Section titled “Properties”

keep_alive?

Section titled “keep_alive?”

optional keep_alive?: string | number

Defined in: lib/providers/types.ts:60

max_tokens?

Section titled “max_tokens?”

optional max_tokens?: number

Defined in: lib/providers/types.ts:61

messages

Section titled “messages”

messages: ChatMessage[]

Defined in: lib/providers/types.ts:46

min_p?

Section titled “min_p?”

optional min_p?: number

Defined in: lib/providers/types.ts:55

model

Section titled “model”

model: string

Defined in: lib/providers/types.ts:45

num_batch?

Section titled “num_batch?”

optional num_batch?: number

Defined in: lib/providers/types.ts:59

num_ctx?

Section titled “num_ctx?”

optional num_ctx?: number

Defined in: lib/providers/types.ts:53

num_gpu?

Section titled “num_gpu?”

optional num_gpu?: number

Defined in: lib/providers/types.ts:58

num_predict?

Section titled “num_predict?”

optional num_predict?: number

Defined in: lib/providers/types.ts:54

num_thread?

Section titled “num_thread?”

optional num_thread?: number

Defined in: lib/providers/types.ts:57

repeat_last_n?

Section titled “repeat_last_n?”

optional repeat_last_n?: number

Defined in: lib/providers/types.ts:51

repeat_penalty?

Section titled “repeat_penalty?”

optional repeat_penalty?: number

Defined in: lib/providers/types.ts:50

seed?

Section titled “seed?”

optional seed?: number

Defined in: lib/providers/types.ts:52

stop?

Section titled “stop?”

optional stop?: string[]

Defined in: lib/providers/types.ts:56

stream?

Section titled “stream?”

optional stream?: boolean

Defined in: lib/providers/types.ts:62

temperature?

Section titled “temperature?”

optional temperature?: number

Defined in: lib/providers/types.ts:47

think?

Section titled “think?”

optional think?: boolean

Defined in: lib/providers/types.ts:67

Ollama thinking toggle. Used for short internal utility calls where hidden reasoning would waste time and never be shown to the user.

tool_choice?

Section titled “tool_choice?”

optional tool_choice?: "auto" | "none" | "required"

Defined in: lib/providers/types.ts:82

Tool-call policy. “none” forbids new tool calls while keeping the tools array in the payload, so strict OpenAI-compatible endpoints that reject a message history with tool turns but no tools field do not 400. Used by the synthesis pass after the tool loop hits its iteration cap. Ollama has no such param, so its adapter expresses “none” by omitting tools (it accepts tool history without them).

tools?

Section titled “tools?”

optional tools?: ToolDefinition[]

Defined in: lib/providers/types.ts:73

Tool definitions offered to the model. Only set for tool-capable models (gated on resolved toolCalling); when absent the request is identical to the pre-tool-calling wire shape, so non-tool models are unaffected.

top_k?

Section titled “top_k?”

optional top_k?: number

Defined in: lib/providers/types.ts:49

top_p?

Section titled “top_p?”

optional top_p?: number

Defined in: lib/providers/types.ts:48