Session Options

struct SessionOptions

How a runtime session is opened (LLMInferenceRuntime::openSession).

Public Members

bool allowCompactExecution = {false}

Whether the session may execute compact steps. Without it the session neither resolves compact execution nor reserves anything for it, and reports compact execution as unavailable.