LLM Providers

LLM Providers in MLJAR Studio

MLJAR Studio supports hosted AI, local desktop model servers, and servers on your own infrastructure. Choose MLJAR AI, OpenAI, OpenRouter, Ollama, LM Studio, Jan, vLLM, llama.cpp, or a custom OpenAI-compatible endpoint for AI-assisted notebooks and data analysis.

Supported LLM providers

Quick decision table

ProviderWhere the model runsSetup
MLJAR AIManaged cloudSign in; availability depends on account access
OpenAICloudAPI key and model
OpenRouterCloudOpenRouter key and model
Ollama LocalLocalOllama and a downloaded model
LM StudioLocal or remote serverStart server; optional token
JanLocal or remote serverStart server; Jan server key
vLLMLocal or remote serverServe model; key if required
llama.cppLocal or remote serverStart llama-server; key if required
Custom OpenAI-compatibleDepends on endpointAPI URL, format, model, and key if required
Ollama CloudCloudOllama key and model

Before configuring a provider

Activate a lifetime MLJAR Studio license to unlock AI Provider Settings. MLJAR AI uses separate account access. For external cloud services, bring the provider API key and model access. For local inference, install the server and download a suitable model first.

How provider setup works

  • Open AI Provider Settings and choose the provider by name.
  • For local and custom servers, check Base URL and add the server key if required.
  • Wait for the available models to load, or use Refresh models, then select a chat-capable model.
  • Click Test connection. After it succeeds, click Save provider and confirm the success message.
  • Check the active provider in the sidebar and send a short notebook request. Retest after changing provider settings.

For OpenAI-compatible servers, connection testing checks the model list and selected model. A notebook request also verifies generation; agent workflows can require additional model and server support for tool calling.

How to choose

Local inference depends on the actual endpoint and model execution. A remote base URL sends prompts and notebook context to that server, even when you select a local-server preset. Read Local vs Cloud LLMs for the comparison and Troubleshooting for setup errors.

Frequently asked questions

Which local model providers does MLJAR Studio support?

Ollama, LM Studio, Jan, vLLM, llama.cpp, and custom OpenAI-compatible servers. The endpoint and model configuration determine whether inference is local or remote.

Do local providers need an OpenAI API key?

No. Local servers use their own authentication. Most presets allow an empty key when server authentication is disabled. The Jan preset requires the Jan server API key.

Do I need a license to configure providers?

AI Provider Settings require a lifetime MLJAR Studio license. MLJAR hosted AI has separate account access requirements; external providers may have their own usage charges.

Can I switch providers later?

Yes. Select a provider, configure its connection and model, test the connection, and save. Retest whenever you change the settings.

« Previous
Code recipes
Next »
MLJAR AI