ClikaRT CLI: The command line

Run a model on your hardware with one command.

For developers who want to try, serve and measure a model before writing any code. Name the model. The CLI does the rest.

Terminal

Check

Know if a model fits before you download it.

A verdict for every device in the machine, and no weights are downloaded to get it.

Terminal
$ clikart-cli check Qwen/Qwen3-4Bdevice grade ctxCPU:0 Good 40k→32k admits 32768 tokens of the 40960 judged, the largest window at Good or betterVulkan:0 Does not fit 40k→0 the weights alone need 7.5 GiB against 5.5 GiB# no model weights were downloaded to get this answer

Run

One command from a model's name to its answer.

A name on the hub, a folder or a single file: the command stays the same.

Terminal
$ clikart-cli Qwen/Qwen3-4B prompt \ "What does a runtime do? Answer in one sentence."A runtime takes a trained model and executes it on thehardware of the machine it runs on.

Serve

Turn a model into a server with one command.

OpenAI and Anthropic clients can call it: an existing app only needs the new address.

Terminal
$ clikart-cli Qwen/Qwen2.5-0.5B-Instruct serveserving on http://127.0.0.1:8000 (model=Qwen/Qwen2.5-0.5B-Instruct)# any OpenAI or Anthropic client, pointed at the new addressclient = OpenAI(base_url="http://127.0.0.1:8000/v1", api_key="none")

Measure

Measure the model on your own hardware.

One command sweeps prompt sizes and parallel requests, and writes one row per combination.

Terminal
$ clikart-cli Qwen/Qwen2.5-0.5B-Instruct bench --output results# default sweep: 128in/128out · 2048in/128out · 128in/1024out# each at 1, 4 and 8 parallel requests# results.csv: nine rows, one per combination# results.json: the settings of the run

Automate

Use it in scripts without a wrapper.

The result on standard output, one exit code per outcome, and an offline switch for pipelines.

check-and-run.sh
#!/bin/shMODEL=Qwen/Qwen3-4B# one row per device, as CSVclikart-cli check "$MODEL" --csv > fit.csv# download onceclikart-cli fetch "$MODEL"# the answer to a file, diagnostics to a log, no networkclikart-cli "$MODEL" prompt --offline \ "What does a runtime do? Answer in one sentence." \ > answer.txt 2> run.logecho "exit code: $?"

The Private
Preview is Live

Leave your email and we will get you in.