ClikaRT CLI: The command line
Run a model on your hardware with one command.
For developers who want to try, serve and measure a model before writing any code. Name the model. The CLI does the rest.
$ clikart-cli <model> <command>
Check
Know if a model fits before you download it.
A verdict for every device in the machine, and no weights are downloaded to get it.
$ clikart-cli check Qwen/Qwen3-4Bdevice grade ctxCPU:0 Good 40k→32k admits 32768 tokens of the 40960 judged, the largest window at Good or betterVulkan:0 Does not fit 40k→0 the weights alone need 7.5 GiB against 5.5 GiB# no model weights were downloaded to get this answer
Run
One command from a model's name to its answer.
A name on the hub, a folder or a single file: the command stays the same.
$ clikart-cli Qwen/Qwen3-4B prompt \ "What does a runtime do? Answer in one sentence."A runtime takes a trained model and executes it on thehardware of the machine it runs on.
Serve
Turn a model into a server with one command.
OpenAI and Anthropic clients can call it: an existing app only needs the new address.
$ clikart-cli Qwen/Qwen2.5-0.5B-Instruct serveserving on http://127.0.0.1:8000 (model=Qwen/Qwen2.5-0.5B-Instruct)# any OpenAI or Anthropic client, pointed at the new addressclient = OpenAI(base_url="http://127.0.0.1:8000/v1", api_key="none")
Measure
Measure the model on your own hardware.
One command sweeps prompt sizes and parallel requests, and writes one row per combination.
$ clikart-cli Qwen/Qwen2.5-0.5B-Instruct bench --output results# default sweep: 128in/128out · 2048in/128out · 128in/1024out# each at 1, 4 and 8 parallel requests# results.csv: nine rows, one per combination# results.json: the settings of the run
Automate
Use it in scripts without a wrapper.
The result on standard output, one exit code per outcome, and an offline switch for pipelines.
#!/bin/shMODEL=Qwen/Qwen3-4B# one row per device, as CSVclikart-cli check "$MODEL" --csv > fit.csv# download onceclikart-cli fetch "$MODEL"# the answer to a file, diagnostics to a log, no networkclikart-cli "$MODEL" prompt --offline \ "What does a runtime do? Answer in one sentence." \ > answer.txt 2> run.logecho "exit code: $?"