Skip to content

host_cmd

diapason.cli.host_cmd

diapason host — download and serve a model locally with auto backend setup.

host(model, backend, port, trust_remote_code)

Download (if needed) and serve a model locally.

Examples:

 diapason host mlx-community/Qwen2.5-7B-4bit --backend mlx diapason host Qwen/Qwen3-8B --backend vllm diapason host qwen3:8b --backend ollama diapason host meta-llama/Llama-3-8B -b sglang