host_cmd
diapason.cli.host_cmd
¶
diapason host — download and serve a model locally with auto backend setup.
host(model, backend, port, trust_remote_code)
¶
Download (if needed) and serve a model locally.
Examples:
diapason host mlx-community/Qwen2.5-7B-4bit --backend mlx diapason host Qwen/Qwen3-8B --backend vllm diapason host qwen3:8b --backend ollama diapason host meta-llama/Llama-3-8B -b sglang