cortex run
This CLI command is a shortcut to run models easily. It executes this sequence of commands:
cortex pull: This command pulls the specified model if the model is not yet downloaded, or finds a local model.cortex engines install: This command installs the specified engines if not yet downloaded.cortex models start: This command starts the specified model, making it active and ready for interactions.
Usage
info
You can use the --verbose flag to display more detailed output of the internal processes. To apply this flag, use the following format: cortex --verbose [subcommand].
- MacOs/Linux
- Windows
cortex [options] <model_id>
cortex.exe [options] <model_id>
Options
| Option | Description | Required | Default value | Example |
|---|---|---|---|---|
model_id | The identifier of the model you want to chat with. | Yes | - | mistral |
--gpus | List of GPUs to use. | No | - | [0,1] |
--ctx_len | Maximum context length for inference. | No | min(8192, max_model_context_length) | 1024 |
-h, --help | Display help information for the command. | No | - | -h |