GitHub

Run failed: [vllm] Error: PluginInvokeError: {"args":{},"error_type":"ValidationError ...

mistralai/Mistral-Small-3.1-24B-Instruct-2503: VLLM_ATTENTION_BACKEND=FLASHINFER CUDA_VISIBLE_DEVICES=2,3,5,6 nohup vllm serve mistralai/Mistral-Small-3.1-24B ...