vllm

An open-source machine learning framework that lets developers build and train their own AI models.

A tool that lets you easily run various large language models on your local computer, supporting popular models like DeepSeek, Qwen, and Gemma.

Load and run various pre-trained AI models in Python, covering tasks such as text, image, and audio.

Run large language models offline on your own computer, no internet or expensive GPU required

A graphical tool for locally running and fine-tuning large AI models, supporting DeepSeek, Gemma, and more. Ready to use out of the box without programming.