How to Install Qwen2.5 on Ubuntu 24.04

Qwen2.5 is Alibaba Cloud’s latest advancement in large language models (LLMs), building upon its predecessors to offer enhanced performance in natural language understanding and generation. This model introduces significant improvements in training data volume, context handling, and specialized capabilities, positioning it competitively among leading AI models.

Key Enhancements in Qwen2.5:

1. Expanded Training Data: Qwen2.5 has been pre-trained on an extensive dataset comprising 18 trillion tokens, enriching its knowledge base and contextual understanding. citeturn0search0
2. Extended Context Handling: The model supports a context length of up to 128,000 tokens, enabling it to process and generate longer, coherent outputs. citeturn0search0
3. Multilingual Proficiency: Qwen2.5 offers support for over 29 languages, including Chinese, English, French, Spanish, and Arabic, making it versatile for global applications. citeturn0search0
4. Specialized Variants: The model includes tailored versions such as Qwen2.5-Coder, optimized for coding tasks with training on 5.5 trillion tokens of code-related data, and Qwen2.5-Math, focused on mathematical problem-solving. citeturn0search0
5. Multimodal Capabilities: The Qwen2.5-VL variant integrates vision and language processing, enabling the model to interpret and generate content that combines textual and visual information. citeturn0search0

Comparative Performance Analysis:

In benchmark evaluations, Qwen2.5 demonstrates competitive performance:

• Arena-Hard Benchmark: Qwen2.5-Max scores 89.4, surpassing DeepSeek V3 (85.5) and Claude 3.5 Sonnet (85.2), indicating superior problem-solving capabilities in challenging tasks. citeturn0search6
• MMLU-Pro Benchmark: Qwen2.5-Max achieves a score of 76.1, slightly ahead of DeepSeek V3 (75.9) but marginally behind Claude 3.5 Sonnet (78.0), showcasing robust multi-tasking and comprehensive understanding. citeturn0search6
• LiveCodeBench: With a score of 38.7, Qwen2.5-Max demonstrates strong coding capabilities, closely matching DeepSeek V3 (37.6) and slightly trailing Claude 3.5 Sonnet (38.9). citeturn0search6

Comparison with Other Leading Models:

When compared to other prominent LLMs, Qwen2.5 exhibits notable strengths:

• GPT-4o: While GPT-4o maintains a slight edge in certain benchmarks, Qwen2.5 offers competitive performance with the added advantage of open-weight accessibility, allowing for greater customization and integration flexibility. citeturn0search0
• LLaMA 3.1-405B: Qwen2.5-Max outperforms LLaMA 3.1-405B in various benchmarks, including general knowledge and language understanding tasks, highlighting its superior training and optimization. citeturn0search6
• DeepSeek V3: Qwen2.5-Max consistently surpasses DeepSeek V3 in benchmarks such as Arena-Hard and LiveBench, indicating enhanced problem-solving abilities and general AI capabilities. citeturn0search6

Strategic Implications:

The release of Qwen2.5 underscores Alibaba’s commitment to advancing AI technology and maintaining a competitive edge in the global AI landscape. By offering a model that combines high performance with open-weight accessibility, Alibaba positions Qwen2.5 as a versatile tool for developers, researchers, and enterprises seeking advanced AI solutions. This approach not only fosters innovation but also promotes transparency and collaboration within the AI community.

In summary, Qwen2.5 represents a significant leap in Alibaba’s AI capabilities, delivering a robust, versatile, and accessible LLM that stands strong among industry leaders.

---

Step 1: Set Up a Server on Shape.Host

Before installing Qwen2.5, you’ll need a server to run it. Here’s how to create one on Shape.Host:

Log in to Shape.Host: Go to the Shape.Host website and log in to your account. Navigate to the Cloud VPS section.

Create a New Server: Click on “Create” and choose the server type that fits your needs.

Pick a Data Center: Select a data center location close to your audience for better performance.

Choose a Plan: Pick a hosting plan that matches your project’s requirements and budget.

Set the OS: Choose Ubuntu 24.04 as your operating system.

Launch the Server: Review your settings and click “Create Instance” Your server will be ready in a few minutes.

In Dashboard you will find your Instance IP

---

Step 2: Connect to Your Server

Once your server is ready, you’ll need to connect to it using SSH. Here’s how:

• Linux/macOS: Open your terminal and type:

ssh root@your_server_ip

Replace your_server_ip with your server’s IP address.

• Windows: Use an SSH client like PuTTY. Enter your server’s IP address, specify the port (usually 22), and click “Open.” Log in with your username and password.

---

Step 3: Update Your System

Before installing anything, it’s important to update your system to ensure all software is up to date. Run the following command:

apt update && apt upgrade -y

---

Step 4: Install Required Tools

Qwen2.5 requires some basic tools to run. Install them using these commands:

apt install python3 -y
apt install python3-pip -y
apt install git -y

These tools include Python (the programming language used for AI models), Pip (a package manager for Python), and Git (for downloading code).

---

Step 5: Create a Directory for the WebUI

Next, create a folder to store all the files for your project. Run the following commands:

cd /home/
mkdir webui
cd webui

This will create a folder named webui and navigate into it.

---

Step 6: Install Ollama

Ollama is a tool that makes it easy to download and run AI models like Qwen2.5. Install it with this command:

curl -fsSL https://ollama.com/install.sh | sh

After installation, check if the Ollama service is running:

systemctl status ollama.service

---

Step 7: Download and Run Qwen2.5

Now it’s time to download the Qwen2.5 model. Run the following command:

ollama run qwen2.5

This will download the model and start it. You can check the list of installed models with:

ollama list

To interact with the model, simply type your questions or prompts in the terminal.

---

Step 8: Set Up Open WebUI (Optional)

If you prefer a graphical interface to interact with Qwen2.5, you can install Open WebUI. Here’s how:

1. Install Python Virtual Environment:

apt install python3-venv

1. Create a Virtual Environment:

python3 -m venv /home/webui/open-webui-venv

1. Activate the Virtual Environment:

source /home/webui/open-webui-venv/bin/activate

1. Install Open WebUI:

pip install open-webui

---

Step 9: Run Open WebUI as a Service

To make Open WebUI run automatically, create a system service:

1. Create a Service File:

nano /etc/systemd/system/open-webui.service

1. Add the Following Content:

[Unit]
Description=Open WebUI Service
After=network.target

[Service]
User=root
WorkingDirectory=/home/webui/open-webui-venv
ExecStart=/home/webui/open-webui-venv/bin/open-webui serve
Restart=always
Environment="PATH=/home/webui/open-webui-venv/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

[Install]
WantedBy=multi-user.target

1. Save and Exit: Press Ctrl + X, then Y, and Enter.
2. Reload and Start the Service:

systemctl daemon-reload
systemctl enable open-webui.service
systemctl start open-webui.service

---

Step 10: Access Open WebUI

Once the service is running, open your web browser and go to:

http://<your_server_ip>:8080

You’ll see the Open WebUI interface, where you can interact with Qwen2.5 in a user-friendly way.

---

If you’re looking for a reliable hosting solution for your AI projects, consider Shape.Host Linux SSD VPS services. With fast SSD storage, scalable resources, and excellent support, Shape.Host is the perfect choice for running AI models like Qwen2.5. Visit Shape.Host to learn more and get started today!