How to Build SaaS Infrastructure: From a Single Server to a Cluster

Building a SaaS infrastructure begins with choosing a basic VPS that scales from a single server to a distributed cluster as your project grows, ensuring fault tolerance and performance.

Why is SaaS Infrastructure Scaling Critically Important?

Developing a SaaS product is only half the battle. Success largely depends on how effectively your saas infrastructure setup handles growing loads, ensures stability, and minimizes costs. A poorly designed or inflexible infrastructure can lead to service slowdowns, downtime, customer loss, and a significant increase in operational expenses. Scaling allows you to smoothly adapt to changing requirements, maintaining high service quality and managing your budget.

Stage 1: Monolith on a Single VPS – A Quick Start for Your SaaS

When is this suitable?

In the initial stage, when you have a limited budget, a small team, and a relatively low predicted load (up to 100-200 active users), launching your SaaS on a single Virtual Private Server (VPS) is the most reasonable solution. This allows you to quickly deploy the product, test hypotheses, and acquire your first customers without significant investment in your SaaS infrastructure.

SaaS Server Architecture on a Single VPS

In this configuration, all components of your SaaS — web server (Nginx, Apache), application server (Node.js, Python/Django/Flask, PHP/Laravel, Ruby on Rails), database (PostgreSQL, MySQL), and possibly background tasks — are hosted on a single VPS. This simplifies deployment and management but creates a single point of failure and limits performance scaling capabilities.

Example Technology Stack:

• OS: Ubuntu Server 22.04 LTS
• Web Server: Nginx
• Database: PostgreSQL 15
• Runtime Environment: Node.js 18 / Python 3.10 / PHP 8.2
• Application: Docker container with your SaaS application

For such a scenario, Valebyte offers basic VPS plans. For example, VPS-2:

• 2 vCPU (Intel Xeon E-2388G, up to 5.1 GHz)
• 4 GB RAM
• 50 GB NVMe SSD
• 1 Gbps port
• Approximate price: from $10/month

Example of basic Nginx and Docker installation:

# Update the system
sudo apt update && sudo apt upgrade -y

# Install Docker
sudo apt install docker.io docker-compose -y
sudo systemctl start docker
sudo systemctl enable docker

# Install Nginx
sudo apt install nginx -y
sudo systemctl start nginx
sudo systemctl enable nginx

# Example Nginx configuration for proxying to a Docker container
# sudo nano /etc/nginx/sites-available/your_saas_app
server {
    listen 80;
    server_name yourdomain.com www.yourdomain.com;

    location / {
        proxy_pass http://localhost:3000; # Your Docker container port
        proxy_set_header Host $host;
        proxy_set_header X-Real-IP $remote_addr;
        proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
        proxy_set_header X-Forwarded-Proto $scheme;
    }
}
# sudo ln -s /etc/nginx/sites-available/your_saas_app /etc/nginx/sites-enabled/
# sudo nginx -t && sudo systemctl reload nginx

Stage 2: Role Separation – VPS for Application and Separate DB Server

Advantages of Separation

As the number of users grows and the load increases, a single server starts to "choke." Most often, the database becomes the bottleneck. Separating the application server and the database server onto two distinct VPS instances is the next logical step. This significantly improves performance, security, and manageability:

• Performance: The database receives dedicated resources (CPU, RAM, disk I/O) without competing with the application.
• Scalability: You can scale the application and database independently of each other.
• Security: Database access can be restricted to only the IP address of the application server.
• Reliability: A failure of one server does not necessarily lead to a complete system failure (e.g., if only the web server goes down, the database remains accessible).

Optimal Infrastructure for Mid-Scale SaaS

This is the ideal SaaS infrastructure for projects that have reached a growth stage, with hundreds or thousands of active users. A dedicated database server (especially with NVMe SSD) provides significantly higher query processing speeds. The application server can be optimized for executing business logic and handling HTTP requests.

Valebyte Recommendations for Stage 2:

• VPS for application (e.g., Valebyte VPS-4):
  • 4 vCPU (Intel Xeon E-2388G)
  • 8 GB RAM
  • 100 GB NVMe SSD
  • Approximate price: from $20/month
• VPS for database (e.g., Valebyte VPS-6 or VPS-8 for heavier DBs):
  • 6-8 vCPU (Intel Xeon E-2388G)
  • 16-32 GB RAM
  • 200-400 GB NVMe SSD
  • Approximate price: from $40-$80/month

It is important to configure the firewall on the database server to accept connections only from the IP address of the application server and, if necessary, from your local IP for administration.

# On the DB server: allow access only from the application server's IP
sudo ufw allow from [APPLICATION_SERVER_IP_ADDRESS] to any port 5432 comment 'Allow app server to PostgreSQL'
sudo ufw enable

Stage 3: Cluster Architecture – Fault Tolerance and High Performance

When is a cluster needed?

When your SaaS serves thousands and tens of thousands of active users, and downtime becomes unacceptable, it is necessary to build a SaaS infrastructure based on a cluster architecture. This ensures high availability, fault tolerance, and the ability to handle peak loads without performance degradation.

Building a SaaS Infrastructure for Scaling

Cluster architecture implies distributing the load among several servers. Key components:

• Load Balancer: Distributes incoming requests among multiple application servers. This can be Nginx, HAProxy, or cloud solutions.
• Multiple Application Servers: Duplicate functionality, providing horizontal scaling.
• Database Cluster: Replication (Master-Slave, Master-Master) for fault tolerance and read load distribution.
• Caching Systems: Redis, Memcached to reduce database load.
• Message Queues: RabbitMQ, Kafka for asynchronous task processing.
• Shared File Storage: S3-compatible storage or a distributed file system.

At this stage, dedicated servers or high-performance VPS with large amounts of RAM and powerful CPUs are often used.

Valebyte Recommendations for Stage 3:

• Load Balancer (minimum 1, preferably 2 for fault tolerance):
  • VPS-2 or VPS-4 (2-4 vCPU, 4-8 GB RAM)
  • Approximate price: from $10-$20/month for each
• Application Servers (minimum 2, scaled as needed):
  • VPS-8 (8 vCPU, 32 GB RAM, 400 GB NVMe) or dedicated server (e.g., Valebyte E3-1270v6, 4C/8T, 32 GB RAM, 2x480 GB NVMe)
  • Approximate price: from $80/month for VPS, from $100/month for dedicated server
• Database Servers (minimum 2 for replication):
  • VPS-8 (8 vCPU, 32 GB RAM, 400 GB NVMe) or dedicated server (e.g., Valebyte E3-1270v6, 4C/8T, 32 GB RAM, 2x480 GB NVMe)
  • Approximate price: from $80/month for VPS, from $100/month for dedicated server
• Caching/Queue Servers:
  • VPS-2 or VPS-4 (2-4 vCPU, 4-8 GB RAM)
  • Approximate price: from $10-$20/month for each

Example Nginx configuration as a load balancer:

# sudo nano /etc/nginx/nginx.conf (in the http section)
upstream backend_app {
    server app_server_1.yourdomain.com:3000 weight=5; # IP or domain of the first application server
    server app_server_2.yourdomain.com:3000 weight=5; # IP or domain of the second application server
    # Add more servers as needed
    # ip_hash; # For sticky sessions, if required
}

# sudo nano /etc/nginx/sites-available/your_saas_lb
server {
    listen 80;
    server_name yourdomain.com www.yourdomain.com;

    location / {
        proxy_pass http://backend_app;
        proxy_set_header Host $host;
        proxy_set_header X-Real-IP $remote_addr;
        proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
        proxy_set_header X-Forwarded-Proto $scheme;
    }
}

Choosing SaaS Hosting: Why Valebyte?

The right SaaS hosting setup is the foundation of your business. Valebyte offers high-performance VPS and dedicated servers that are ideal for every stage of your SaaS infrastructure development. Our advantages:

• Powerful Hardware: Modern Intel Xeon E-2388G processors with high clock speeds (up to 5.1 GHz) and NVMe SSDs ensure maximum performance for your applications and databases.
• Flexibility and Scalability: A wide selection of VPS plans and dedicated servers allows you to precisely match resources to current needs and easily scale as you grow.
• Reliable Network: High-speed 1 Gbps ports and DDoS protection guarantee stable operation of your service.
• Location: Servers in the Netherlands provide optimal latency for a European audience.
• Support: Expert 24/7 technical support is ready to assist with any infrastructure-related questions.

Comparison of Valebyte Servers for Different SaaS Stages

Best Practices for SaaS Infrastructure Setup

1. Monitoring: Implement comprehensive monitoring systems (Prometheus, Grafana, Zabbix) to track the performance of servers, applications, and databases. This will allow timely identification of bottlenecks.
2. Automation: Use automation tools (Ansible, Terraform, Docker Compose) for deploying, configuring, and managing your infrastructure. This will reduce operational time and decrease the likelihood of errors.
3. Backup: Set up regular automatic backups of all critical data and configurations. Store backups in multiple independent locations.
4. Security: Regularly update software, use firewalls, VPN for access to admin panels, strong password policies, and two-factor authentication. Conduct security audits.
5. CI/CD: Implement Continuous Integration and Continuous Delivery (CI/CD) processes to automate the building, testing, and deployment of your SaaS.
6. CDN Usage: For static content (images, CSS, JS), use a Content Delivery Network (CDN) to speed up content delivery to users worldwide and reduce the load on your servers.
7. Logging: Centralized logging (ELK Stack, Loki) will help quickly diagnose problems and track user behavior.

Conclusion

An effective SaaS infrastructure setup is not a one-time action but a continuous process of adaptation and scaling. Starting with a simple VPS and gradually moving to distributed clusters, you can ensure reliability and high performance for your SaaS. Valebyte offers flexible and powerful solutions that will support your project at any stage of growth.