How to improve the QPS and throughput of the system

Simply put, increasing qps and throughput by adding clusters is actually more complicated than this

First we need to know the bottlenecks of the system

What we Known system topology

For the rest interface, the system facilities are:

dns -gt; nginx -gt; tomcat -gt; db/soa

Secondly, considering the issue of load balancing, we can use other facilities to ensure the load balancing of cluster nodes and further improve the system qps

So there is:

You can add it at the application layer For caching, you can use redis to add cache. For the network, you can use cdn

Add clusters and load balancing separately for the bottleneck system to solve the problem

Because when a single table exceeds 10 million pieces of data, It is very slow, so at this time library splitting is needed, so there are vertical splitting and horizontal splitting.

For example, sending text messages, sending emails, etc.

Cluster load balancing

Increasing cache

System split

Sub-database and sub-table

Vertical split and horizontal split

Asynchronous MQ