Let's talk about grayscale publishing and monitoring of background services

The two courses "Grayscale Release" and "All-round Monitoring" in "The Way of Massive Service" must have been studied by technical colleagues. I think these two methodologies are very characteristic of the industry and Tencent.

Before joining Tencent's QQ backend team, the author worked in the telecommunications industry and financial industry for several years. When I first joined Tencent, I felt that many aspects of technology were refreshing:

• The background system is deployed on a lot of cheap servers, and everyone manages a lot of machines, which makes people feel very accomplished and rich
• There is a relatively accurate equipment budget calculation model, and the performance of each server is usually squeezed to just the right amount under the premise of considering disaster recovery redundancy, and the person in charge will have an in-depth insight into the performance, disaster recovery, flexibility and other aspects of the entire system. It is an honor to be in charge of a massive system
• There are no full-time testers, after the developer's self-test, Grayscale release plus detailed monitoring, the main system will be released almost every two weeks, as a background technician, his work directly affects hundreds of millions of users, a bit of a feeling of holding a nuclear bomb in God's perspective
• The monitoring system (our internal system called monitor) is really very convenient, a curve intuitively displays various indicators of the operation of the entire system, if there are abnormal text messages and phone calls, it will ring, making people feel that everything is under control, there is a feeling of controlling an aircraft carrier in front of a large number of dashboards or fighter jets flying with nuclear bombs.
  
  

Well, hurry up and end the good feeling of programmers, I want to say the main point: grayscale publishing and monitoring are really two essential tools for massive services on the Internet, which can greatly improve the availability and operation level of background services.

Of course, Grayscale release is not just a part of the release of new code, and monitoring is not just as simple as drawing curves and alarm messages, there will be a lot of things in it, and the philosophy behind it is continuous delivery, user testing and control.

Msec is an open source framework for Tencent, and its creative impulse and construction experience come from more than 10 years of operational thinking from the QQ backend team. Grayscale publishing monitoring is an important consideration in the design of millisecond service engines.

On the Service Configuration Management page, click "Develop Release Plan"

Select the target machine and release type to be published by Grayscale this time:

Select the correct version of the configuration file, external library, business plug-in, etc. in the following wizard to complete the release plan:

Next, click the O&M - > Release menu to query all release plans and roll back for published plans. Click Details to view more details about the release plan and execute the release:

Regarding monitoring, in the second article: RPC and routing management, it has been discussed in more detail, so I will not go into detail here, just explain: In addition to some information automatically reported by RPC and the framework itself, it also supports customized reporting information (for example, I want to report the number of logins of level 28 VIP users), and supports setting alarms for fluctuations, maximum values, and minimum values of key indicators:

Grayscale publishing and monitoring are two essential tools for massive services on the Internet, which can greatly improve the availability and operation level of background services, and the philosophy behind it is continuous delivery, user testing, and control. With the Millisecond Service Engine, startup teams can quickly access these two powerful tools. Details are visibleTencent Cloud Service Marketplace、Millisecond Service Engine official website