Tag：fault
-
Time：2021-5-9
Redis Cluster Before learning redis cluster, let’s first understand why we need cluster. When we encounter single machine memory, concurrency, traffic and other bottlenecks, the single machine can no longer meet the requirements of our node 7000 and 7001, we can use cluster architecture to achieve load balancing. Introduction to data partition The distributed database […]
-
Time：2021-5-2
Technical editor: mango fruitSegmentFault has he reported the official account number: SegmentFault According to foreign media reports, yesterday afternoon Pacific time, IBM cloud broke down, causing many websites to lose response. The IBM page is also inaccessible IBM’s own status page is also hosted in An internal server error occurred on IBM cloud. According […]
-
Time：2021-4-29
Source code:GitHub. Click here || Gitee. Click here 1、 HDFS high availability 1. Basic description In the case of single node failure or a few nodes failure, the cluster can also provide normal services. HDFS high availability mechanism can eliminate single node failure by configuring two namenodes active / standby to realize hot standby of […]
-
Time：2021-4-19
HDFS high error tolerance mechanism Summarize the above links For the three kinds of faults, corresponding to a variety of measures Node failed If the namenode fails, the whole cluster will hang up in the non highly available version If the datanode fails, it can detect whether it works normally by sending heartbeat signals to […]
-
Time：2021-4-10
This project uses Java data processing process developed by spring MVC + native JDBC, and uses Oracle database.The overall contents of the project are as follows: The message middleware used in the project mainly includes ActiveMQ and Kafka. This article mainly introduces Kafka Kafka data is divided into producers and consumers. The producer defines a […]
-
Time：2021-4-9
Fail over In other words, when the active service or application is terminated unexpectedly, the redundant or standby server, system, hardware or network can be quickly enabled to replace them. For example, if multiple services are attached to a load balancer, if a request occurs, the load balancer can automatically switch to another service Failback […]
-
Time：2021-4-3
1、 Preface In the last article, we discussed Kafka’s workflow, storage mechanism and partition strategy, and clarified how the data produced by producers are stored and how to query data according to offsetKafka (1): workflow, storage mechanism, partition strategy So how does Kafka ensure data reliability? How to guarantee the accuracy of exactly only? How […]
-
Time：2021-4-1
Nowadays, many new applications are data intensive rather than compute intensive. For these types of applications, the processing power of CPU is often not the first limiting factor. The key lies in the amount of data, the complexity of data and the rapid variability of data. Each application module is usually built based on a […]
-
Time：2021-3-18
Abstract:Kwai Kwai Development Engineer Liu Jiangang shared the practice of real-time link protection under the Spring Festival Gala. The content mainly includes the following four parts Introduction to Kwai Flink Real time guarantee scheme for Spring Festival Gala Spring Festival Gala real time big screen Future planning Tips：Click the “read the original” link to view […]
-
Time：2021-3-14
Click to share Status quo of it operation and maintenance alarm At present, the main method to ensure the normal operation of the IT operation and maintenance field is to monitor the relevant operation and maintenance indicators in real time, and set some rules according to the experience. By comparing the real-time monitoring data with […]
-
Time：2021-3-12
1、 Kafka command line operation 1.1 create topic [[email protected] kafka]$ bin/kafka-topics.sh –zookeeper hadoop10:2181 –create –replication-factor 2 –partitions 1 –topic first Created topic first. 1.2 View topic [[email protected] kafka]$ bin/kafka-topics.sh –zookeeper hadoop10:2181 –list demo first 1.3 deleting topic [[email protected] kafka]$ bin/kafka-topics.sh –zookeeper hadoop10:2181 -delete –topic first Topic first is marked for deletion. Note: This will have […]
-
Time：2021-3-10
Under the pressure of this year’s epidemic, almost all enterprises realize that digital transformation has become an inevitable trend. Enterprises are no longer entangled in the multiple-choice question of “no transformation, no death, no good transformation”, but begin to firmly look for the goal and method of digital transformation. Huidu“Experts 1-to-1, helping 2021 enterprises to […]
