HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues

Time:2022-11-24

foreword

The “microservice” architecture has been widely spread in recent years and has become very popular, so that open source frameworks and tools related to microservice architecture have become more and more active, such as: Netlix OSS, Dubbo, Apache Thrift, etc. Spring Cloud has also received great attention from architects and developers because of the wide popularity and strong influence of the Spring community in the field of enterprise applications.

brief introduction

Distributed architecture and microservice platform are the key technologies in today’s IT industry, and they are also the core technologies that senior software engineers and system architects must master. This book takes the migration from traditional distributed architecture to container-based microservice architecture as the main line, and comprehensively and thoroughly introduces the knowledge and technologies related to distributed architecture and microservices. This book does not mention the boring theory of distribution at the beginning, but tells a wonderful history of IT development, which focuses on the decline of mainframes and UNIX small machines and the rise of the X86 platform, thus subtly eliciting CPU, memory The distributed evolution process of , network, and storage is precisely the “material basis” on which distributed software systems operate. Then briefly introduces the network foundation necessary for system architecture, and introduces in detail the classic theories, design routines and RPC communication in distributed systems, and deeply discusses memory, SOA architecture, distributed storage, distributed computing, etc. Analysis, and finally introduces the full-text search and message queue middleware in detail, as well as the key content involved in the microservice architecture. This book is an enthusiastic sharing of Leader-us’ many years of architecture experience, and it is mainly aimed at IT professionals who are concerned about distributed architecture and microservices, and who aspire to become powerful architects.

HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues

Friends who need the complete pdf document of this book, directly [click here] to get

Chapter 1 Distributed Systems

The distributed world is a very complex world. No technology exists in isolation, and no technology can adapt to all scenarios. As a distributed system architect or senior R&D personnel, you must learn as much knowledge as possible, master the evolution route of various technologies, and gradually upgrade from a programming madman to a knowledgeable IT expert , Practice and theory go hand in hand, code and page numbers fly together, only in this way can you better achieve the future.

HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues

HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues

HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues

Chapter 2 Weaknesses in the “Knowledge Barrel” – Network Basics

It has been dozens of years since the distributed system was born and developed, and it is accompanied by some very important basic theories. It is these far-reaching basic theories that have laid a solid foundation for distributed systems and created distributed systems. The magnificent buildings in the field. In order to practice martial arts, let us start learning from these classic distributed theories.

HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues

HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues

HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues

Chapter 3 Classical Fundamentals of Distributed Systems

It has been decades since the distributed system was born and developed, accompanied by some very important basic theories. It is these far-reaching basic theories that have laid a solid foundation for the distributed system and created the distributed field. a magnificent mansion. In order to practice martial arts, let us start learning from these classic distributed theories.

HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues

HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues

HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues

Chapter 4 Talking about RPC

Every distributed system is inseparable from multi-process communication issues, including IPC communication between multi-processes on the machine and network-based remote communication technology, which is one of the core and key basic technologies in the distributed system architecture , as far as remote communication is concerned, apart from the remote communication protocols of various special systems such as NFS. FTP, SNMP. SMTP. From communication technology to the once-popular SOAP (Web Service) protocol, and then to the popular HTTP REST. Nowadays, due to the rise of the mobile Internet and the era of big data, various RPC frameworks that support multi-language and high-performance transmission have once again become Hot technology.

HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues

HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues

HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues

Chapter 5 A Deeper Look at Memory

In addition to CPU, memory is probably the most important computing resource. Cache middleware, high-performance data processing systems, and popular big data platforms that have basically become the standard configuration of distributed systems are all inseparable from the in-depth understanding and ingenious use of computer memory. In this chapter we explore this familiar yet complex field.

HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues

HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues

HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues

Chapter 6 In-depth Analysis of Distributed Storage

The distributed file system has always been one of the most important infrastructures in large-scale distributed systems. The most important technology in Hadoop is not MapReduce, but HDFS. In addition to HDFS, Spark can also be used in conjunction with the old distributed file system GlusterFS , and the most important in OpenStack. The subsystem that can operate independently and make money is the distributed object storage system Swif. Today’s hot Docker and Kubernetes container technologies still need distributed file systems to achieve shared storage in batch processing tasks, and more Needless to say, countless e-commerce systems require a distributed file system to store massive photos. Therefore, it is very important for a distributed system architect to master the knowledge and skills related to distributed storage.

HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues

HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues

HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues

Chapter 7 Talking about Distributed Computing

Regardless of the distribution of network, memory or storage, their ultimate goal is to realize the distribution of computing: data flows on each computer node, and each computing node can access the shared data in a certain way. Finally, after distributed computing The output results are persistently stored and output. As the most important capability and goal in distributed systems, distributed computing is also one of the key technologies of big data systems. After years of development and evolution, there are already many mature distributed computing-related open source programming frameworks and platforms for us to choose from. As architects, we should understand and master these frameworks and platforms as much as possible.

HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues

HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues

Chapter 8 Full Text Search and Message Queue Middleware

In the previous chapters, we have learned various basic knowledge and skills necessary to build a distributed system, such as the basic theory of distributed systems, network programming technology, RPC framework, memory computing, distributed file system, distributed computing Frameworks, etc., but it is not enough to just master these contents. We also need to learn and master some middleware in distributed systems. These middlewares are mainly used in some common business scenarios in distributed systems: data full-text retrieval , log and message processing, database sharding, website load balancing, etc. Due to limited space, this chapter only gives a comprehensive introduction to the two widely used and relatively complex middleware, full-text search and message queue.

HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues

HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues

Chapter 9 Microservice Architecture

Microservice architecture is a very popular concept at present. It is not created out of thin air, but is the inevitable result of technological development. Microservice architecture is not a vague and empty term. Its core concepts and architectural principles are real. Although there are no recognized technical standards and draft specifications for microservice architecture, there are already some influential open source frameworks in the industry. Microservice architecture platform, “architect” can choose a suitable microservice architecture platform according to the company’s technical strength and the characteristics of the project, so as to safely implement the microservice transformation or development process of the project.

HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues

HP architects decipher from distributed to microservices, in-depth understanding of RPC, memory, storage, retrieval and other issues