Apache brpc committer Li Lei: through sharing, talents can constantly step on the shoulders of giants

Time:2021-11-24

In the massive treasure house of the community, we first enjoyed the achievements of open source projects, which greatly improved the development efficiency, so that we don’t have to make detours and build wheels again, and can move forward faster.

——- Li Lei

Apachecon is the official global conference series of the Apache Software Foundation (ASF). As a prestigious open source feast, apachecon has attracted much attention in the open source community and is also one of the well-known activities in the early stage of the open source movement.

As early as 1998, before the establishment of ASF, apachecon has attracted participants at all levels to explore “tomorrow’s technology” in more than 300 Apache projects and their different communities. Also at this session, developers who developed httpd services gathered together and decided to establish the Apache Software Foundation.

Apachecon is held once a year, usually in Europe or North America. It is a great opportunity for Apache developers to communicate, discuss and meet offline. It is also a rare occasion to share ideas and stir up ideas. Show the latest development and emerging innovation of Apache project through hands-on implementation, keynote speech, practical case study, training, hacking activities, etc.

This year, in order to better serve the rapidly growing Apache users and contributors in the Asia Pacific region, the apachecon organizing committee and the apachecon software foundation are pleased to announce that the first apachecon online conference for the Asia Pacific time zone apachecon Asia Conference will be held online from August 6 to 8, 2021.

In order to let everyone know more about open source and apachecon Asia, segmentfault will interview some track chair or conference lecturers to let you know the background of the conference preparation and the stories of these experts.

Today, we bring you an interview with Li Lei, Apache brpc Committee.

Apache brpc committer Li Lei: through sharing, talents can constantly step on the shoulders of giants

The following is the interview with Li Lei by segmentfault:

About Li Lei

Hello, I’m Li Lei, graduated from Xi’an Jiaotong University. At present, I work as an infrastructure engineer, engaged in the research and development of graph database and distributed kV. I’m a committer of Apache brpc (Computing).


Li Lei’s first contact with open source

When I first came into contact with open source, I used MapReduce in Apache Hadoop to implement offline jobs. At that time, in order to optimize the job running time, I optimized a MapReduce job to the task of maponly, but I also encountered some problems at this time. When the mapper task on a machine has been completed, unfortunately the machine is down, and the mapper task that has been completed before will be re executed. The maponly task does not need to be re executed, so there is a lot of room for optimization. Under the guidance of a Hadoop contributor colleague, I completed the repair of this problem and contributed to the community.

In subsequent projects, in order to optimize the RPC cost, I introduced Apache brpc (incubation) into the project, continuously studied and participated in the work of the community, contributed some features, fixed some bugs, deeply participated in the open source community, and gained a lot.


What did individuals and companies gain from participating in open source and contributing to the Apache community?

By participating in open source, in the massive treasure house of the community, we first enjoyed the achievements of open source projects, greatly improved the development efficiency, so that we don’t have to make detours and build wheels again, and can move forward faster. Of course, while enjoying the results, we also actively give back to the community and make modest contributions to the community. During this period, I met many excellent predecessors, learned more in-depth technology in practice, helped many users in the community, and made myself grow faster.


“The Apache way” understood by Li Lei?

The core of “the Apache way” I understand is sharing. Many excellent projects have been shared with the Apache community, and are becoming more and more mature with the joint efforts of a large number of developers in the community. Each developer shares his own innovation, which makes the project take root and thrive in the community. Human progress has always been like this. Through sharing, future generations can continue to step on the shoulders of giants, and this idea is incisively and vividly reflected in the Apache community. The community has accumulated countless wisdom of developers and opened a welcome door to every developer in the world. Everyone can continue to innovate and share on the existing accumulation to drive the rapid development of software technology.


Li Lei and apachecon Asia

The track where I work is inventor, and the topic of my speech is “the practice of byte beating distributed graph database based on brpc”. Bytegraph is a distributed graph database developed by bytegraph. It supports the storage of mega graphs with trillions of edges of data. A single cluster supports tens of millions of read-write QPS, with a total running scale of nearly 10000 servers. In such a large-scale scenario, bytegraph relies on brpc to provide high-performance, easy-to-use and stable RPC framework support. This sharing will introduce bytegraph and brpc, as well as the practical experience of brpc based large-scale distributed systems such as bytegraph.

Brpc is an excellent C + + RPC framework, which has been applied in many companies and scenarios. Of course, some friends may not understand it. I hope to share with you the design idea of brpc, the use experience of brpc and how to solve some possible problems. I hope these experiences can give you some reference and help you in your work.


Join us in apachecon Asia!

There are cutting-edge technologies and excellent ideas in the industry. Come on!


About Apache brpc (incubation)

Apache brpc (incubating) is an excellent industrial C + + RPC framework. It is compatible with a variety of protocols and easy to expand. It has extremely excellent performance, excellent stability and rich peripheral tools. Up to now, many companies, including Baidu, iqiyi, byte beat, BiliBili and so on, have used brpc in a large number of projects. We look forward to brpc helping more projects with your joint efforts. We also welcome you to participate in brpc’s community work and build a world-class RPC framework together. Interested students can contact us by email[email protected], or contact lorinll via wechat.
In addition, you are also welcome to join the byte beating infrastructure. There are industry-leading distributed storage / computing technologies and super large-scale application scenarios. Interested students can also contact me through wechat or email.


Apachecon Asia full agenda address:
https://www.apachecon.com/aca…

Immediate registered address:
https://hopin.com/events/apac…

Apache brpc committer Li Lei: through sharing, talents can constantly step on the shoulders of giants

Recommended Today

Seven solutions for distributed transactions

1、 What is distributed transaction Distributed transaction means that transaction participants, transaction supporting servers, resource servers and transaction managers are located on different nodes of different distributed systems. A large operation is completed by more than n small operations. These small operations are distributed on different services. For these operations, either all of them are […]