Apachecon’s first Chinese banquet at the annual open source event! The latest progress of these Apache big data open source projects deserves attention

Time:2021-10-1

Apachecon's first Chinese banquet at the annual open source event! The latest progress of these Apache big data open source projects deserves attention
(the picture shows the first Apache con conference in 1998)

Apachecon is a prestigious open source feast. It is one of the meetings that have attracted much attention in the open source community and one of the early well-known activities of the open source movement. Its earliest issue dates back to 1998. At this session, developers who developed httpd services gathered together and decided to establish the Apache Software Foundation.


Apachecon is organized by the Apache Software Foundation and is now held once a year, usually in Europe or North America,It is a great opportunity for Apache developers to communicate, discuss and meet offline. It is also a rare occasion to share ideas and stir up ideas.

With the development of computer technology, the topics of apachecon are also increasing every year, especially the hot big data, which is simply separated and held independently.

2020 is a special year. Although it has no impact on the overall development of Apache, offline communication cannot be realized. After all, the virus is still rampant. Just like other large conferences, it is held online this year. The advantage of online holding is to increase more possibilities, such as supporting multilingual sub forums, you knowThe topic of speaking Chinese is the first time on Apache con。 How can such an opportunity be missed?

The meeting lasted three days from September 29 to October 1. The official agenda has been announced. You can go to the official website to view the details of the agenda. At the same time, the conference is open to registration free of charge,Scan the QR code to register~

Apachecon's first Chinese banquet at the annual open source event! The latest progress of these Apache big data open source projects deserves attention


In the report of Apache foundation for fiscal year 2020, China is the country with the largest number of Apache Software Downloads. More and more open source projects created in China join the Apache incubator and graduate into top projects.

This year’s Apache conThis is the first time that the issue of speaking Chinese has emergedThere will also be several open source celebrities in China who will share and exchange with you through this conferencebig dataThe editorial department recommends the following topics for you——

Apache Doris – an MPP database that supports rapid analysis of massive data

Topic introduction: Apache Doris (incubation) is an MPP database that supports rapid analysis of massive data. Since the beginning of design, Doris has adhered to the principles of minimalist operation and maintenance, high efficiency and reliability, easy learning and easy use, and provided users with comprehensive and efficient massive data analysis capabilities.

Since entering the Apache incubator at the end of 2018, Doris has released five major versions, received contributions from more than 100 developers in the community, and landed and applied in many Internet leading enterprises and vertical enterprises.

This sharing mainly includes four parts: Doris’s development process, system architecture, main features and application cases, so as to help the audience have a comprehensive and concrete understanding of Doris. At the same time, this sharing will also introduce the new features of the just released version 0.13 and the upcoming version 0.14. In the new version, we can see that Doris is exploring the field of batch and real-time unified data warehouse to help simplify the architecture of enterprise big data platform.

Finally, it will introduce the current development of Doris community, hoping to help developers join the open source community more conveniently and quickly.

Apachecon's first Chinese banquet at the annual open source event! The latest progress of these Apache big data open source projects deserves attention

Guest profile: Chen Mingyu, senior R & D Engineer of Baidu, with 6 years of experience in Distributed System R & D, has been focusing on the field of distributed extensible analytical database. He has led and participated in the whole process of Apache Doris from Baidu open source to entering Apache incubator. At the same time, he is also a PPMC member of Apache Doris.


How does Apache dolphin scheduler support the scheduling of 100000 data tasks per day?

Topic introduction: Apache dolphin scheduler (initiator) is a distributed and easily extensible visual big data task scheduling system, which is committed to solving the complex dependencies in the big data processing process and making the scheduling system in the data processing processOut of the box

Since entering the Apache incubator in August last year, there have been more than 120 + contributors, more than 3000 wechat users, and hundreds of applications from IBM, meituan, 360 and other companies.

This sharing will first introduce the development of the dolphin scheduler community, then introduce why we repeated wheel building to rebuild big data task scheduling, the overall design idea and considerations of dolphin scheduler, as well as the characteristics and capabilities of dolphin scheduler, and then introduce the change process of dolphin scheduler architecture.

In this sharing, I will also talk about the challenges and accumulated experience we encountered in big data task scheduling, share some user cases and use scenarios, and finally share the process of open source.

Apachecon's first Chinese banquet at the annual open source event! The latest progress of these Apache big data open source projects deserves attention

Introduction to the author: Dai Lidong, director of Analysys big data platform & Apache dolphin scheduler PPMC, is responsible for the architecture design, technology selection, technology breakthrough, talent recruitment and training of tens of billions of data processing chains every day.


What’s new in Apache carbondata 2.0

Topic introduction: in June this year, Apache carbondata released version 2.0. Compared with the previous version 1. X, it significantly improved data access and data analysis capabilities, enhanced Pb level large table index and multi-dimensional query capabilities, improved CDC features, supported update, delete and merge functions, reconstructed MV, and supported a variety of data formats.

Apachecon's first Chinese banquet at the annual open source event! The latest progress of these Apache big data open source projects deserves attention

Guest profile: Cai Qiang, Huawei engineer, Apache carbondata contributor, has more than 10 years of big data system R & D experience, and has a deep understanding of Hadoop, spark, hive and other big data systems. As an initial member of Apache carbondata project and PMC, I am responsible for the core architecture design of warehousing, indexing and other features.


In addition to the two recommended abovebig dataClosely related topics, as well as the following wonderful contents deserve your attention——

  • Apache’s growth in China
  • New Apache Software Foundation members from China, responsibilities and obligations
  • From web engineer to Apache apisik PMC member
  • New features of Apache carbondata 2.0
  • Echarts: can you “use simple” and “strong personalized customization” at the same time
  • New features of Apache shardingsphere 5. X
  • How does Apache dolphin scheduler support scheduling of 100000 data tasks per day
  • OSS. Chat – the bridge of Apache road in China
  • Apache tubemq: a new MQ choice in the big data scenario
  • Apache Doris: an MPP database that supports rapid analysis of massive data

This year, apachecon and other Apache offline face-to-face activities are transferred to online, and everyone can participate at home. The conference has a variety of topics and a total of10Theme sharing24Forums170+A speech.

The conference will also hold a Chinese Forum spontaneously organized by the community and ad hoc according to the “Apache way”. Others include German, Hindi and Spanish forums, which can be clicked [](https://www.apachecon.com/aca… https://www.apachecon.com/acah2020/tracks/View all forum agendas.

All interested partners, sign up quickly! Here’s the registration address again:https://hopin.to/events/apachecon-home

Apachecon's first Chinese banquet at the annual open source event! The latest progress of these Apache big data open source projects deserves attention

Apachecon's first Chinese banquet at the annual open source event! The latest progress of these Apache big data open source projects deserves attention
Apachecon's first Chinese banquet at the annual open source event! The latest progress of these Apache big data open source projects deserves attention