Annual open source event Apache con first Chinese feast! The latest progress of these Apache big data open source projects deserves attention

Time:2020-11-26

Annual open source event Apache con first Chinese feast! The latest progress of these Apache big data open source projects deserves attention
(the picture shows the first apachecon conference in 1998)

Apachecon is a well-known open source feast. It is one of the most concerned conferences in the open source field and one of the well-known activities in the early open source movement. Its earliest issue dates back to 1998. At this session, developers of httpd services gathered together and decided to establish the Apache Software Foundation.


Apachecon is sponsored by the Apache Software Foundation and is now held once a year, usually in Europe or North America,It is a great opportunity for Apache developers to communicate, discuss and meet offline, and it is also a rare occasion to share ideas and stir up ideas.

With the development of computer technology, the topics of apachecon are increasing every year, especially the hot big data, which is simply separated and opened independently.

2020 is a special year. Although it has no impact on the overall development of Apache, offline communication cannot be realized. After all, viruses are still rampant, just like other large-scale conferences. This year, we chose to hold online. The advantage of online hosting is to increase the possibility, such as supporting multi language sub forumsThis is the first time that the issue of speaking Chinese has appeared on apachecon。 How can such an opportunity be missed?

From September 29 to October 1, the meeting lasted for three days. The official agenda has been announced. Please visit the official website for details. At the same time, registration is free,Scan QR code to register~

Annual open source event Apache con first Chinese feast! The latest progress of these Apache big data open source projects deserves attention


In the report of Apache foundation for fiscal year 2020, China is the country with the largest number of Apache Software Downloads. More and more open source projects created in China join the Apache incubator and graduate into top projects.

This year’s apacheconIt is the first time that the issue of speaking Chinese has emergedSeveral Chinese open source celebrities will share with you through this conferencebig dataThe editorial department recommends the following topics——

Apache doris-a MPP database supporting rapid analysis of massive data

Topic introductionApache Doris (incubating) is a MPP database that supports rapid analysis of massive data. Since the beginning of its design, Doris has been adhering to the principles of simple operation and maintenance, high efficiency and reliability, and easy to learn and use, providing users with comprehensive and efficient massive data analysis ability.

Since entering the Apache incubator at the end of 2018, Doris has released five major versions, received contributions from more than 100 developers from the community, and has landed and applied in Duojia Internet head enterprises and vertical enterprises.

This sharing mainly includes four parts: Doris’s development history, system architecture, main features and application cases, so as to help the audience have a comprehensive and concrete understanding of Doris. At the same time, this sharing will also introduce the newly released version 0.13 and the new features of 0.14 to be released soon. In the new version, we can see that Doris is exploring the field of batch and real-time unified data warehouse to help simplify the enterprise big data platform architecture.

Finally, it will introduce the current development of Doris community, hoping to help developers join the open source community more conveniently and quickly.

Annual open source event Apache con first Chinese feast! The latest progress of these Apache big data open source projects deserves attention

Guest profileChen Mingyu, a senior R & D Engineer of Baidu, with 6 years of experience in distributed system development, has been focusing on the field of distributed extensible analytical database. He has led and participated in the whole process of Apache Doris from Baidu’s open source to entering the Apache incubator. He is also a PPMC member of Apache Doris.


How does Apache dolphin scheduler support 100000 level daily data task scheduling?

Brief introduction to the topic: Apache dolphin scheduler (incubator) is a distributed and extensible visual big data task scheduling system, which is committed to solving the complex dependency relationship in the big data processing process, so that the scheduling system can be in the data processing processOut of the box

Since entering the Apache incubator in August last year, there have been more than 120 contributors, more than 3000 wechat users, and hundreds of companies such as IBM, meituan and 360 have applied.

This sharing will first introduce the development of the dolphin scheduler community, then we will introduce why we had to repeatedly build wheels to rebuild big data task scheduling, the overall design ideas and considerations of dolphin scheduler, as well as the characteristics and capabilities of dolphin scheduler. Next, we will introduce the evolution process of dolphin scheduler architecture.

In this sharing, I will also talk about the challenges and experiences we have encountered in scheduling big data tasks, share some user cases and usage scenarios, and finally share the process of open source.

Annual open source event Apache con first Chinese feast! The latest progress of these Apache big data open source projects deserves attention

Brief introduction to the authorDai Lidong, director of Yiguan big data platform & Apache dolphin scheduler PPMC, is responsible for the architecture design, technology selection, technical research, talent recruitment and training of tens of billions of data processing chains every day.


New features of Apache carbondata 2.0

Brief introduction to the topicIn June this year, Apache carbondata released version 2.0. Compared with the previous version 1. X, it significantly improved the ability of data access and data analysis, enhanced the Pb level large table index and multidimensional query ability, improved the CDC features, supported the functions of update, delete and merge, and reconstructed MV to support a variety of data formats.

Annual open source event Apache con first Chinese feast! The latest progress of these Apache big data open source projects deserves attention

Guest profileCai Qiang, Huawei engineer, Apache carbondata contributor, has more than 10 years of big data system research and development experience, and has a profound understanding of Hadoop, spark, hive and other big data systems. As the initial member of Apache carbondata project and PMC, responsible for the core architecture design of warehousing and indexing.


In addition to the two recommended andbig dataThe following topics are worth paying close attention to——

  • Apache’s growth in China
  • Members, responsibilities and obligations of new Apache Software Foundation from China
  • From web engineer to Apache API IX PMC member
  • New features of Apache carbondata 2.0
  • Ecarts: can “easy to use” and “strong personalized customization” at the same time? “
  • New features of Apache shardingsphere 5. X
  • How does Apache dolphin scheduler support 100000 level daily data task scheduling? “
  • ” OSS.Chat -The way of Apache is a bridge in China
  • Apache tubemq: a new MQ choice in big data scenarios
  • Apache Doris: an MPP database supporting rapid analysis of massive data

This year, Apache con and other Apache offline face-to-face activities have moved to online, where everyone can participate at home. This conference has a variety of topics, wonderful and common10Theme sharing24Forums170+A speech.

This conference will also hold a Chinese Forum organized by the community and specially designated according to the “Apache way”. Other forums, such as German, Hindi and Spanish, will also be held. You can click [](https://www.apachecon.com/aca… https://www.apachecon.com/acah2020/tracks/View all forum agenda.

You are interested in small partners, hurry to sign up! Let’s broadcast the registration address again:https://hopin.to/events/apachecon-home

Annual open source event Apache con first Chinese feast! The latest progress of these Apache big data open source projects deserves attention

Annual open source event Apache con first Chinese feast! The latest progress of these Apache big data open source projects deserves attention
Annual open source event Apache con first Chinese feast! The latest progress of these Apache big data open source projects deserves attention

Recommended Today

PHP 12th week function learning record

sha1() effect sha1()Function to evaluate the value of a stringSHA-1Hash. usage sha1(string,raw) case <?php $str = “Hello”; echo sha1($str); ?> result f7ff9e8b7bb2e09b70935a5d785e0cc5d9d0abf0 sha1_file() effect sha1_file()Function calculation fileSHA-1Hash. usage sha1_file(file,raw) case <?php $filename = “test.txt”; $sha1file = sha1_file($filename); echo $sha1file; ?> result aaf4c61ddcc5e8a2dabede0f3b482cd9aea9434d similar_text() effect similar_text()Function to calculate the similarity between two strings. usage similar_text(string1,string2,percent) case […]