What are the major changes to the upcoming Flink 1.11?

Time:2020-8-18

On June 14, the computing platform business unit and Alibaba cloud developer community jointly held theThe first big data + AI meetup will be launchedA number of technical experts from Ali, Databricks, Kwai Fu and NetEase cloud music gathered here to discuss the hot topics of big data and AI.

What are the major changes to the upcoming Flink 1.11?

Meetup essence

  1. Core developers of big data hot open source software such as Flink 1.11, spark 3.0, alink 1.1.1 help you circle the latest version focus
  2. What can real-time data warehouse, data lake and HSAP architecture do
  3. Kwai Tat quick project, NetEase cloud music Flink + Kafka landing experience is exclusive.
  4. Super luxury guests, live room has prepared a variety of exquisite gifts, live delivery

How to watch

  • Time: 10:00-18:00, June 14
  • Live booking link: https://developer.aliyun.com/…

Tips:For more information about meetup, you can scan the QR code below for group consultation.

<p style=”text-align:center”>What are the major changes to the upcoming Flink 1.11?
</p><p style=”text- align:center “> (big data + AI meetup communication group)</p>

<p style=”text-align:center”>A welfare</p>

Forward this article to the circle of friends to participate in the lottery, 10 Flink paper learning materials waiting for you! Scan wechat code and contact squirrels to participate in the lottery:
<p style=”text-align:center”>What are the major changes to the upcoming Flink 1.11?</p>

<p style=”text- align:center “> {meetup complete agenda}</p>

<p style=”text-align:center”>What are the major changes to the upcoming Flink 1.11?
</p>

The agenda of this meetup afternoon is as follows.

01 practical application of Flink + Kafka in Netease cloud music

Yue Meng, R & D Engineer of Netease cloud music real time computing platform

What are the major changes to the upcoming Flink 1.11?

Introduction to the speech:

This sharing mainly introduces the application practice of cloud music based on Flink + Kafka, including the management and use of Kafka stream table metadata, the construction of real-time data distribution function using Flink + Kafka, and some strategies and thoughts under the scenario of building real-time features based on Flink + Kafka.

02 how delta Lake helps cloud users solve the problem of real-time data warehousing

Xin Yong, technical expert of Alibaba

What are the major changes to the upcoming Flink 1.11?

Introduction to the speech:

Delta lake has been widely concerned in the industry since its release. Its acid support, historical version backtracking, update / delete / merge into syntax support and other functions perfectly meet the user’s requirements for data Lake content management. The flow batch integration design of multi hop architecture greatly simplifies the cost of user operation and maintenance data pipeline, and makes the traditional ETL process evolve into more flexible ELT + process.
In this speech, we will share how EMR uses delta lake to help users solve the problem of real-time data warehousing, and what useful improvements and explorations have been made to delta Lake in the process.

Real time link protection practice for Kwai Fu evening activities

Liu Jiangang Development Engineer Kwai

What are the major changes to the upcoming Flink 1.11?

Introduction to the speech:

This sharing mainly introduces the guarantee work of the Kwai Fu interior to ensure the real-time link business needs of the 2020 Spring Festival Gala. It includes: real-time task classification support scheme, overall link stability guarantee, and typical business scenarios and pressure test support scheme. Finally, under a series of support, the real-time link successfully withstood the pressure of the Spring Festival Gala, and the guarantee activities were successfully completed.

04 in depth interpretation of Flink 1.11 table & SQL

Li Jinsong (Zhixin) | Alibaba technology expert

What are the major changes to the upcoming Flink 1.11?

Introduction to the speech:

Flink SQL 1.11 is also a greatly improved version. It has completed a number of features to improve the ease of use and function of SQL. It not only enhances the ease of use and flexibility in the field of stream processing, but also greatly develops the role of Flink in the unified framework of streaming batch. The main contents are as follows:

  1. DDL ease of use
  2. Change table refactoring
  3. Hive Streaming Source&Sink&Join
  4. Hive DDL Dialect
  5. Filesystem connector

The above is a detailed introduction to the topic of this afternoon meetup. At 10:00 on June 14, big data + AI meetup live room is looking forward to your arrival. There are more exquisite gifts. You can get them by participating in the interaction! Click the link below to book meetup live ~

<u> Meet up live
https://developer.aliyun.com/…