Alibaba cloud maxcompute July 2021 issue

Time:2021-11-29

Introduction:Maxcompute’s July issue will take you to know about the latest project deletion, SQL performance optimization recommendation and other functions released in July, as well as the wonderful live courses in July and August. Welcome to read.

This issue of the monthly magazine will bring youMaxComputeThe latest product trends in July.

Reading guide

  • Latest product release in July
  • Best practice good article recommendation
  • Review of technical live broadcast in July
  • Technical live broadcast forecast in August

Latest product release in July

1. Maxcompute project delete new function Publishing Investigation documents > >

Applicable customer

Big data developers and managers

Publishing function

Maxcompute supports “through maxcompute console – item list – more operations” to delete items. It provides two deletion methods: “logical deletion, recoverable within 15 days” and “immediate deletion”. After selecting immediate deletion, you can immediately create an item with the same name.

Method 1: logical deletion. After deletion, the item is unavailable and can be recovered within 15 days (including data recovery). After 15 days, it will be completely deleted and permanently unrecoverable.

Method 2: immediately delete, completely delete, and permanently unrecoverable. After deletion, you can immediately create an item with the same name.

2、Maxcompute housekeeper publishes new SQL performance optimization recommendations View document > >

Applicable customer

It is applicable to developers and audit operation and maintenance personnel who develop big data through maxcompute

Publishing function

Maxcompute housekeeper regularly recommends a list of jobs that need performance or cost optimization. This time is mainly for “SQL periodic jobs including joins that are suitable for enabling dynamic filter for performance optimization”. The recommended result list will give the latest instance ID (click to enter logview) and the number of input and output of the join. At the same time, it will predict the acceleration efficiency of SQL optimized by dynamic filter and the auxiliary information of hint mode. It is convenient to obtain the work information to be optimized and judge whether the job needs to be optimized through the information. If you think there is a job in the recommended list that does not need to be optimized, you can unsubscribe from this job.

3、Maxcompute SQL subquery supports multi column operationgrammarView document > >

Applicable customer

Big data developer, analyst

Publishing function

Maxcompute SQL is compatible with PostgreSQL subquery syntax. In subquery / scalar subquery syntax supports multi column operation. In type subquery syntax supports the expression of in in in where statement. Value is a simple multi column select, or value contains an aggregate function, or value is multiple constants. Scalar type subquery syntax supports the equivalence comparison expression of multi column scalar subquery in the select statement, or the Boolean expression of equivalence comparison between multi column and scalar subquery in the select statement, or the equivalence comparison expression between multi column and scalar subquery in the where statement.

4、Maxcompute SQL supports pre sorting some aggregate function inputs View document > >

Applicable customer

Developers, analysts

Publishing function

Maxcompute SQL supports WM\_ CONCAT、COLLECT\_ List and udaf input pre sort.

Aggregate function WM for maxcompute SQL\_ CONCAT, COLLECT\_ List and udaf functions sensitive to data input order. If the row sequence with group (order by col1 [, col2…]) is specified, the input of the aggregation function will be orderly.

Best practice good article recommendation

Review of technical live broadcast in July

2021 Alibaba big data technology open class first quarter – External tools connect SaaS mode cloud data warehouse maxcompute actual combat

“Lecture 1” business Bi analysis tool  Live playback > >

Lecture 2: open source Bi analysis tools & database management toolsLive playback > >

“Lecture 3” ETL toolsLive playback > >

Technical live broadcast forecast in August

2021 Alibaba big data technology open class Season 2 – SaaS mode cloud data warehouse maxcompute application scenario practice

Alibaba cloud maxcompute July 2021 issue

Copyright notice:The content of this article is spontaneously contributed by Alibaba cloud real name registered users, and the copyright belongs to the original author. Alibaba cloud developer community does not own its copyright or bear corresponding legal liabilities. Please refer to Alibaba cloud developer community user service agreement and Alibaba cloud developer community intellectual property protection guidelines for specific rules. If you find any content suspected of plagiarism in the community, fill in the infringement complaint form to report. Once verified, the community will immediately delete the content suspected of infringement.