Huawei officially open source data virtualization engine openlookeng, which can provide a unified SQL interface

Time:2021-9-15

Huawei officially open source data virtualization engine openlookeng, which can provide a unified SQL interface

Technical editor: mango fruit from Sifu editorial department
SegmentFault has he reported the official account number: SegmentFault

Sementfault on July 2, Huawei announced the official open source data virtualization engine openlookeng, which is an open source high-performance data virtualization engine. It can provide a unified SQL interface, cross data source / data center analysis capability and interactive, batch, stream and other integrated query scenarios. At the same time, the capabilities of pre scheduling, cross source indexing, dynamic filtering, cross source collaboration and horizontal expansion are enhanced.

On November 19 last year, Huawei announced that open source data virtualization introduced hetuengine. Openlookeng is its renamed open source version, and its open source community official website has also been launched.

Huawei officially open source data virtualization engine openlookeng, which can provide a unified SQL interface

The problems that openlookeng open source project can solve include: unified SQL interface to access multiple data sources, no data relocation, the ability to process data in the data location, and support cross data center and cross cloud processing. Openlookeng also provides coordinator AA’s highly reliable and scalable data source connector framework, which makes it easier for users and big data solution partners to use openlookeng.

Openlookeng uses presto, the industry’s famous open source SQL Engine, to provide basic capabilities for interactive query analysis, and continues to develop in the integration of scene query, cross data center / cloud, data source expansion, performance, reliability, security, etc.

Huawei official said: “openlookeng is committed to providing a minimalist data analysis experience for big data users, allowing users to use ‘big data’ like using ‘database’.”

At present, Huawei’s open source projects cover all aspects such as deep learning framework, intelligent open data autonomy platform, big data, edge computing, high-performance scheduling engine, etc. Huawei is building an open source community with perfect performance and capability integration.

Official website of open source community:https://openlookeng.io

Huawei officially open source data virtualization engine openlookeng, which can provide a unified SQL interface