Tag：data warehouse
-
Time：2021-7-29
Background and challenges Before the emergence and popularization of object storage technology, HDFS (Hadoop distributed file system) was one of the few open source, free and cost-effective Pb storage systems in the market (compared with expensive San systems), which was widely used in enterprise data archiving scenarios. At the same time, many distributed computing frameworks […]
-
Time：2021-7-13
Introduction: This article will talk about how to build a unified data service accelerated real-time data warehouse based on Flink + hologres. Author: Chen Jianxin, development engineer of call technology data warehouse, currently focuses on the integration of offline and real-time architecture of call technology big data platform. Shenzhen call Technology Co., Ltd. (hereinafter referred […]
-
Time：2021-7-13
How to transform specific requirements or projects into implementable solutions, how to carry out requirements analysis, architecture design, detailed model design, etc., are the contents of discussion in the process of model implementation. This section first briefly introduces the model implementation process commonly used in the industry, and then focuses on Alibaba onedata model design […]
-
Time：2021-7-12
Flink, popular in recent years, is one of the most recognized big data computing engines; As an open-source newsql database, tidb is well received by the industry for its excellent horizontal expansion ability and high availability. So when Flink meets tidb, what kind of spark will it produce? Apache Flink community meetup Beijing station is […]
-
Time：2021-6-26
Related knowledgeHive is the basic component of data warehouse application in big data technology cluster, and it is the benchmark of other similar data warehouse applications. Basic data operations can be processed by hive client in script mode. If you need to develop applications, you need to use hive’s jdbc driver to connect.Hive jdbc driver […]
-
Time：2021-6-18
With the rapid development of the Internet, there will be more and more types of business and more business data. When it develops to a certain scale, the traditional data storage structure can not meet the needs of enterprises, and the real-time data warehouse has become a necessary basic service. Taking the dimension table join […]
-
Time：2021-6-17
This article is reproduced fromhttps://mp.weixin.qq.com/s/Il… background Data lake and data Lakehouse seem to have become the hottest buzzwords in the field of big data. When we accept these buzzwords, as technicians, we often ask, is this a new technology, or is it just a conceptual renovation (new bottles and old wine)? What problems does it […]
-
Time：2021-6-9
When this era comes, it’s absolutely invincible. All things grow wantonly, dust and dawn rise, rivers gather into rivers, nameless hills rise as peaks, and the world is extremely open for a moment. ——Wu Xiaobo’s thirty years of agitation From rope binding to quantum computing,From flying pigeons to the interconnection of all things,The scenery on […]
-
Time：2021-5-13
With the development of China’s modern society, the rapid rise of E-commerce makes China’s commerce enter an intelligent era. More and more enterprises begin to pay attention to the intelligent information system, and hope to apply the intelligent information system project management to promote the upgrading of enterprise services, improve the sales volume of enterprise […]
-
Time：2021-5-13
Introduction:On March 24, 2021, Forrester, the global authoritative it analysis organization, released the latest cloud data warehouse Research Report – “the Forrester wave: cloud data warehouse Q1 2021”. Alibaba cloud became the only Chinese cloud manufacturer selected for this evaluation. Alibaba cloud data warehouse, with “analyticdb” as one of the core representatives, has created the […]
-
Time：2021-5-12
ETL, the abbreviation of English extract transform load, is used to describe the process of extracting, transforming and loading data from the source to the destination. ETL is an important part of building a data warehouse. The user extracts the required data from the data source, cleans the data, and finally loads the data into […]
-
Time：2021-5-6
This paper is shared by Ju Dasheng, a researcher of meituan and the person in charge of real-time computing. It mainly introduces the application practice of Flink in the incremental production of meituan data warehouse. The contents include: Data warehouse incremental production Streaming data integration Streaming data processing Application of streaming OLAP Future planning 1、 […]
