Self built hive data warehouse Cross Version migration to Alibaba cloud databricks data insight

Time:2022-5-25

Introduction:Customers build their own Hadoop cluster in IDC or public cloud environment, build data warehouse and analysis system, and purchase Alibaba cloud databricks data insight cluster, which involves the migration of data warehouse data and metadata and the revision and update of hive version.

Best practices:【Self built hive data warehouse Cross Version migration to Alibaba cloud databricks data insight
Best practices channel:【Best practices channel
There are rich best practices for enterprises to go to the cloud. Starting from typical scenarios, we provide a series of project practice schemes to reduce the threshold for enterprises to go to the cloud and meet your needs at the same time!

Scene description

Customers build their own Hadoop cluster in IDC or public cloud environment, build data warehouse and analysis system, and purchase Alibaba cloud databricks data insight cluster, which involves the migration of data warehouse data and metadata and the revision and update of hive version.

Practical advantages

  • The fully managed spark cluster is free of operation and maintenance, saving labor costs.
  • Databricks data insight is deeply integrated with other Alibaba cloud products (OSS, RDS, maxcompute, EMR) to support the input and output of these products as data sources.
  • Using the commercial version of databricks runtime engine can improve the performance of open source spark by 3-5 times.

Product list

  • Databricks data insights
  • ECS
  • File storage HDFS
  • Object storage OSS
  • VPC

Business architecture

Self built hive data warehouse Cross Version migration to Alibaba cloud databricks data insight

Best practices

Copyright notice:The content of this article is spontaneously contributed by Alibaba cloud real name registered users, and the copyright belongs to the original author. Alibaba cloud developer community does not own its copyright or bear corresponding legal liabilities. Please refer to Alibaba cloud developer community user service agreement and Alibaba cloud developer community intellectual property protection guidelines for specific rules. If you find any content suspected of plagiarism in the community, fill in the infringement complaint form to report. Once verified, the community will immediately delete the content suspected of infringement.