Tag：big data
-
(2) Flink CEP SQL Strict Neighborhood Code Demonstration – A Tool for Building a Risk Control System
In the previous article, we gave a brief introduction to Flink CEP. In this article, we will demonstrate the strict neighbor effect in Flink CEP SQL through code:(1) Pom dependencies:<dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-cep_${scala.binary.version}</artifactId> <version>${flink.version}</version> </dependency>(2) Define a message object public static class Ticker { public long id; public String symbol; public long price; public long tax; […]
-
Live streaming reservation Lake Warehouse service, the end of Big data? This open source launch is for you!
【Click to sign up now】August 11th, NetEase Shufan will hold “Enterprise-level streaming lake warehouse service Arctic Open Source Conference“, invited Netease Shufan’s big data product line and relevant partners to jointly interpret the thinking on the evolution of data technology and Arctic open source, introduce the progress of the Arctic project, future development and community […]
-
Graphical Big Data | Spark Machine Learning (Part 2) – Modeling and Hyperparameter Tuning
author:Han [email protected] address：http://www.showmeai.tech/tutorials/84Address of this article：http://www.showmeai.tech/article-detail/181Disclaimer: All rights reserved, please contact the platform and the author for reprinting and indicate the source 1. Classification, regression and clustering models 1) Overview of classification algorithms Classification is an important machine learning and data mining technique. The purpose of classification is to construct a classification function or classification […]
-
[Zhao Yuqiang] The new book “Big Data Principles and Practical Combat” is on the market! ! !
After nearly a year of waiting, the new book “Big Data Principles and Practice” is on the market! ! Sneak peek! ! ! Click here for details Click here for details Click here for details Click here for details Click here for details Click here for details Click here for […]
-
(3) Flink CEP SQL loose neighbor code demonstration
In the previous article, we demonstrated the effect of the strict neighbor mode, and then in the previous article, we will demonstrate the relaxed neighbor: (1) pom dependency:<dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-cep_${scala.binary.version}</artifactId> <version>${flink.version}</version> </dependency>(2) Define a message object public static class Ticker { public long id; public String symbol; public long price; public long tax; public LocalDateTime […]
-
Graphical Big Data | Spark GraphFrames-Graph-Based Data Analysis and Mining
author:Han [email protected] address：http://www.showmeai.tech/tutorials/84Address of this article：http://www.showmeai.tech/article-detail/182Disclaimer: All rights reserved, please contact the platform and the author for reprinting and indicate the source 1. Introduction to GraphFrames Databricks, UC Berkeley and MIT jointly developed a graph processing library for Apache Spark called GraphFrames. This class library is built on top of DataFrame, which can not only […]
-
Accelerated skills! Teach you to configure and run Hive Metastore and Presto on your computer within 10 minutes
Author: Fan Bin; Founding Member of Alluxio, Vice President of Open Source Community To beginners: This tutorial will guide beginners to query data on S3 by building Presto and Hive Metastore on the local server.Presto is a SQL engine for planning and executing queries, S3 provides storage services for table partition files, and Hive Metastore […]
-
(4) Demonstration of Flink CEP SQL greedy word volume
Based on the extension of the previous (3) Flink CEP SQL loose neighbor code demonstration, in the previous article we used greedy word size + (matching at least 1 or more lines), this article will demonstrate the effect of various greedy word sizes:(1) Use greedy word size * (match 0 or more lines) public static […]
-
Databricks Enterprise Edition Spark&Delta Lake Engine Helps Lakehouse Efficient Access
Introduction: This article introduces the performance advantages of Databricks Enterprise Edition Delta Lake. With these features, the query performance of Spark SQL can be greatly improved and the query speed of Delta tables can be accelerated. author: Li Jingui (Jinxi) Alibaba Cloud Open Source Big Data Platform Development Engineer Wang Xiaolong (Xiaolong) Alibaba Cloud Open […]
-
[Teacher Zhao Yuqiang] Employment salary statistics of previous students, looking forward to the 01st course of Oracle
[Teacher Zhao Yuqiang] Employment salary statistics of previous students, looking forward to the 01st course of Oracle
-
Big data training: Spark performance tuning and parameter configuration
Spark Performance Tuning – Basics As we all know, correct parameter configuration is of great help to improve the efficiency of Spark, and helps related data developers and analysts to use Spark more efficiently for offline batch processing and SQL report analysis. The recommended parameter configuration template is as follows: spark-submit submission method script/xxx/spark23/xxx/spark-submit –master […]