Tag:streaming

  • Are you still using pagination? Try mybatis streaming query, really powerful!

    Time:2021-3-25

    Basic concepts Streaming query means that after a successful query, it does not return a collection, but an iterator. The application gets a query result from the iterator each time. The advantage of streaming query is that it can reduce memory usage. If there is no streaming query, if we want to get 10 million […]

  • Kafka actual combat: (4) detailed explanation of Kafka stream

    Time:2021-3-23

    1、 Background of Kafka stream 1. Introduction to Kafka stream It provides the function of stream processing and analyzing the tree stored in Kafka Kafka stream features: Kafka stream provides a very simple and lightweight library, which can be easily embedded in any Java application, or packaged and deployed in any way There are no […]

  • Kafka stream introduction and basic application (including case)

    Time:2021-3-20

    catalog 1. Background of Kafka stream 1.1 what is Kafka stream 1.2 what is flow computing 1.3 why Kafka stream 2. How Kafka stream solves key problems in streaming system 2.1 ktable and ksteam 2.2 time 2.3 window 3. Kafka stream application example 3.1 case 1: write the data of topic a to topic B […]

  • Kwai based optimization based on Apache Flink

    Time:2021-3-20

    This is Kwai Tai teacher Liu Jiangang, which is divided into three parts. First, the basic concepts of streaming computing are introduced, then the key technologies of Flink are introduced. Finally, some applications of Flink in Kwai do production practice are introduced, including real-time index calculation and fast failover. 1、 Introduction of flow calculation Stream […]

  • Using named pipes to host grpc

    Time:2021-3-8

    Grpc is very popular recently. I feel that the whole RPC can’t keep up with the fashion without grpc. Grpc design Grpc is a high performance language independent framework for remote procedure call (RPC). Just need to use a RPC application system, naturally focus on it, but can it really solve all the problems? Not […]

  • How does mybatis implement streaming query?

    Time:2021-3-6

    Basic concepts Streaming query means that after a successful query, it does not return a collection, but an iterator. The application gets a query result from the iterator each time. The advantage of streaming query is that it can reduce memory usage. If there is no streaming query, if we want to get 10 million […]

  • Six java examples of alink online learning

    Time:2021-3-5

    I published a series of articles on how to use Python for alink online learning Some readers reported that they need java version. Although these two versions are the same in algorithm principle, there are still many differences in the process of using. In order to facilitate readers to quickly use java to start alink […]

  • After six months of open source, what are the new features of alink?

    Time:2021-2-16

    This article is based on the Flink Forward global online conference and Chinese essence edition, and is shared by Alibaba senior computing expert Yang Xu. This paper mainly introduces the progress of alink in the past six months from the announcement of open source to now, and mainly shares some features, principles, and use skills […]

  • How does alink connect to Kafka data source? (Java version)

    Time:2021-2-11

    This paper mainly discusses how to use the Kafka connection components of alink (kafka011sourcestreamops and kafka011sinkstreamops) to read and write data. How do you need a local Kafka data source for experiment? You can refer to another article of mine, which introduces the process of building Kafka and topic in detail. Building Kafka on MacOS […]

  • How to use alink to connect Kafka data source? (Python version)

    Time:2021-2-2

    This paper mainly discusses how to use the Kafka connection components of alink (kafka011sourcestreamops and kafka011sinkstreamops) to read and write data. How do you need a local Kafka data source for experiment? You can refer to another article of mine, which introduces the process of building Kafka and topic in detail. Building Kafka on MacOShttps://zhuanlan.zhihu.com/p/… […]

  • Use of spark learning notes spark streaming

    Time:2019-11-6

    1. Spark Streaming Spark streaming is a real-time computing framework based on spark core, which can consume and process data from many data sources One of the most basic abstractions in spark streaming is called dstream (agent), which is essentially a series of continuous RDD. Dstream is actually the encapsulation of RDD Dstream can be […]

  • Spark streaming operator development example

    Time:2019-11-4

    Spark streaming operator development example Transform operator development When the transform operation is applied to dstream, it can be used to perform any RDD to RDD conversion operation, and it can also be used to implement operations not provided in dstream API. For example, dstream API does not provide the join operation between each batch […]