Tag：partition
-
Windows get CPU, memory, and disk usage scripts
Reprinted from: https://blog.51cto.com/luweikai/1904427 reference resources: http://www.51testing.com/html/85/87885-17546.html https://www.cnblogs.com/wtao/archive/2011/09/16/2178760.html Get the CPU utilization script (VBS) and save it as CPU vbs： 1 On Error Resume Next 2 Set objProc = GetObject(“winmgmts:\\.\root\cimv2:win32_processor=’cpu0′”) 3 Wscript. Echo “CPU usage:” & objproc LoadPercentage & “%” Get the memory usage script (VBS) and save it as RAM vbs： 1 strComputer = […]
-
Blog recommendation ｜ in depth analysis of transactions in Apache pulsar
About Apache pulsar Apache pulsar is the top-level project of Apache Software Foundation. It is the next-generation cloud native distributed message flow platform. It integrates message, storage and lightweight functional computing. It adopts the design of separation of computing and storage architecture, supports multi tenant, persistent storage and multi machine room cross regional data replication, […]
-
How to increase swap partition
# dd if=/dev/zero of=/. Swapf BS = 1024 count = 102400 #bs, 512 by default, and KB by default; # mkswap /.swapf # swapon /.swapf#Swap on – s # displays the status of swap attachment;Edit / etc / fstab:/.swapf swap swap defaults 0 0For example, it has been divided into / dev / sda7 and […]
-
Create a new batch stream integration: a detailed explanation of the pulsar Flink connector released by Apache Flink 1.14.0
Introduction to the author Sheng Yufan, streamnative development engineer, Apache pulsar and Apache Flink contributor. Before joining streamnative, he worked for Alibaba big data platform and Tencent cloud, and was responsible for the development of Flink. Sheng Yufan is the core committer and project implementation leader of Tencent cloud project Barad. He is currently responsible […]
-
Sparkcore core attributes of Spark Learning Records
Sparkcore preliminary of spark learning record concept Spark is a fast, universal and scalable big data analysis and calculation engine based on memory. The modules include spark core, spark SQL, spark streaming, spark mlib and spark graphx Spark submit example Standalone bin/spark-submit \ –class org.apache.spark.examples.SparkPi \ –master spark://spark111:7077 \ ./examples/jars/spark-examples_2.12-3.0.0.jar \ 1000 Yarn bin/spark-submit \ […]
-
Surrounding ecology ｜ ROP heavy release version 0.2.0: the architecture is newly upgraded, and the message accuracy is 100%
Introduction to the author Ran Xiaolong – R & D Engineer of Tencent cloud middleware team, author of Apache pulsar Committee, ROP and maintainer, Apache bookkeeper contributor, author of Apache pulsar go client, Apache pulsar go functions and streamnational / pulsarctl. abstract Recently, Tencent cloud middleware team and streamnational team officially released the version of […]
-
Big data development spark understanding common RDDS
1. Five basic properties A list of partitions A function for computing each split A list of dependencies on other RDDs Optionally, a Partitioner for key-value RDDs (e.g. to say that the RDD is hash-partitioned) Optionally, a list of preferred locations to compute each split on (e.g. block locations for an HDFS file) This is […]
-
Introduction to spark core computing
Introduction to RDD Concept introduction RDD: resilient distributed datasets RDD is the most basic abstract data model, which represents an immutable, partitioned and parallel logical set RDD is an abstract data model Supplement: Elasticity:The data in RDD is saved in memory. When the memory is insufficient, the data can be saved in disk Distributed:For the […]
-
oracle sql
View Oracle database version Any of the following commands select * from v$version; select version from v$instance; Select version FROM Product_component_version Where SUBSTR(PRODUCT,1,6)=’Oracle’; 1.dual The smallest worksheet provided by Oracle has only one row and one column, which has some special functionsDual is a pseudo table because it does not store dataWhen we don’t […]
-
2021-06-15-hive-25 (join in spark)
There are three kinds of join strategies in spark. Shuffle join and broadcast join are very common. Here is an introduction to bucket join 1.shuffle join (Common Join) 2.broadcast join 3.bucket map join 1） set hive.optimize.bucketmapjoin = true;2) The number of buckets in one table is an integer multiple of the number of buckets in […]
-
Exploration of implementing bitmap in PHP – extended use of GMP
Original address:https://blog.fanscore.cn/p/22/ 1、 Background The company currently has a user group system. The core function is to get the qualified uid list in different business lines according to different condition groups, and then save it to bitmap in redis. For example, if there are two users in a user group: 3 and 7, i.e[3,7], represented […]
-
Practice of the fourth paradigm openmldb in recalculation optimization of financial risk control database
Recently, at the datafunsummit: Intelligent Finance Online summit, Chen Dihao, the fourth paradigm platform architect, focused on the application of the fourth paradigm open source machine learning database openmldb in the financial field, as well as the processing of underlying chronological features and the details of window calculation optimization, with the theme of openmldb risk […]