Tag：resource management
-
Batch file bat background running
Requirements: When running the batch file bat, a black window will be displayed, occupying the position of the taskbar. Moreover, for my obsessive-compulsive disorder, it looks very uncomfortable, so I think about how to hide and run in the background;I found two methods on the Internet, which can make bat run in the background without […]
-
Resource management of cloud application delivery platform appstack
Cloud application delivery platform appstackIt is a developer friendly cloud native application delivery platform with application as the core. It provides one-stop capabilities such as application orchestration, environment management, deployment and operation and maintenance, resource management and application release, helps enterprises establish an overall solution for continuous application delivery, accelerates the transformation of Enterprise Cloud […]
-
Big data development – new features of flink-1.13
introduce About April, flink1 It was released on 13 and participated in flink1 13 meetup has gained a lot. In general, it is the improvement and optimization of flingsql, the optimization of resource scheduling management, the optimization of flow batch integration, the optimization of Flink’s runtime and datastream API, and the optimization of state backend […]
-
Hengyuan cloud_ How does the cloud GPU server use vscode?
Source of the article | Hengyuan cloud community (focusing on artificial intelligence / deep learning cloud GPU server training platform, November favorite powder activity ing, official experience website:https://gpushare.com/ ） Original address |https://gpushare.com/docs/best_practices/vscode/ VSCode Vscode # is a cross platform code editor developed by Microsoft. It is free, open source and supports extensions. Using the remote plug-in, […]
-
[Flink selection] detailed explanation of taskmanager – Architecture
This article focuses on the overall architecture of task manager.Taskmanager is an RPC server as a whole, provide interfaces, such as requesting slot, submitting task, canceling task, etc. Taskmanager includes taskslottable, jobleaderservice, ResourceManager, etc. 1. Overall architecture of taskmanager Jobmanager and taskmanager areRPC communication based on akka。 Taskmanager itself is an RPC server, which provides […]
-
With the glory of real-time technology, Microsoft releases real-time big data analysis products!
The new programming model of cross cloud intelligent devices and parallel technology is a key aspect of digital transformation. One of the key data types generated from these new application paradigms is telemetry data. Telemetry data is everywhere: IOT sensors, application logs, network logs, infrastructure logs, security logs, indicators, click streams, time series, etc. The […]
-
Several ways to open SAP Hana Database Explorer in different locations
SAP Hana database browser is a web-based tool for browsing and using SAP Hana database objects, such as tables, views, functions, stored procedures, importing and exporting data, debugging sqlscript, viewing trace files, and executing SQL statements. It was previously named SAP Hana runtime tool (hrtt) and was introduced in SAP Hana 1.0 SPS 12. Because […]
-
Precautions for spark project landing practice and daily big data development
Spark introductionMemory based distributed cluster computing platformIt can adapt to python, Java, Scala and SQLExpanded functions: machine learning, flow computing, graph computing Spark featuresEfficient Memory computing engine Dag diagram 10 ~ 100 times faster than MapReduce Easy to use It provides rich APIs and supports Java, Scala and python Small amount of code Integration with […]
-
Hadoop-HDFS、MapReduce、YARN
Distributed file storage HDFS Storage model: bytes The file is divided into blocks according to bytes. The default size is 128MB and the minimum size is 1m (modifiable). Each block has an offset. Block blocks are stored in cluster nodes.Lateral expansion The block block size of the same file is the same, and the block […]
-
Spark – spark shell usage
Nspark shell is a powerful interactive data analysis tool provided by spark. We use it directly$SPARK_HOME/bin/spark-shellCommand to start spark shell. If it is in the bin directory, you can use it directlyspark-shell。After entering, you can see that SC and spark have been initialized. parameter Spark shell also supports other parameters, such as master, executor memory, […]