Tag：disk
-
MySQL Foundation (05): logical architecture diagram and details of InnoDB storage engine
Source code: GitHub, click here, gitee, click here 1、 MySQL logical architecture 1. Logic architecture diagram Based on the following logical architecture diagram, you can be familiar with the collaborative working relationship between various MySQL architecture components. The classic C / S architecture style is client / server mode. 2. Hierarchical description Client connection Generally, […]
-
RDD of distributed elastic data set helps spark improve operation efficiency
As we have said in the introduction of spark, in order to speed up the processing of spark, one of the solutions is to introduce a distributed elastic data setRDD RDD concept What is RDD: RDD (resilient distributed Data set) elastic data set is the most basic data abstraction in spark. Although RDD is a […]
-
A comprehensive interpretation of PostgreSQL and Greenplum’s hash join
On October 15, 2019, Yao Yandong, deputy general manager of pivot China R & D center and sponsor of Greenplum Chinese community, attended PostgreSQL conference Europe held in Italy and delivered a wonderful speech how does hash join work in PostgreSQL and its derivates. This paper is organized according to the content of the speech […]
-
Optimization Practice of tens of times performance improvement of oppo million level high concurrency mongodb cluster (I)
This article is from oppo Internet technology team. Please note the author for reprint. Meanwhile, welcome to the official account of OPPO Internet technology team: OPPO_tech, share with you OPPO frontier Internet technology and activities. 1. background The peak TPS of a cluster on the line is more than 1 million / S (mainly write […]
-
How Mars executes distributed
Previously, we have introduced what Mars is. Now Mars is open-source in GitHub and on-line trial. In this article, we will introduce the distributed execution architecture that Mars has implemented, and welcome your comments. Framework Mars provides a set of libraries for distributed execution of tensor. This library usesmars.actorsImplementation of the actor model, including scheduler, […]
-
Question 02: how can I simulate slow disk IO?
Question: How to simulate slow disk IO? Experiment: 1. Create a delayed disk Create a 100m file with DD Use losetup to virtualize the created file into a block device / dev / loop3 Map block device / dev / loop3 to a device with latency (100ms for both read and write operations) 2. Experiment […]
-
How to answer the question of performance optimization to impress the interviewers of Alibaba?
Alimei’s Guide:In our daily work, we will encounter application performance problems more or less. In Alibaba interview, performance optimization is also a frequently asked question, which is used to check whether there is actual online problem-solving experience. In the face of such problems, Qi Guang, an engineer from Ali, gives a detailed process. Look at […]
-
How to use Kafka to increase the backup quantity of topic and make the business to a higher level
This article is published by cloud + community 1、 Difficulties When establishing a topic, you can set the number of backups by specifying the parameter — replication factor. However, once the topic is established, you cannot modify the number of replicas through kafka-topic.sh or the command. 2、 Solutions In fact, we can consider an “alternative” […]
-
Accurate TTL expiration and elimination mechanism based on rocksdb
This article is from oppo Internet technology team. If you need to reprint it, please indicate the source and author. Welcome to our official account: OPPO_tech Parker is a distributed kV storage system based on rocksdb developed by oppo Internet. It is a redis like storage system. It mainly solves the problems that users encounter […]
-
Do you know what performance strategy Kafka uses
This article is my experience in Kafka research. Welcome to point out the mistakesVisit my blog more Preface As an increasingly popular stream processing platform, Kafka makes people wonder why it is so popular and famous. I explore the mystery of Kafka from the perspective of performance. Define Kafka’s performance position First of all, clear […]
-
MINIX file system
First, reference Principle analysis of storage technology Two, text 1. Preface MINIX is the earliest file system of Linux. The disk layout of the Linux file system consists of six parts:Boot block, super block, i-node bitmap, logical block bitmap, i-node, logical block Boot block:At the beginning of a file system, usually a sector, in which […]
-
Take you through the MySQL index structure (1)
Preface Hello, I’m here again. It’s almost the end of the year. As an ambitious farmer, I want to save a year-end summary for myself. Simply this time, we will share the core and the most difficult to understand content in the database, that is, index. In this blog, I will talk […]