Tag：Data Volume
-
Time：2020-10-29
Gaia advertising matching system (gaeaad) is used to support the real-time advertising delivery system of Gaia mutual entertainment platform. It needs to match the advertising data and the information reported by game SDK in near real time. In essence, it needs to calculate in real time according to the advertising of each channel and the […]
-
Time：2020-10-27
Introduction to the authorDai Xiaolei, now a 360 commercial database operation and maintenance expert, tidb user group ambassador, is responsible for the database operation and maintenance of the whole intelligent business line, solves various database problems, and promotes the application of new open source databases such as tidb. 360 intelligent business line has been using […]
-
Time：2020-10-23
Because an interface is too slow… Try to optimize (/ bald) Spring data used- mongo:2.1.3 Mongo drive: 3.8.2 Look at my first query. Optimization ideas paging Original paging query Due to the large amount of data, this query was slow, and it was later found that there was no need to use aggregation at all. […]
-
Time：2020-10-18
After that, a series of articles will be published for database index, please look forward to it Preface several reasons for learning index High paid programmers must have knowledge, no matter where to interview, database index optimization is a required knowledge Work essential, no matter any system must deal with the database, when the amount […]
-
Time：2020-10-14
In SQL server, how to quickly delete data in large tables? Before answering this question, we must make clear the context and the actual, specific needs, different scenarios have different response methods. 1: Delete all data in the whole table If the data of the whole table is cleared and […]
-
Time：2020-10-10
preface Some time ago, I took over an API call statistics project for internal use of the company. Recently, I received a frequent alarm about slow SQL. I happened to be learning this content recently. Let’s practice. Practical operation This slow SQL mainly involves two tables. API_ Result — used to count API call results […]
-
Time：2020-10-1
1. count(1) and count(*) When the amount of data in the table is larger, it takes more time to use count (1) than count (*) after analyzing the table! From the execution plan, count (1) and count (*) have the same effect. However, after analyzing the table, count (1) will take less time than count […]
-
Time：2020-9-30
As we know, most spark computing is done in memory, so the bottleneck of spark generally comes from the shortage of resources in the cluster (standalone, yarn, mesos, k8s), CPU, network bandwidth and memory. For the performance of spark, if you want it to be fast, you have to make full use of system resources, […]
-
Time：2020-9-30
Write it at the front Because I want to design a database to practice, I temporarily decided to skip the operation and maintenance part and directly learn the part about “system architecture” in Chapter 4. Day 22 Today, we are going to learn the Chapter 41 | mongodb application scenarios and selection. Please click here […]
-
Time：2020-9-27
Linux operation and maintenance knowledge system web: nginx, tomcat, apache, weblogic, IIS LB: nginx, LVS, haproxy, keepalived, F5 monitor: zabbix, nagios, cacti, prometheus, openfalcon Automation: ansible, saltstack, puppet, pxe, pssh Automation assistance:Docker, Jenkins, maven, gitlab, CI / CD (continuous integration / continuous deployment) Database: MySQL, redis, mongodb, oracle, NoSQL, sqlserver2012, sqlserver2008, Hbase Storage: NAS, iscsi, […]
-
Time：2020-9-27
Comparison of XML, JSON and protobuf formats for data interaction 1. JSON: the most popular web project is JSON. Because the browser supports JSON data very well, it has a lot of built-in function support.2. XML: the most widely used in Web service, but its data is more redundant than JSON because it requires pairs […]
-
Time：2020-9-23
Clickhouse performance test In order to verify the performance of Clickhouse, we will conduct multi-dimensional test on the Clickhouse based on the actual business scenarios. Build test data In the actual business, the most common business scenario includes two tables, the main order table and the order details tableUsually two tables willjoinInquiry, orgroup byQuery, the […]
