Baidu brain event Atlas: insight into event knowledge in a complex world

Time:2021-10-23

In recent years, Internet ecology has experienced rapid development, and digital information is growing explosively. According to the statistical report on China’s Internet development, by March 2020, the number of Chinese Internet users had reached 904 million and the total number of web pages had exceeded 297.8 billion. The complex and massive information brings many problems to people’s learning and use of knowledge, such as difficult integration, difficult search, difficult understanding and so on.

Artificial intelligence technology has now penetrated into all aspects of people’s life and work. In terms of the problem of processing and understanding massive information, “knowledge map” provides important support for artificial intelligence technology: through AI technology, big data and continuous learning in the process of interacting with users, knowledge map describes the concepts, entities Events and the relationship between them can help machines better understand the world and make artificial intelligence technology more powerful.

At present, the knowledge map based on “entity map” mainly describes entities, attributes and the relationship between entities. Its knowledge expression is too simple to understand dynamic objective events. Therefore, more complex knowledge systems need to be understood and modeled. Baidu brain “event map” integrates the complex and diverse event data of the objective world and expands the entity map in multiple dimensions of time, space and action. It has stronger knowledge expression ability and can better describe the dynamic changes of the objective world. The event centered knowledge structure is also more in line with human understanding of the objective world. Event map can help people quickly obtain and continuously track the progress of events, quickly and accurately obtain core key information, and provide auxiliary decision-making ability.

What is the event map of Baidu brain? What are the core competencies? How does it help all walks of life to realize intelligent upgrading? Let’s take a look:

What is the event map

“Event” refers to a series of activities carried out around a certain theme with the participation of one or more roles (event subjects) in a specific time and space. “Event map” refers to the continuous and rapid acquisition of events in the objective world, enriching event attributes, establishing the correlation between events, and forming a knowledge network with events as the basic unit.

As shown in the figure below, Song Hye Kyo and song Zhongji have experienced various events at different time points, so their entity relationship has changed in time sequence, forming a typical event map knowledge network.

Baidu brain event Atlas: insight into event knowledge in a complex world

The event map can help people find hot events faster, better understand the current situation, cause and effect and context of many related events, and help people more accurately grasp the potential impact, predict the future development trend and respond in time. At the same time, the event map also plays a more and more important role in the application of various industries, such as investment research, media creation, public opinion monitoring, credit risk control and so on.

Main usage scenarios of event map

Based on the industry-leading knowledge map technology, baidu event map provides event detection, event extraction, causal reasoning, event retrieval and other technologies to help the intelligent upgrading of various industries. At present, baidu event map technology has been widely used in Baidu’s own products, such as searching hot event context, map POI change detection, machine assisted writing, etc., as shown in the figure below.

Baidu brain event Atlas: insight into event knowledge in a complex world

In addition to the successful application of Baidu’s own products, the event map also shows broad application prospects in various industries. Let’s see what industries the event map can empower and what pain points it can solve for all walks of life:
Baidu brain event Atlas: insight into event knowledge in a complex world
Baidu brain event Atlas: insight into event knowledge in a complex world
Baidu brain event Atlas: insight into event knowledge in a complex world
Baidu brain event Atlas: insight into event knowledge in a complex world

In addition to the above scenarios, event atlas is widely used in government affairs, public relations, intelligent office and other fields. With the help of event map technology, the landing effect of intelligent solutions for these scenarios can be greatly improved.

Core competence of event map

The following figure gives a technical overview of Baidu event map, which focuses on three core competencies: event detection, event extraction and causal reasoning.

Baidu brain event Atlas: insight into event knowledge in a complex world

l Capability 1: event detection

Based on the information content of the whole network, event detection can mine event phrases in real time, discover new hot events and constantly supplement historical events. It can accurately, quickly and comprehensively detect various events from the information content of the whole network. It is the first important link in the construction of event map.

Baidu brain event map has achieved minute level collection of hot events, and the scale of events has reached tens of millions, which can give consideration to the comprehensive coverage of hot events and long-term cold events. For example, the “hot event discovery” function can support minute level monitoring and discovery of hot events in provinces, cities, districts and counties. As shown in the figure below

Baidu brain event Atlas: insight into event knowledge in a complex world

l Capability 2: event extraction

Event extraction is to identify events and their types from unstructured natural language texts and extract their event elements. As shown in the following figure, how to extract core event elements such as event type, argument role, time, place and person from a simple sentence:

Baidu brain event Atlas: insight into event knowledge in a complex world

In the face of complex sentences, event extraction technology will identify different types of events in sentences and extract the corresponding arguments according to the argument role set:
Baidu brain event Atlas: insight into event knowledge in a complex world

In order to promote the development of event extraction technology, Baidu has released duee, the largest event extraction dataset in the industry, as the “thousand words” open source project of Baidu dataset(https://www.luge.ai/)Part of the is free to researchers. In 2020, Baidu, together with China Chinese information society and China computer society, held an event extraction technology competition, which attracted the extensive participation of more than 1200 scholars at home and abroad. Through self-developed customized event extraction, baidu brain event map can provide simple and easy-to-use technical functions and complete the extraction without any code ability. At the same time, it further reduces the dependence on the amount of data of the training corpus. Only a small amount of training corpus is needed to output a high-quality event extraction model.

Baidu brain event Atlas: insight into event knowledge in a complex world

l Ability 3: causal reasoning

Causal reasoning is a technology to discover and deduce the causal relationship between events, and it is also the most cutting-edge exploration direction of event map.

Baidu brain event atlas extracts the causal evidence between events in the massive data accumulated by Baidu for many years, summarizes and forms accurate causal knowledge, and makes causal reasoning on the events (tracing the causes and deriving the results). So as to comprehensively improve the predictability and availability of the event map and meet the reasoning needs of each scenario for event causality.

In practical application, causal reasoning ability can be used to analyze the impact of event causality on economy, society and people’s livelihood through the learning reasoning of event related information such as “Fed’s purchase of treasury bonds”, “pork price rise” and “COVID-19 outbreak”. The following figure is an example of the causal relationship derivation of the “gold price rise” event.

Baidu brain event Atlas: insight into event knowledge in a complex world

In addition to the above three main technical capabilities, event retrieval, as an important technology to improve knowledge acquisition ability, also supports business scenarios such as search, recommendation and public opinion monitoring. Specifically, event retrieval technology is a new generation of intelligent retrieval based on event dimension. By extracting and displaying the participant, region, industry, emotional tendency, summary and other structural attributes of the event, we can realize the aggregation of massive information throughout the network, sort out the context of the event according to time, and finally display the full picture of the event in an all-round way. At present, the event map can support the retrieval of tens of millions of events, which is related to hundreds of millions of information on the whole Internet. The following figure shows the details of the incident retrieved with “Russia’s expulsion of a senior diplomat from Norway” as the search term.

Baidu brain event Atlas: insight into event knowledge in a complex world

Write at the end

With the rapid development of Internet technology, “those who get knowledge get the world” has become the consensus of all industries. The big data + artificial intelligence technology represented by the event map is catching up with the times. This treasure house containing a lot of prior knowledge is being continuously excavated and applied.

Baidu brain, as a frontier explorer of event map technology, has accumulated rich experience and advanced technical ability. In the future, it will empower all walks of life, help enterprises reduce costs and increase efficiency, and help all industries complete intelligent upgrading.

Standards, openness, CO creation and win-win; Baidu brain event atlas, looking forward to exploring with you!

Cooperation consultation:https://ai.baidu.com/tech/kg/…

Recommended Today

Interpretation of Presto / Trino authoritative guidelines and official design documents

Official website address:https://trino.io/docs/current/See the bibliography Trino: the definitive guideOpen source community blog address:https://blog.starburstdata.com/Trino blog address:https://trino.io/blog/The authors are all the three founders of presto, so these two materials plus the Presto paper in 2019 (see my other blog) are the most authoritative Presto technical documents. However, after reading by the editor, these are not fine enough. […]