Technical editor: Xu Jiuyi from: sinao editorial department
“The party in summer is my home, I shine in the night or in the day…”
On August 14, he Chang, a new member of Xiaobing‘s artificial intelligence framework, made an official debut. He Chang and Ma boqian, a famous musician, jointly promoted Burberry’s TB summer Monogram single “runway 2.0”. The single was co written by Ma boqian, Xiao Bing and co producer Kevin shin.
This is the first time Xiaobing created hip-hop music with rap elements, and it is also Ma boqian’s first cooperation with artificial intelligence to create and sing. At present, “runway 2.0” has been put on the shelves of Netease cloud music and other platforms.
AI He Chang is the latest virtual singer in Xiaobing’s AI framework. Her singing is natural and fluent, and her timbre is very expressive. “Runway 2.0” relies on Xiaobing’s latest deep neural network singing model, which is automatically deduced by He Chang of artificial intelligence. The latest version of singing model realizes the natural “breath” of artificial intelligence in virtual singing and applies “breath” to the whole singing process. It enables artificial intelligence to use abundant “Zhongqi” to set off singing like human singers, so as to improve the quality of artificial intelligence virtual singing to a new height.
In addition, the further optimization of the deep neural network structure and the substantial supplement of training data have improved the higher skills and multi styles of artificial intelligence song interpretation, realized the natural transition between different singing skills, and further rapidly synthesized songs with the same quality as human singers, and enabled virtual singers within the framework of Xiaobing to freely absorb the songs of most human singers Singing skills, mastery, in the singing process to achieve a more mature interpretation.
In ancient China, there are many incisive discussions on the sound of music, such as“Silk is not as good as bamboo, bamboo is not as good as meat” is “progressive nature”。 Therefore, the artificial intelligence sound synthesis, which is constantly approaching the quality of human singers, is regarded as the highest technical goal of “artificial intelligence creation” branch by Xiaobing team.
AI Xiaobing is one of the “people” in “runway 2.0”. In the field of music creation, Xiaobing’s music creation ability has realized the end-to-end integration of melody, composition and lyrics.
Inspired by a text description or a picture, Xiaobing can create a unique music track, and automatically complete the orchestration selection, composition and lyrics creation according to its style and rhythm. Xiaobing’s creation is carried out in the cloud, and the creation time of a complete song of about three minutes is within two minutes. At present, Xiao Bing has mastered various styles of music creation, such as popular, folk and ancient styles.
As for the first time to co create and sing with AI, Ma boqian said: “I regard he Chang and Xiao Bing as human beings to cooperate. It’s as if they’re in another city, except that they can’t sit together, working with them is the same as working with humans. I think art and technology are directly linked, and they need each other. “
Xiaobing team believes that the biggest interaction in the future is not human-computer interaction, but the interaction between human and artificial intelligence. The number of artificial intelligence interaction subjects may far exceed the number of human beings. This will be the biggest opportunity for AI in the future, and Xiaobing’s “ubiquitous” entrance.
Taking the singing field as an example, in addition to the virtual singers such as Xiaobing and he Chang, Xiaobing framework also has or provides more than ten high-quality virtual singer models for the third party. With the technical support of Xiaobing framework, more AI singers with high restoration degree will emerge. Maybe in the near future, Xiaobing, he Chang and more AI singers will jointly bring more shocking and sci-fi music experience to users.