USO technology was invited to share the technical framework and challenges of AI synthetic virtual characters at lvson2020 conference

Abstract ： As a service provider of intelligent video and audio solutions , Americo technology is committed to providing services for mobile Internet 、 A smart phone 、 Smart hardware 、 Traditional radio and television and communication operators and other industry institutions provide the most cutting-edge overall video and audio solutions , Provide efficient services for developers and industry partners 、 Stable underlying technical support , Help partners achieve business innovation and create huge user value .

2020 year 10 month 31 Japan ,LiveVideoStackCon 2020  The audio and video technology conference was held at Park Plaza Beijing , Conference focus audio and video technology and globalization 、AI And multimedia processing 、 Education and multimedia 、 Video codec 、 Server development optimization 、 Hot topics related to audio and video technology and industry applications such as education and multimedia . Assemble 500 Many from Pan entertainment 、 education 、 Videoconferencing 、 social contact 、 game 、 Online retailers 、 Finance 、 Senior scholars and experts in the field of Internet of things development .

In the meeting , Beijing Meishe Network Technology Co., Ltd AI Mr. Hou Kang, head of the research group, was invited to attend and share the keynote speech 《AI Technical framework and challenges of synthesizing virtual characters 》, The content of the speech ranges from AI Starting from the technical framework of synthesizing virtual characters , It introduces AI Background of synthetic virtual character technology , This technique is achieved by inputting a paragraph of text , Generate a nearly real shot of the anchor video . Further details are given AI The differences, advantages and disadvantages between different technical paths of synthetic virtual characters , Design and optimization of expression and mouth prediction model ,3D Face reconstruction and rendering technology 、 Against generative networks , Key technologies such as video frame rendering and fusion . For mouth jitter and distortion ,GAN Distorted results in facial details , Finally, the smooth transition between the front and back frames of the video and other difficulties share the solution .

American Photography Technology AI Composite virtual anchor , Combine artificial intelligence with computer graphics . When the computer obtains the content information in voice or text , The face of the virtual image can be driven by computer graphics synthesis technology , Rendering and fusion , After massive facial data, the training of generating confrontation network , Achieve a very realistic expression restoration , Finally achieve fine lip synchronization 、 A virtual anchor with vivid expression and posture, which is no different from a real person . On the news 、 Virtual customer service 、 Internet teaching and other fields have rich application scenarios .

At present, the product matrix of American photography technology includes ： High definition video shooting and deep editing SDK、 Intelligent video production service platform 、 Intelligent editing solution 、 Smartphone solutions 、 Face + Skin care / Sticker solution 、 Cloud clip 、 Virtual anchor 、 Video packaging custom design and other services . Covering the mobile end 、PC End 、Web End , The whole process from shooting to editing , Realize the playing methods of all current mainstream videos . Have a flexible technical architecture , Using multithreading and GPU、CPU Collaborative preprocessing mechanism 、 Naturallanguageprocessing algorithms and other technologies , It has been unanimously recognized by leading manufacturers in various industries , Now with ruxiaomi 、OPPO、ViVO、 ASUS 、 Cheetah Mobile 、 Bili, Bili 、 Sina 、KEEP And other leading customers in various fields to carry out in-depth technical cooperation . And with the State Grid 、 Cooperation with traditional enterprises such as radio and television , Push headlines APP、 The application of financial media in government and enterprises . Except for domestic guests , American photography technology also arranges foreign markets , Fill the gap of intelligent video and audio solutions in overseas markets in the world . at present , Already in the United States 、 South Korea 、 India 、 Singapore and other countries and local Internet companies provide in-depth technical services , Radiate tens of millions of overseas users , Help partners achieve business innovation and create huge user value .