Meitu, Inc., an AI-driven mobile internet company that has been transforming the way its users create and share their beauty, has officially launched the Anime Avatar feature on the Meitu App. The new feature not only automatically generates a highly personalized cartoon image, but also mirrors the user's facial expressions and movements in real time, distinguishing it from the avatar builders of yesterday. Catering to kawaii (cute) and cosplay culture enthusiasts, Anime Avatar is the world's first AI-based real-time anime avatar generator on a mainstream consumer app.
MTlab's AI technologies ensure that the resulting anime avatar both closely matches the attributes of real portraits and is a highly recognizable cartoon image.
The Anime Avatar feature can distinguish between tens of thousands of clothing and hair colors, thousands of facial features, hundreds of hairstyles, twenty different kinds of accessories, and various skin colors and face types. All of this ensures that the resulting anime avatar both closely matches the attributes of real portraits and is a highly recognizable cartoon image.
Users can select the "Photo" button to have the interface display both their original photo and the anime image. The feature allows users to customize their facial features, outfits, clothing items, hairstyles, accessories, and backgrounds – including for special occasions. This year will see the release of Christmas-themed costumes for the avatars and users will have even more custom themed options for future holidays, such as New Year, Spring Festival, and Valentine's Day.
The feature allows users to customize their facial features, outfits, and accessories – including for special events like Christmas and New Year.
The Anime Avatar feature also allows users to create personalized videos and emojis. By selecting the "Video" button, users can record movements of up to 10 seconds, or further personalize the video by adding music and vocal recordings that can be customized by modifying their tone and pitch. By selecting "Emoji", users can capture unique facial expressions of up to 5 seconds in length that will be replicated by their anime avatar. They can also add stylized messages to further personalize their emoji.
This feature comprehensively uses MTlab's AI technologies, including but not limited to: facial detection, facial landmark detection, facial attribute analysis, image segmentation, hairstyle recognition, clothing and accessory recognition, and image generation. Augmented Reality (AR) technology is also used to render the final product.
The facial landmark detection technology can locate 118 key points on the face and can analyze the face in real time with stability and accuracy in complex situations.
The technological process works like this: users provide the initial data input for analysis by taking a photo or uploading an image. The AI technologies will then detect and analyze the image's attributes including but not limited to gender, age, facial and eye shape, eyebrows, skin color, facial expression, hairstyle, hair color, clothing, clothing color, accessories, and accessory colors. By using models to map and construct the relationship between the real and the anime images, an anime image with a remarkable likeness to the original is created. The AR technology then allows the avatar to mirror the user's facial expressions and movements in real time.
An AI-driven company, Meitu has integrated these technologies into its suite of beautification apps across the board: the facial landmark detection technology is used as a basic technology in almost all Meitu products, laying the foundation for fine beautifying and exquisite virtual makeup effects. Facial attribute analysis is used to provide users with personalized beauty-enhancement features, virtual makeup effects, and beauty product recommendations. Image segmentation technology has a number of uses such as background replacement and blurring. Image generation technology has been applied to many functions such as AI Portrait and Andy the ArtBot. AR technology has been applied to virtual makeup and AR filters like Marvel's Venom-themed AR effect, which was recently released.
Enhancing the image rendering accuracy to an even greater extent, the Anime Avatar feature is an extension of Andy the ArtBot and Hand-Drawn Selfies, Meitu's highly successful AI-driven functions that also generate real-time illustrations based on users' real-life photos. In January 2017, Meitu launched its Hand-Drawn Selfie Function, turning users' portrait photos into unique illustrations. In November 2017, Meitu launched Andy the ArtBot, an upgraded version of the hand-painted selfie function. The Meitu App took the top spot in the App Store Rankings of six countries earlier this year, including Japan, South Korea, Thailand, Egypt, Saudi Arabia, and Mongolia: much of this success can be directly attributed to Andy the ArtBot.