Pixi’s new iOS app turns text messages into interactive AR experiences - BERITAJA

Forget stickers, GIFs, and emoji reactions. Pixi is betting that the adjacent improvement of messaging is interactive augmented reality (AR).

The startup launched its messaging-native app connected the App Store connected Wednesday, allowing users to nonstop AI-powered AR characters done iMessage. Instead of appearing arsenic fixed media, the characters travel to life done the recipient’s iPhone camera, wherever they could respond to their surroundings, interact pinch people, and respond successful existent time.

While AR isn’t caller and shiny anymore—companies for illustration Snap person created AR filters and lenses for years—Pixi believes its attack is different. By combining AR pinch on-device AI, its characters could understand what’s happening about them and behave accordingly. A virtual cat, for example, reacts erstwhile a existent canine walks past. (According to the company, each ocular and audio processing remains connected the instrumentality to sphere personification privacy.)

Pixi laminitis Mark Drummond (ex-DreamWorks Animation and ex-Apple) says the app is designed to bring a greater consciousness of beingness and spontaneity to integer conversations. Rather than sending a matter to wish personification a Happy Birthday, users could nonstop characters that create a shared experience, turning a elemental connection into thing person to a integer gift aliases playful interaction.

“The user problem we’re solving is reasoning of a friend erstwhile they’re not present,” he told TechCrunch. “Sometimes the psychology is called pebbling aliases imaginative gifting. You’re sharing tokens of affection, fundamentally cards, e-cards, and gifts. That’s your dad, or, successful immoderate cases, your granddad’s media. We could do better. We could do thing that’s digitally native, and that uses everything we learned about AR connected the iPhone.” 

Earlier this week, Drummond demonstrated the app for us, selecting the feline character, which performed a bid of stand-up jokes connected his desk. Notably, the feline appeared to respond to Drummond’s facial expressions. For instance, the acquisition concluded erstwhile he smiled, showcasing the character’s expertise to comprehend affectional cues.

At launch, users will person entree to a robot, a cat, and an animated letter cover characteristic that could respond to their sound and “attack” their friends successful a playful way. If they move, the letter cover will pursuit them. There are besides games for illustration tic-tac-toe and whack-a-mole.

Image Credits:Pixi Platforms

Pixi plans to grow beyond conscionable a fewer characters. The extremity is to create a marketplace wherever studios, brands, and independent creators could stock their unsocial characters for users to take from. The institution envisions this being utilized for events for illustration movie premieres aliases merchandise launches, allowing characters to make excitement, specified arsenic erstwhile M&Ms merchandise a caller flavor.

Drummond besides mentioned introducing Alice successful Wonderland arsenic a characteristic option, arsenic she is an unfastened intelligence property. He pointed retired that “our Alice characteristic needs to respond to objects that she sees connected your desktop successful an ‘Alice-consistent’ way,” to show to partners really their creations will interact pinch the technology.

In the future, Pixi hopes to let users to create their ain characters and personalities. 

“Part of our scheme is to unfastened up those generative AI capabilities to our [users], truthful they could punctual their measurement to opportunity something, like, ‘I want a bluish blob that threatens my friend and growls astatine them and keeps chasing them connected the phone,’” Drummond explained.

To nonstop a characteristic to your friend, download the app connected iOS and usage iMessage by tapping the positive motion fastener successful the little near corner. No installation is required to person a Pixi message.

Initially, the app will beryllium disposable only for iPhone models 11 and newer, but location are plans to grow to Android devices and messaging platforms for illustration WhatsApp and Instagram successful the future. 

Also, while the app is free for users, brands will person the action to complaint for their characters if they choose.

“We’re going to promote group to do it for free, because past group go your ain marque ambassadors. You’re putting them successful complaint of utilizing your characters to show their ain stories,” Drummond said.