Inworld AI

Projects Update 2 (Apr 2023)

Tracy Harwood Blog April 24, 2023 Leave a reply

This week, we highlight three excellent Unreal storytelling projects, and some other interesting storymaking development projects we think you’ll find just as intriguing.

Unreal Stories

Brave Creatures, released on 2 March, is one of the most inventive and magical stories made using Unreal Engine we’ve seen and it’s not been set on an alien planet full of freakish monsters and travellers in space suits. The creative team, Studio Pallanza (none other than Academy award-winning VFX artist, Adam Valdez) was awarded a Mega Grant to bring this project to life, and it has done a truly outstanding job of it. It will surely be the basis of a new children’s series? Here’s the link –

and if you want to hear Adam discuss the work, check out Jae Salina’s interview with him here –

Promise with Dr. (English version), released on 17 Feb by TT Studio, is another magical story, albeit with a completely different aesthetic. Great editing and storytelling, do check this out too –

Miika is an award-winning film by Ugandan director, Nsiimenta Shevon, released on 27 Feb. This is powerful and disturbing, as only tales of African conflict can be. Beautifully animated by Solomon Jagwe, here’s the link –

Storymaking in Other Ways

This is not a film or an animation, but a fascinating insight into the storymaking possibilities of interactive chatbots and animated robots. In this ‘show and tell’ presentation at SXSW 2023 by Disney Parks’ chair of Experiences and Products Josh D’Amaro, Tinker Bell (Peter Pan’s sidekick) is shown as an animated chatbot in a box and a roller-skating child-like robot is emoted using mocap. These are Disney’s ‘greeters’ of the future, embedded with storytelling capabilities through the design process. What is particularly interesting is that, at least for me, the usual uncanny valley effect had somehow disappeared – what do you think?

In our next selection, MidJourney has been used to conflate two very different yet seemingly complementary storyworlds into a series of bizarre images, one being Star Wars and the other being the paintings of Hieronymus Bosch. This work, called Star Wars by MidJourney, by AI Visionary Art, was published on 18 Feb and somehow converts the grotesque and nonsensical creatures into a familiar canon (for some, Damien) –

And finally this week, we share an overview of an InWorld AI driven adventure game called Origins (our feature image for this post), animated using Unreal’s Metahuman characters and presented in the style of a film noir (or rather, a neo-noir). This is vaguely reminiscent of some of those very early games that inspired a lot of machinima creators back in the earliest days, Max Payne for those with long memories. InWorld AI has described its approach as the future of NPCs, but its also their DNA too. The chatbot and naturalistic style interface is a really interesting development for storymaking and storytelling and we’re definitely looking forward to seeing what creators do with this kind of creative platform in future. Check this out –

That’s it for this post, thanks for reading and do share with us anything you spot that you think we should be reviewing on the podcast.

Tech Update 2 (Jan 2023)

Tracy Harwood Blog January 16, 2023 Leave a reply

This week, we highlight some character development tools, NeRFs, NFTs and environments for machinima and virtual production.

Characters

Beginning with the awe-inspiring toolset of Unreal Engine’s MetaHumans, the organization has released a FREE three-hours long online course for beginners on real-time animating with Faceware Analyzer and Retargeter tools. Here’s a taster of what you can expect –

A creator we’ve featured a number of times (his tutorials are awesome), JSFILMZ (our feature image) has posted a taster of MetaHuman’s Live Drive from Facegood, which launched in December. The demo shows straight from camera to Unreal but what’s amazing is the price for the head-mounted hardware of <$500! This obviously isn’t free but its good value compared to some of the other facial tracking hardware on the market, and Jae compares those to give you an overview of what you get for the money. The Facegood software itself, Avatary, is free though, which produces some impressive animations. Check out Jae’s introductory overview below, and then pick up his tutorials on each of the components he discusses on his channel –

Move.ai has launched its iPhone beta application for free markerless mocap (requires two phones). Ultimately, this isn’t going to be free to use so make the most of the beta sign-up opportunity – the official launch takes place in March 2023 and their main target in the first instance is professional studios, which will put this out of reach for many indies. This article gives you a quick overview (by 80.lv), and this short video explainer introduces their store –

And finally, on characters this month, we highlight Inworld AI. This organization is creating interactive conversational characters that can be exported and shared across various platforms, either as avatars or the underlying chatbot (think smart NPCs). Some of you may recall John Gaeta mentioned this in our interview with him last year, and since then, Inworld has become part of the Walt Disney Company’s Accelerator Programme, been awarded an Epic MegaGrant and raised a pot of money from investors. The application of the software is vast – everything from games to marketing, as well as machinima and virtual productions too… and that’s because of how the characters can be moulded. Inworld states: ‘When crafting your character’s brain, you are able to use the Studio to tailor many elements of cognition and behavior, such as goals and motivations, manners of speech, memories and knowledge, and voice‘. Inworld released a nice tutorial in December, link below. Its definitely one to try out –

NeRFing Around

We found a nice short on Neural Radiance Fields (aka NeRFs) by Corridor Crew, using the Luma AI app, which is truly stunning for recreating realistic anything. They highlight some of the key challenges, and present a very interesting test with a chrome ball – surely it is never going to possible to create this kind of object with dynamic reflections and all…? Check it out here –

As Corridor Crew states, this is clearly one of the next big tech things in image capture for CGI.

NFTs

The fluid waters of NFTs continues to muddy. This article (by NFT Now) highlights some of the recent class action law suits being brought against creator platforms, suggesting that the markets are being artificially inflated by celebrity endorsers, although this is surely true for so many other products too? Its more an argument about the nature of the endorsement process and the stake in the investment that the endorser has that’s the issue here seemingly. One of the main challenges here is the fundemantal role of community in NFTs, which is always going to mean there is a very fine line on ‘insider trading’. Its also interesting to note that IP owners are now becoming more actively involved in this nascent space. Once again, whenever the legals get involved, everyday creatives are the losers, so whilst some of the actions highlighted are less directly relevant, the outcomes of the legal disputes ultimately will be, so we’ll keep tracking this.

Environments

Finally, we want to highlight a couple of environments for you.

Firstly, Half Life Alyx has a new mod, courtesy of Corey Laddo! Corey has created a mod that allows you to view the game in the role of Alyx Vance. Its designed to be a free of charge for owners of the game, and provides a 4-5 hour experience for ‘average players’. Great if you want to shoot content from a first person perspective. You can support Corey on his Patreon account, should you want to give him something for his effort. Download the mod from Steam here. Meantime, here’s a taster for you –

Secondly, Damien shared a new sandbox environment that will be launching soon (well, we think it will since its apparently been in dev since 2012), called Outerra World by Microprose. This looks amazing, and will allow you create any kind of realistic 1:1 scale terrain simulation, which you can share and navigate using any asset that the community creates and shares too. Here’s the link to the Steam page (to add your details to the waitlist).

If you have comments or thoughts on any of the techs this week, do go ahead and comment.

Completely Machinima S2 Ep 40 News (July 2022)

Tracy Harwood Podcast Episodes July 7, 2022 Leave a reply

Despite being encouraged to create an episode of just 15 minutes duration by one of our followers, the team have this month extended their coverage – hear Tracy, Damien and Phil discuss vtubing, Ricky’s Duke Henry the Red character in the game Evil Dead, the FTC’s proposed updates to social media guidelines, Unreal’s review of the Matrix Awakens Experience, John Gaeta’s latest exploits, metaquette, Reallusion’s iClone 8 and CC4 and a number of other exciting developments relevant to the world of real-time filmmaking and machinima.  Thankfully, you can use the timestamps to jump to the bits your most interested in!



YouTube Version of This Episode

Time stamps, links and show notes

1:34 Feedback from our followers: 3DChick, Al Scotch, Spentaneous, Mike Clements, Circu Virtu, Notagamer3d

8:14 Vtubing and Face Rig app (Steam), VTuber Studio – real time puppeteering using faceware

17:41 Interactive video on Vimeo, branching narrative storylines

20:23 Ukranian films of the recent war, showcased at Milan Machinima Film Festival website

24:17 Evil Dead and the character Duke Henry the Red played by Ricky Grove and IP generally, Ricky Grove on IMDb

Ricky vs Ricky

39:29 FTC updating ‘disclosures 101 for social media infuencers’ guide’ discussion, the relationship between brands, platforms and influencers and see also [Company] Rulez! (Phil Rice aka zsOverman & Evan Ryan aka Krad Productions).  Here is PC Gamers’ comments and proposals to update the guidelines

54:55 Competition updates: Nvidia Omniverse Machinima promo video ‘Top Goose’ | A NVIDIA Omniverse Machinima Short #MadeInMachinima, released 9 June 2022, and Unreal competition.  Here is Ben Tuttle’s The Amazing Comet (Unreal Engine/iClone) (4413 Media), released 9 June 2022.  And here’s a link to William Faucher’s YouTube channel.

screencap Ben Tuttle’s The Amazing Comet

58:03 Making of Unreal’s Matrix Awakens Experience, Behind the Scenes on The Matrix Awakens: An Unreal Engine 5 Experience, released 6 June 2022, and Tracy’s interview with John Gaeta, VFX, The Matrix films, released 17 February 2022.  Living Cities is a new metaverse mirror world, website link and Visual Effects Giant John Gaeta joins Inworld AI as Chief Creative Officer, 1 June 2022 and Inworld AI teaser video, released 28 April 2022

screencap Behind the Scene of Matrix Awakens Experience

1:00:16 Pooky Amsterdam’s blog on metaverse etiquette, called Metaquette website link

1:00:39 Reallusion’s iClone 8 character animation processes including Character Creator 4 Launch by Reallusion (released 26 May 2022) and iClone 8 Demo Video by Reallusion (released 26 May 2022)

1:13:08 Mesh to MetaHuman in Unreal Engine by Unreal Engine, released 9 June 2022

1:13:33 Meta’s new model allows creating photoreal avatars with an iPhone, 80.lv, 14 June 2022 and full research publication

1:14:02 Mocap with the MoCats: Livestreaming with Multiple Actors (Faceware & Movella/Xsens) by Faceware, released 7 June 2022

1:14:29 Love, Death & Robots, Jibaro character creation Love, Death + Robots | Inside the Animation: Jibaro, Netflix, released 9 June 2022 and Art Dump: stunning projects made for Love, Death + Robots, 80.LV website link

1:16:48 Jonathon Nimmons WriteSeen.com, launched June 2022, website connecting creative writers with industry professionals (upload written content, attach a video pitch, audio clips, video clips and a link to a prototype if required)

1:19:08 A word of thanks to our sponsors