What do AI, 48 hours and Second Life have in common? Not a lot, beyond some stunningly creative pieces that we found for you this week!
AI films are now beginning to come through and we have two very interesting ones for you to take a look at. The first is created/prompted by Matt Mayle (our feature image for this post) and has been made using Elevenlabs (voice), Runwayml’s GEN2 (animation) and ChatGPT4 (text concept) and is described an ‘AI assisted short’, called The Mass (released 26 April) –
The second is called The Frost, by Waymark Creative Labs (released 5 June). This has a distinct aesthetic to it, encapsulates a curious message, and overall reflects the state of AI animation at this stage, but its nonetheless a gripping piece. Its been created with DALLE-2 and D-ID –
Our next pick was made in 48 hours (well, with a bit of tweaking on top) and has been made in Unreal Engine, called Dude Where’s My Ship by Megasteakman. To be frank, the speed of its creation does show in the final quality of film, but its nonetheless an interesting development, especially given that I was a regular judge on the 48 Hour Filmmaking Contest a few years ago. The machinima version of that contest was managed and supported by Chantal Harvey for several years and its astonishing to think that this is the next generation of that process –
Finally, this week, a film made in Second Life, which lends itself to flash production, based on content from a plethera of creators on whom its content relies. The film is called The Doll Maker (released 27 May) and has been made by FeorieFrimon using various models and Paragon Dance Animations movements to a Beats Antique music composition called Flip –
Our review of inspirational projects often includes work which is NOT machinima, and this week we have picked out a couple that we’re sure our followers will enjoy too… of course, interspersed with examples of great machinima projects. Not least, this includes the podcast’s Damien’s (aka Darth Angelus) Star Wars fan series, a stalwart of the Second Life machinima creator community, Tutsy NAvArAthnA, whom Tracy interviewed a couple of years back here, and the only stereoscopic machinima we’ve actually seen!
The Classics: from Star Trek to Star Wars
Firstly, a parody of the original Star Trek series, this is the latest episode of Mark Largent’s long-running Stalled Trek project. The ep is called The City of the Edge of Foreclosure (released on YT on 25 April). It is based on Harlan Ellison’s epic episode called The City on the Edge of Forever, which originally aired in 1969 should you want to look it up on IMdB. As Largent says in those importal words ‘You cannot have your fate, and Edith too’!
Damien’s Star Wars series, Heir to the Empire, is featured on SFW Magazine’s website here. The article explains Damien’s process for animating the original novel by Timothy Zahn. You can watch the whole series on his channel, or the latest episode here –
and plus, given the recent pap interest in Damien, we can confirm that he is NOT married, or at least, he’s never declared that status to us!
This is a great fun short stop-mo by Winga (released 4 May). Yes its an ad for an AI-using mobile phone image tracking stabilizer called Insta360, but definitely worth a view. The back end of the vid is an explainer of the kit and how Winga shot the film, also worth a view –
The REAL Metaverse
In this short, Mon Metaverse (released 16 Jan 2022), well-known Second Life creator and documentarian Tutsy NAvArAthna, discusses his observations on the metaverse, the promise of Second Life and the sinister ways in which some are turning the ‘digital screw’ by orchestrating our online experiences. The film features the creative work on dozens of creators (see the film credits for details). There’s an advisory warning with this but, then again, that’s the point being made (its also our featured image for this post). With Second Life having recently celebrated its 20th year, its timely to share the work too –
I knew if we waited awhile someone would share a stereoscopic machinima with us… if you recall, Tracy highlighted there were very few (if any) that had been made, a point arising from the panel discussion at the Oberhausen International Film Festival earlier this year (reported here). Well, here you go. This short has been made by the uber-talented Second Life creator Ataro Asbrink. It is called Mandala Moods 3D and is a hypnotising example of what’s possible. You will need anaglyph glasses to appreciate it of course –
We’ve been following the debate on copyright, fair use and transformative use of IP for what seems like 30 years in the world of machinima (see some of our posts here, here and here) – oh, actually its 27 years…! On 18 May, the world was exercised a little further on the issue of transformative use when the Supreme Court (US) reached its decision on Andy Warhol’s use of a photograph of Prince in a magazine – a case that’s been running since 2016, following Prince’s death. Many suggested this decision is the beginning of end of transformative use – or at least ‘narrows the ‘fair use’ doctrine‘ – and will have massive detrimental impacts on all things created, such as machinima from games engines… however, with the particular scenario fully outlined, this was probably the right outcome for this case. The scenario relates to an unattributed use of an image from a private collecton of works (created and held by Warhol/foundation), where other works involving the same creatives in the collection had previously been attributed and the photographer recompensed when having been used in magazines, and the fact that both Warhol and the photographer (Lynn Goldsmith) made money from selling images individually. So, this decision is about context of use involving the individuals as much as it is ‘fair use’ per se. Justice Sotomayor stated the important factor in the fair-use analysis was that “the purpose and character of the use, including whether such use is of a commercial nature or is for nonprofit educational purposes” pushed the decision in favour of the photographer, arguing that “licenses, for photographs or derivatives of them, are how photographers like Goldsmith make a living. They provide an economic incentive to create original works, which is the goal of copyright.” You can read the ruling in full here – or use your favorite search tool for a link to any one of the numerous news articles covering the case.
So, until such time as the principle applied in this case is actually applied to a creator context, where income is rarely a goal of productions beyond individual recognition and perhaps the meagre YouTube % share for eyeballs it receives, and transformation is generally well beyond that originally intended by say a game dev, it feels like there’s nothing to see here.
On 23 June, Second Life turns 20 years old! There will be virtual parties, exhibitions, product sales and more – for 20 days of course, and you can find out more on the community website here. Happy Birthday to all the Lindens – the first open world environment to truly embrace metaversal themes.
If you want to catch up on some light reading, then its also worth noting that Wagner James Au’s new book releases a week later on 27 June, called Making a Metaverse that Matters. Au also regularly writes some great updates for what has to be one of the longest-running metaverse blogs. Its called New World Notes, which he founded in 2006. Au was the first metaverse journalist and marketer for SL back in 2003. Links to the book here –
Excited to tease the cover for my book, "Making a Metaverse That Matters"!
In stores next month. Please consider pre-ordering.
Nvidia are releasing a monthly update on its blog of all things Omniverse, including latest advancements for the OpenUSD framework that has so quickly become the gold standard for integrating a wide range of creator tools in a 3D workflow. Here‘s the link to the first part of the ‘Into the Omniverse’ series (our feature image for this post) which includes an overview of an update to the connector for Adobe Substance 3D Painter. Substance 3D releases its latest version 203.0 in mid June. This series is a must follow for all content creators, whether or not you own an RTX!
For those seeking advice on devising a virtual production pipeline, Unreal Engine has helpfully released a visualisation guide here and a nice vid here –
Unreal Engine released version 5.2 on 11 May, which includes some fab new features including a preview of its still in dev Procedural Content Generation framework, enabling creators to populate large scenes more efficiently; Substrate, that supports a greater range of surface appearances such as the opalescent finish showcased in this vid –
an enhanced virtual production set of tools for realtime filmmaking support; enhanced VCam system for multi-camera control; and nDisplay extended support, which is setting the scene for the next version 5.3. A link to the release notes is here.
We also spotted a useful tool in the UE Marketplace albeit pricey at $249 for indies: MetaShoot. It includes lighting and render presets for assistance with creating sophisticated lighting setups in your VP studio, released by VINZI – Code Plugins, link here.
Also super helpful is Kitbash3D’s new Cargo asset browser, including some 10,000 searchable assets. The basic account, which is free, allows you to 1-click upload content to your project and manage the assets you have but for a fee of $65/month, the pro version will let you search and access the full model and media library. Its another layer of cost so do check out the small print.
Phil’s project to restore Machiniplex films starts with the release of his own Male Restroom Etiquette (originally released in 2006), with a hosted premiere of the HD remastered version on 11 June. The film was listed in the Guinness Book of Record’s Gamer’s Edition in 2009 as the most viewed machinima on YouTube at the time. Link here –
I was privileged to have been invited to Oberhausen International Short Film Festival (Germany, 26 April to 1 May) by Dr Lars Henrik Gass, Festival Director, Katharina Schroder, Theme Coordinator and the programme curators, Dmitry Frolov and Vladimir Nadein for the first programme of avant-garde and experimental machinima films at a major European film festival to take place. I was also delighted to see machinima work, created by Alice Bucknell, featured on the programme magazine’s front cover too! I was there, primarily, to participate in a panel discussion with Gemma Fantacci, one of the organisers of the Milan Machinima Film Festival, and two artist-curators from the US and Hong Kong respectively, Alice Bucknell and Ip Yuk-Yiu.
The programme, entitled Against Gravity, was themed to loosely represent a video-game/machinima creative experience, from Starting the Game, Holding the Controller, Crack the Code, Don’t Forget to Save, Opening the Map, Unlock the Real, Cosplay As…, and a retrospective of Phil Solomon’s work, called Interplay, a filmmaker whose turn to machinima in later life was the inspiration for the festival theme. As one might expect, the organizers dive into each sub-theme to tease out their narrative through a selection of works across a span of 27 years of machinima practice. Unfortunately, I didn’t arrive in time to see all the selections, but the ones I did see were very interesting.
Image: Programme Cover (link to Festival programme here)
Many of the films were ones I had not previously seen – experimental films tend to be distributed in a different way to traditional machinima, using mostly artistic channels, and so often make their way directly to independent film theatres and galleries as a consequence. This of course diverges from the traditional approach to machinima-making of community-shared content, through which debate and practices are openly discussed. What was interesting with the presentation was the mix of older work with more recent pieces, effectively positioning machinima in a narrative of avant-garde practice and demonstrating experimental applications by artists/filmmakers for an audience that clearly had interest in the work if little experience of machinima or games specifically. I got the distinct sense of the emergence of a new generation of machinima fans – both creators and audience – and also the sense there is demand for a new way to experience machinima on larger screens from this audience, especially with technological advancements that make quality of content higher resolution and approaches employed by artists accessible in the experimental tradition of film viewership.
It was also interesting that the foundation of machinima was considered relevant to the presentation of avant-garde works both because its origins lie within 3D real-time games engines and also because the use of game as a creative matrix for storytelling beyond gameplay conveys subversion, virtuality and transcendence – all themes that resonate well with the experimental arts movement. Drawing on Solomon, however, the rationale for including machinima was the transformation from analogue forms of film to digital, with all the nuances that brings – relating to the breadth of creative practices, methods of transferring work for exhibition, storage and also presentation to audiences. What was interesting in this is that many at the festival seem to have little conception of either the term machinima, the game communities from which it emanates or its impacts on popular online culture. Filmmakers selected appear to have forged their own practices, sometimes as multimedia artists, using games as found tools and environments. Some were clearly also a little reticent about being associated with its background and origins, the taint of the M.com years, and probably alongside that the many issues the community has collectively faced in relation to the recognition of originality, ownership and authorship of works created.
Of the themed selections I saw, in Open the Map, the idea that games whet the appetite for utopian experiences was demonstrated through the selection of two films. The first was a documentary about a group of queer teenagers living through the challenges of Covid by escaping into Minecraft to connect with each other in a virtual safe space they made their own. The film, Tracing Utopia (2021), was directed by Nick Tyson and Catarina de Sousa, and was based on their observations of working with the teenagers over an extended period of time. It highlighted well the essence of community and collaboration, something that has always been the heart of machinima. The second was Alice Bucknell’s three-channel installation converted for the festival to a single channel, called The Martian Word for World is Mother (2022). This film was made in Unreal Engine and showed three different visualisations of Mars (the Green, the Blue and the Red), each being a post-human perspective on the future colonisation of the planet, drawing inspiration from popular sci-fi tropes on the interplay between ecological, economic and political ideologies. These include Elon Musk (terraforming), Donna Harraway (Cyborg Manifesto), Ursula K Le Guin and Kim Stanley Robinson’s 2009 Mars trilogy, among others. It is Bucknell’s Blue Mars that is shown on the front cover on the Oberhausen Film Festival programme, illustrating how multinational organizations convert permafrost into water for sale back to Earth – something she presents as a speculative near future. Not exactly a vision of utopia per se but her Green Mars was an interesting approach to reflecting on how the technologies used to exploit Mars in her Red and Blue versions may help Mars bring back to life its former natural habitat for its own end. She includes a mystical (textual and aural) language that was created using Scottish Gaelic, Helene Smith’s invented Martian language and sounds of Arctic wind, created using a text-to-speech AI and the assistance of OpenAI’s GPT-3. A fascinating creative process and captivating to watch and listen to.
image: Tracing Utopia
In Unlock the Real, older films were used to position machinima through documentaries, for example Harun Farocki’s Parallel I (2014) showed how games have advanced in their representation of assets such as trees, clouds, water and fire from the earliest machine dashes in the 1980s, to squares of the early 1990s, to more modern mesh representations such as in GTA in the 2000s. That reflective process of course, with recent developments in the representation of fluid, skin and movement dynamics integrated now into so many tools that creators use, whilst incomplete in Farocki’s work perfectly illustrated how games have focussed on advancing realism. This was then followed by works that demonstrated aspects of even greater realism, from shape and form, to speed of movement (Benoit Paillé’s Hyper Timelapse GTAV, see below), to representation of human experiences and the interplay between virtual and real, and even the way that in-game corruptions of brands really don’t hide what they represent any more (Jacky Connolly’s Decent into Hell, 2021). Indeed, Connolly’s clever interweaving of photographs and real film into the GTAV landscape was quite a trippy experience. It is not often one sees that trajectory so clearly but Vladimir and Dmitry’s curation made it easy for less experienced machinima followers to make the connections between virtual game worlds, film and real-life experiences.
Benoit Paillé’s HYPER TIMELAPSE GTAV (CROSSROAD OF REALITIES) (available on Les Nuits Photo Festival Vimeo channel, released 30 Nov 2015) –
The Phil Solomon retrospective, themed Interplay, was equally fascinating, with introductory comments by Ip Yuk-Yiu and Lynne Sachs who both knew him personally. Solomon was a key influencer in the US avant-garde film scene, and one of his early works had previously won an award at the Oberhausen Film Festival (Remains to be Seen, 1990 – a clip of which you can see on this Vimeo channel). Vladimir and Dmitry selected two of his early photochemical 16mm films: The Secret Garden (1988) and Twilight Psalm II: ‘Walking Distance’ (1999). These had a mesmerising depth to them apparently achieved by applying an emulsion to each frame and then transferring it using an optical reader. They were juxtaposed with the subsequent selection of Solomon’s tribute following the passing of his lifelong friend, Mark LaPore, in a trilogy of machinima films made using GTA (San Andreas). The trilogy was called In Memoriam: Rehearsals for Retirement (2007), Last Days in a Lonely Place (2007) and Still Raining, Still Dreaming (2008). Interestingly, Yuk-Yiu commented that he never fully appreciated Solomon’s machinima work when it was released. This was primarily because he could not see a connection to his previous work yet the interplay was evidently between chemistry and code (analogue and digital) techniques as well as presence/absence represented by the virtual world. However, the rather melancholic scenes in the machinimas, which seemed to somehow represent Solomon’s search for his friend through the glitches in the game world, may also have been connected through another film that Solomon made with LaPore in GTA, released just a few days before he died, called Crossroad (2005).
image: Vladimir Nadein and Dmitry Frolov introduce Interplay with Lynne Sachs (right) and Ip Yuk-Yiu (left)
I really enjoyed the opportunity to participate in the panel discussion as well as the various follow-up chats with others visiting the event. On the panel, each of us had very different experiences and perspectives of machinima, and we were asked some great questions about how we came to machinima, how we see it evolving and what its future will be. A question that emerged was at what point is the term machinima no longer relevant. From an avant-garde perspective, some questioned whether machinima’s history got in the way of framing their work. Well, of course, many of us long-timers have had those discussions over the years but it was interesting to hear others discuss this too. I really liked how the critical reflection suggested that it is its adaptability in reflecting latest technological and game advancements as ‘machine cinema’ that keep it apart from other creative practices – an observation I like to think the pioneering Hugh Hancock would have been supportive of.
Machinima is also clearly a good fit with the avant-garde scene, which of course is well reflected in Matteo Bittanti et al’s VRAL Patreon project, where you can find monthly film selections and interviews with creators. Matteo is also one of the founders of the Milan Machinima Film Festival, along with Gemma Fantacci, a student of game-related counter-culture, whom I had the pleasure of meeting in person for the first time in Oberhausen (although earlier this year we also chatted for the Digra Italia talks series). Indeed, a number of the directors included in the machinima theme at Oberhausen were ones the Milan team have featured, as indeed have we on the CM podcast.
Another interesting audience question was also about the nature of 3D and its continual re-emergence in film, and how it differs in games. It was clear that with a primarily film-based audience, some struggled to appreciate the nature of 3D and realtime concepts that are so well understood in game worlds. Of course, anything rendered for a 2D screen immediately makes it difficult to imagine depth dimensions, or indeed the methods used to capture and edit scenes, for example using mod tools within 3D environments. Part of the reason is the different uses of the term 3D: in-game experiences are a 2D illusion of a 3D representation rendered through a screen. 3D films in contrast are a fixed view perspective generated by overlaying stereoscopic views. I’m sure they exist but, thinking about this, I don’t recall ever having seen a 3D stereoscopic machinima. Nonetheless, the nature of machinima remains a challenging aspect to communicate and convey – as indeed do the differences in the experience one has when viewing the work in a publicly shared environment such as a cinema, gallery or arcade compared to desk-based screens, handheld or even hyper-personal VR screens. For example, most machinimas we review on the CM podcast have never been intended for consumption on the ‘big’ screen and it certainly isn’t made using large format screens. This is something I recall thinking about at great length for the 2007 European Machinima Festival as well as the various showcases of works I’ve made over the intervening years, not least because detail is emphasized in ways that is never really experienced in a 3D game environment. And even though many avant-garde works are intended for larger format screens, this aspect does not seem to be a particular focus of directors. Thus, the 3D/2D transformation highlights another important yet completely unexplored and unappreciated aspect of machinima as avant-garde or experimental film, perhaps related to the closed distribution methods and consumption experience design strategies used as previously highlighted.
In sum, Oberhausen International Short Film Festival was a fascinating in-depth review of different avant-garde perspectives on machinima. It was a real pleasure to have time to talk to some of the participants in the programme who made the journey from across the world to attend. I was especially thrilled to see the baton for the development of a new appreciative community being picked up by Dmitry and Vladimir – the huge effort they had made in devising the programme, engaging with creators and connecting the dots across the generations of machinima and filmmaking traditions was outstanding, and evidenced in most of the theme sessions selling out. I was really pleased to hear they are potentially going to be doing more of this in future and I’m certainly looking forward to catching up with them soon to hear their reflections and future plans too.
And finally, something I haven’t experienced since I was a teenager was the beautiful plush setting of the cinema in which the programme took place, complete with red velvet curtains and projectors (when required) at the Lichtburg (meaning ‘fortress of light’) Filmpalast Gloria auditorium (see above). Oberhausen is the oldest German short film festival, founded in 1954, and one of the most significant for the development of production conditions in Germany. In 1962, the Oberhausen Manifesto declaration by 26 filmmakers at the eighth festival is attributed with having created the basis for the success of New German Cinema worldwide. I therefore thoroughly recommend finding the time to visit and support a future festival.
Summary of Themes and Films
A listing of the films shown for each theme is as follows –
Start the Game
Everyday Daylight by Total Refusal (Austria), performed live with GTAV
Vladimir Nadein (b. 1993, Moscow) is a curator, artist and film producer based in Taipei, Taiwan. His works were presented at the solo exhibition Deep Play, VT Artsalon and Greater Taipei Biennale. He produced an award-winning film Detours, supported by Hubert Bals Fund, received the Eurimages Lab Project Award at Les Arcs Film Festival and was shown at Venice Critics’ Week, Viennale, Thessaloniki IFF, Berlin Critics’ Week, FICUNAM, Jeonju IFF, IndieLisboa, Beldocs, FILMADRID, Camden IFF, TFAI, Barbican Centre among others. In 2016, Nadein co-founded the Moscow International Experimental Film Festival and directed it for five editions. He curated special programmes and screenings for the 17th Venice Architecture Biennale, Hamburg Short Film Festival, Moscow International Biennale for Young Art, Garage Museum, University of California, Los Angeles and other venues. Nadein tutored at the Moscow School of New Cinema and is a member of the filmmaking duo together with Dina Karaman.
Dmitry Frolov (b. 1988, Kaliningrad) is an art and film curator and researcher based in Izmir, Turkey. He holds a BA in Сultural Studies from the Russian State University for the Humanities and an MA in Film Programming and Curating from Birkbeck, University of London. He has curated a variety of screenings, panels, performances and exhibitions dedicated to such artists as Maya Deren, Chris Marker, Tony Conrad, Vladimir Kobrin, Yoko Ono, Michael Snow, Annabel Nicholson, James Benning, Alain Cavalier, Aura Satz, Cao Fei, Ana Vaz, Cyprien Gaillard, etc. His texts have been published in Iskusstvo Kino, Spectate, Colta.ru, Syg.ma and other media. Since 2017, he has been working as a curator at the Moscow International Experimental Film Festival (MIEFF). Currently, he is also working as a film curator at Pushkin House, London.