#11 Bringing mini games to life and creating a new festival with AI
In this Substack, we dive into how AI is changing the game for creators. From Google DeepMind's Genie, which transforms drawings into playable mini-games, to the innovative ways AI is reshaping video production, we cover the essentials. Let’s spotlight AI's role in creating a multilingual commercial for Trivago and discuss its broader impacts on the industry, including significant decisions by figures like Tyler Perry. Plus, we share our journey creating BotanicBeats, a festival trailer made entirely with AI tools, showcasing the creative potential at our fingertips. Let’s go!
Google DeepMind's Genie: Bringing Your Mini-Games to Life with AI Magic
Imagine being able to create a fully playable game from just a single image. That's exactly what Google DeepMind's latest breakthrough, Genie, allows you to do. With their new project, "Genie: Generative Interactive Environments," they're pushing the boundaries of what's possible with generative AI. What sets Genie apart is its grasp of the basics of physics, like gravity and collision. These are essential for crafting a 2D game that feels real and fun. It's like having a magic wand that turns your ideas into engaging mini-games, complete with all the jumps, falls, and bumps you'd expect.
The magic starts with just a 2D image. There's no need for complex instructions or videos. Imagine creating a game from a drawing you made or an image generated by AI, like Dall-e-3. Whether it's whimsical cartoons or simple sketches, Genie brings them to life as playable games. Think about the possibilities – turning your doodles and dreams into interactive experiences!
Beyond the fun of game creation, Genie's understanding of physics hints at something bigger. This technology could one day help robots navigate and interact with our world more naturally. It's a step toward machines that see and understand the world a bit more like we do. In essence, Genie isn't just about creating games. It's a glimpse into a future where AI can transform our sketches and imaginations into real, interactive worlds. And who knows? This could be just the beginning of a new era where technology truly understands the physical world around us.
The big AI shift in Video Production
The world of video production is witnessing a significant shift, thanks to advancements in artificial intelligence (AI). Remember the not-so-impressive AI-generated videos circulating a year ago? Fast forward to today, and we're talking about Sora, a groundbreaking AI that's reshaping how videos are made. This isn't just speculation about the future; it's happening now, with tangible effects on the industry. A few things we are noticing:
The Rise of AI in Advertising: A Look at Trivago's Multilingual Commercial
Take Trivago's latest TV commercial, for instance. On the surface, it seems like any other ad. Yet, it stands out by being available in 20 different languages, all made possible by AI. This leap from having to organise 20 separate shoots with different spokespeople to just one actor and a single production speaks volumes. It's a clear sign of how AI is streamlining the creative process, making it more efficient and far-reaching.
and
      2. The Economic Ripple Effects: Tyler Perry's Pause on a $800 Million Investment
The impact of AI like Sora extends beyond production efficiencies. It's causing industry heavyweights to rethink their strategies. Tyler Perry, a big name in production, has put a massive $800 million investment in new buildings on hold after witnessing Sora's capabilities. This decision reflects the broader implications for related industries such as construction, transportation, and equipment manufacturing all. AI's influence is immediate and wide-ranging, challenging us to reconsider the economic landscape of video production. Â
      3. Making images sing or speak with the EMO research paper by Alibaba
AI's potential to revolutionize video content is not limited to commercials. Alibaba's EMO research showcases how AI can create videos of characters singing or speaking with lifelike precision. Tools like Synthesia and HeyGen have already provided glimpses into this future, but EMO pushes the boundaries further, offering almost indistinguishable from reality videos.
Imagine combining EMO's capabilities with tools like Sora. We could see AI-generated music videos that require minimal human intervention, opening up new creative possibilities and redefining the role of technology in art and entertainment.
Generating a full on festival trailer with AI
We embarked on an ambitious project to produce BotanicBeats, a festival trailer entirely crafted using cutting-edge AI technology. Our jungle-themed trailer was brought to life through the integration of various AI tools. The script and shot list were meticulously generated by ChatGPT, ensuring they resonated with our theme's essence. Elevenlabs lent its capabilities to create a compelling voice-over that narrated our vision with clarity. To complement the jungle vibe, music was ingeniously created with Stable Audio. The visuals were not just imagined but brought to life by Midjourney, with StableVideo stepping in to animate them into a cohesive video. To bring it all together, a human touch was applied to assemble all AI-generated elements, culminating in the production of the final trailer.
Check out the trailer below!
 | A guest post by
|