#5 Choo choo! Let's jump on the hype train of video AI
Yes we’ve seen the announcements: Pika.Art is introducing a new way to use text-to-video AI. But since we can’t use the system yet (what’s up with that though), we are not ready to discuss this yet. Instead, in this week’s edition of our bi-weekly innovation newsletter: Stable-video-diffusion by Stability AI makes your images move, Bard is binge watching your favourite youtube series and AI safety company Lakera (AI safety company) launched a new version of Gandalf the prompt injection tester. Also, we want to tell you all about our personalised AI stories we build for HEMA. Let’s go!
Stable-video-diffusion makes your images move
AI generated images are getting better by the day, now that OpenAI launched Dall-e-3 we can even use it with ChatGPT and via their API. The next step will be the generation of video content by generative AI. This can be done in a couple of different ways, instead of generating an entire video from text it's also possible to make still images move. Stable-video-diffusion makes it possible to make any image move for a few seconds. Just like this example below.
This model is fully open source so you can run it yourself, optimise it yourself or get alterations of it other people made. Runway did just this by building an inpainting tool on top of Stable-video-diffusion. With this tool you can choose which parts of a video get animated and which parts don’t. This also called frame interpolation.
Bard is binge watching your favourite youtube series
As many don’t realise, Youtube is the second largest search engine by volume. Therefore it has an enormous amount of information and knowledge stored from all over the world. All of this information is now accessible within Bard, whether you want a summary of your favourite recipe in Youtube. Or maybe you have a few questions about a DIY-project you have been working on. You can ask all kinds of questions about every video on Youtube.
But this does raise a few interesting questions. For example, this example shows a video of a recipe and Bard gives you a written recipe with ingredients. But normally this written recipe is behind a paywall. So how good is this for creators that have side businesses that leverage their Youtube videos for reach and attention? Something to consider..
Gandalf the truth teller
Earlier this year, Lakera (a LLM safety company) launched Gandalf. A fun game where people get the chance to retrieve a hidden password from an AI trained not to give out the password. This game is ultimately introduced to learn how people try to use prompt injection in tricking a LLM.
Prompt injection is a technique used in interactions with AI language models, where additional instructions or commands are inserted into a prompt in an attempt to alter or influence the AI's response. This can be done for various purposes, such as trying to bypass restrictions, manipulate the output, or explore the capabilities and limits of the AI.
Lakera now launched a new version of the Gandalf game. Giving people the ability to try to outwit the AI into telling the secret password. It’s a great way to learn more about the way LLM’s work and how safety measures are implemented.
Try it yourself via https://gandalf.lakera.ai/adventure-6
Your Personal AI bedtime story with HEMA
Integrating AI into the creation of personal stories and texts represents a significant advance in content creation. AI enables us to generate unique, tailor-made stories, from romantic Valentine's cards to children's stories and even useful texts like motivation letters and blog posts. This technology not only offers a more personalised experience for users but also opens new doors for creative and educational purposes.
An AI-generated personal story can take many forms. From a secret love card for your Valentine at KLM, to a Sinterklaas poem, or a bedtime story for children, as we have done for HEMA. These applications can be both entertaining and educational, from assisting in writing motivation letters and blog posts to creating personalised emails.
How wonderful would it be to receive a poem, story, or text tailored specifically to you, instead of a standard message? This is our passionate focus, and we'd love to take you on this adventure.
Read all about how this works in our latest blog: https://www.livewall.co/blogs/ai-driven-story-creation-revolution