Runway recently dropped a major update in the AI video space that’s getting a lot of attention—and for good reason. This new feature, called Aleph, represents a big leap forward in how we can tweak and transform our footage, whether it’s AI-generated or traditionally filmed. I came across some fresh insights into Aleph’s capabilities and limitations, so let’s dive in and unpack what it really means for video creators and the VFX world.
What is Aleph? Changing the way we interact with video
Aleph is a new Runway tool integrated directly into their platform, designed to let you modify nearly any aspect of a video clip just by describing what you want. Unlike manual editing or complex VFX layering, you essentially chat with Runway‘s AI to make changes. For example, rather than painstakingly color-correcting or rotoscoping, you can prompt the AI to change a tuxedo’s color or remove objects seamlessly from the scene.
One interesting aspect is the emerging agentic workflow, where instead of giving step-by-step commands, you interact more naturally, almost like the AI is your collaborative assistant. But while this offers amazing convenience, it also demands clear and explicit prompts to avoid unexpected results. I found that less precise instructions often led to quite funny—and sometimes bizarre—outputs, like turning a serious character into someone completely different. So, a good manager mindset is essential: be specific, give detailed guidelines, and expect to iterate a bit.
Putting Aleph to the test: From color changes to object removal
Some of the experiments I came across highlight Aleph’s impressive range:
- Color tweaks: Running a Midjourney-generated wedding scene through Aleph and simply asking it to change a tuxedo’s color to green worked well, especially for key accessories like bow ties and collars. It wasn’t perfect (the jacket was only subtly greener), but given the minimal prompt, that’s pretty impressive.
- Traditional stock footage: The tool was tested on classic noir-style footage, adding convincing colorization and even repairing backgrounds beyond the focal point. While the current max output is just 5 seconds, this constraint actually encourages creativity and pairs nicely with AI-generated clips.
- Facial tweaks: Changing expressions—for instance, morphing a stoic character into laughing or smiling—works about half the time without drifting too far from the original look. But pushing these kinds of changes requires care, as faces can quickly lose resemblance.
- Adding objects with visual prompts: Borrowing Midjourney-generated sunglasses and superimposing them onto a character in Casino Royale was an entertaining example of pairing visual and textual cues. It wasn’t perfect, but the concept of multimodal instruction opens up exciting creative doors.
- Object removal and scene cleanup: One of Aleph’s real power moves is erasing unwanted items—like a knight in an AI-generated fantasy battle—cleanly from footage. This also applies to removing subtitles from V3 videos, which can speed up the editing process significantly.
Aleph’s object removal feature isn’t just a gimmick—it’s redefining what’s possible when cleaning up or altering existing footage.
Real-world creative applications and limitations
What stood out to me most was how Aleph handles real footage from DSLRs and smartphones. Traditional media isn’t always easy to work with because it’s messy and complex, but Aleph showed real promise in enhancing these clips with subtle but effective modifications.
Creative users in the community are already exploring this tech in fun and inventive ways—from shifting camera angles to creating new VFX passes on footage that was never shot in the first place. Imagine a fantasy queen guest-starring on The Office, or a Joker scene flipped to reveal a ridiculous documentary crew trailing behind—these examples show how AI-assisted creativity can be wacky, powerful, and sometimes totally unexpected.
More Read
That said, Aleph isn’t magic yet. There are definite quirks, especially when trying to maintain exact style, color grading, or precise details. I encountered cases where removing subtitles or visual prompts radically altered the scene’s atmosphere, requiring multiple attempts and very careful prompting to get it right.
What this tells me is the road ahead will be a back and forth between human vision and AI capabilities—a kind of creative tug-of-war that keeps things interesting.
Key takeaways
- Aleph is a significant step forward in AI video editing, enabling complex modifications through natural language and visual prompts.
- Prompt clarity is crucial—vague or lazy prompts can lead to unintended outputs, so detailed instructions help maintain control and consistency.
- Current output limits (5 seconds) encourage creative workflows and integration with other AI-generation tools rather than full-length polished content in one go.
- Object removal and subtitle editing are standout features that speed up editing and open new creative possibilities.
- Aleph isn’t the death of VFX, but a complementary evolution that could change how filmmakers and artists approach their craft.
Looking ahead
The pace of innovation in AI video tools like Aleph is exhilarating. Alongside it, other advancements are unfolding, like newer versions of Runway’s Act 2 and exciting character creators from different platforms. One platform that caught my interest is Showrunner, which, despite a quirky interface, runs a legit world model allowing characters to act autonomously within shows—adding depth beneath the surface.
So, while Aleph is just one piece of the puzzle, it points toward a future where AI will be deeply woven into video production workflows—not replacing humans, but teaming up to create and imagine in new ways. I’m excited to keep exploring this evolving landscape and see how creators push these tools beyond their current boundaries.
For anyone interested in AI video, now’s a great time to experiment. Keep an eye on Runway’s Friday drops—they tend to have surprises. And as always, the real magic happens when you mix human creativity with these emerging AI capabilities.
