OpenAI’s upcoming Sora AI video creation tool has some sweet and creepy creative features, but a new player has emerged that has many AI enthusiasts raving about its features. Kling, developed by Chinese tech giant and TikTok competitor Kuaishou, is also already available, but with some caveats.
Kling’s capabilities surpass its competitors in several important ways. Kling can create videos up to 2 minutes long at 1080p resolution at 30 frames per second. This is a significant improvement over Pika and RunwayML, which can each generate just a few seconds, and twice what OpenAI said Sora will handle.
OpenAI’s Sora is crazy.
But KWAI just launched a Sora-like model called KLING and people are going crazy for it.
Kling comes onto the scene shortly after the launch of Vidu, another Chinese AI video creation tool developed by Shengshu Technology and Tsinghua University. Vidu produces shorter videos, but its U-ViT (Universal Vision Transformer) technology, which has already proven superior to Runway and Pika, allows it to create highly realistic and detailed videos.
Kling uses advanced 3D facial and body reconstruction technology to generate realistic movements and limb movements based on a single full-body photo. It also avoids other common problems that some AI video generators have when depicting people, such as having too many limbs or being impossibly bent.
So far, video creation AI is evolving.
“Kling,” an AI that creates videos of comparable quality to Sora, is amazing…
– Kiuchi Shodai @ SHIFT AI CEO ‘To make Japan an advanced AI country’ 𝕏 (@shota7180) June 9, 2024
Like Sora, Kling also has a better understanding of real-world physics, allowing him to more accurately simulate physical interactions between objects. It’s also designed to follow prompts precisely and create scene sequences with different views, allowing you to create more complex and dynamic videos.
Image: Kling/Kuaishou
Kuaishou released a series of demo videos showing how to render the scene Kling demonstrated in OpenAI with Sora. The video looked very realistic with good scene composition and movement. The quality surpassed Runway and Pica in terms of realism and consistency, and even surpassed Sora in some generations.
Some users have shared other creations on social media, which seem compelling enough to justify the hype.
A cute black and white border collie sticks its head out the car window, its fur blowing in the wind, smiling and sticking its tongue out. pic.twitter.com/6cuJbPqsxB
Kling is currently available as a public demo in China via a waiting list, but Kuaishou is promising a wider global rollout.
The Kling website is in Chinese and appears to require a Chinese phone number to register. You’ll also need to download the Kwaicut app before getting in line and follow the steps listed on the official Kling-AI website.
Until then, the best choices for those looking to generate AI video are Pika Labs, RunwayML, and for local generation, Stable Video Diffusion.
Edited by Ryan Ozawa.
generally intelligent newsletter
A weekly AI journey explained by Gen, a generative AI model.
