Dream Machine (text-to-video model)

File:Monster Camp Screenshot.jpg character Mike Wazowski in the background of one scene.]]

Dream Machine is a text-to-video model created by the San Francisco-based generative artificial intelligence company Luma Labs, which had previously created Genie, a 3D model generator. It was released to the public on June 12, 2024, which was announced by the company in a post on X alongside examples of videos it created.{{cite web |last1=LeClair |first1=Dave |title=First look — Luma's new Dream Machine could be the AI video creator we've always wanted |url=https://www.tomsguide.com/ai/ai-image-video/first-look-lumas-new-dream-machine-could-be-the-ai-video-creator-weve-always-wanted |website=Tom's Guide |access-date=June 19, 2024 |date=June 12, 2024 |archive-date=June 17, 2024 |archive-url=https://web.archive.org/web/20240617222445/https://www.tomsguide.com/ai/ai-image-video/first-look-lumas-new-dream-machine-could-be-the-ai-video-creator-weve-always-wanted |url-status=live }} Soon after its release, users on social media posted video versions of images generated with Midjourney, as well as moving recreations of artworks such as Girl with a Pearl Earring and memes such as Doge, Picard facepalm, Success Kid, and distracted boyfriend.{{cite web |last1=DiBenedetto |first1=Chase |title=Luma AI Dream Machine: What it is, how to try it |url=https://mashable.com/article/luma-ai-dream-machine-how-to-try-it |website=Mashable |access-date=June 19, 2024 |date=June 15, 2024}}{{cite web |last1=Curtis |first1=Charles |title=Dream Machine AI is turning classic memes into videos and the results are unhinged |url=https://ftw.usatoday.com/2024/06/dream-machine-ai-memes-videos |website=For The Win |access-date=June 19, 2024 |date=June 18, 2024 |archive-date=June 19, 2024 |archive-url=https://web.archive.org/web/20240619033805/https://ftw.usatoday.com/2024/06/dream-machine-ai-memes-videos |url-status=live }}{{cite web |last1=Stanley |first1=Alyse |title=People are using Luma Dream Machine to animate memes — here's 5 of the best examples |url=https://www.tomsguide.com/ai/people-are-using-luma-dream-machine-to-animate-memes-heres-5-of-the-best-examples |website=Tom's Guide |access-date=June 19, 2024 |date=June 17, 2024}}{{cite web |last1=Thalen |first1=Mikael |title=AI evangelists keep getting blown away by the Distracted Boyfriend meme being turned into a video |url=https://www.dailydot.com/debug/luma-ai-dream-machine-distracted-boyfriend-meme/ |website=The Daily Dot |access-date=June 19, 2024 |date=June 18, 2024}} One video, a trailer for a fictional animated movie titled Monster Camp, was reposted by Luma Labs on their X account. Users on the platform criticized the video as stealing the aesthetic of the Monsters, Inc. franchise, also pointing out that Mike Wazowski, a character from the franchise, appears in the trailer.{{cite web |last1=Pulliam-Moore |first1=Charles |title=An AI video tool just launched, and it's already copying Disney's IP |url=https://www.theverge.com/2024/6/18/24181375/luma-ai-monster-camp-monsters-inc-pixar |website=The Verge |access-date=June 19, 2024 |date=June 18, 2024 |archive-date=June 18, 2024 |archive-url=https://web.archive.org/web/20240618232512/https://www.theverge.com/2024/6/18/24181375/luma-ai-monster-camp-monsters-inc-pixar |url-status=live }} Another video posted by director Ellenor Argyropoulos of a Pixar-style animation of a girl in ancient Egypt created with Dream Machine went viral online.{{cite web |last1=Adarlo |first1=Sharon |title=This AI-Generated Pixar Style Animation Just Might Blow Your Mind |url=https://futurism.com/the-byte/ai-generated-pixar-style-animation |website=Futurism |access-date=June 19, 2024 |date=June 15, 2024 |archive-date=June 19, 2024 |archive-url=https://web.archive.org/web/20240619033802/https://futurism.com/the-byte/ai-generated-pixar-style-animation |url-status=live }}

{{As of|June 2024}}, users can create videos with Dream Machine, which are five seconds long and 1360 × 752 pixels, by signing up with their Google account and typing in a prompt or using a still image.{{cite web |last1=Growcoot |first1=Matt |title=This AI Video Generator is Free to Use With No Waiting List |url=https://petapixel.com/2024/06/17/this-ai-video-generator-is-free-to-use-with-no-waiting-list-luma-labs-dream-machine/ |website=PetaPixel |access-date=June 19, 2024 |date=June 17, 2024}} Dream Machine alters the prompt based on its own large language model. Users can create 10 videos a day and 30 videos for free with Dream Machine. The program also offers Standard, Pro, and Premier subscription plans, which allow users to create 120, 400, and 2,000 videos, respectively. Dream Machine's website states that its videos have difficulty depicting text and motion. Luma Labs has stated that it has plans to release a developer-friendly API for Dream Machine. The week after its release, Luma Labs announced that it would be adding the ability to extend videos, a discovery feature, and in-video editing.{{cite web |last1=Morrison |first1=Ryan |title=Luma Dream Machine AI video generator is getting a huge update — here's what's in store |url=https://www.tomsguide.com/ai/ai-image-video/luma-dream-machine-ai-video-generator-is-getting-a-huge-update-heres-whats-in-store |website=Tom's Guide |access-date=June 19, 2024 |date=June 17, 2024 |archive-date=June 19, 2024 |archive-url=https://web.archive.org/web/20240619033801/https://www.tomsguide.com/ai/ai-image-video/luma-dream-machine-ai-video-generator-is-getting-a-huge-update-heres-whats-in-store |url-status=live }}

Critics compared Dream Machine heavily to Sora, a text-to-video model created by OpenAI, and Kling, another text-to-video model, upon its release. Charles Pulliam-Moore of The Verge wrote that "bullish fans" of generative AI "were quick to call [Dream Machine] a novel innovation", but remarked upon its training data not being available to the public. Mark Wilson of TechRadar also noted that it was unclear what Dream Machine's training data was, which he said "means that its potential outside of personal use or improving your GIF game could be limited", but wrote that it was "certainly a fun tool to test drive" as "a taster of the more advanced (and no doubt more expensive) AI video generators to come".{{cite web |last1=Wilson |first1=Mark |title=A new OpenAI Sora rival just landed for AI videos – and you can use it right now for free |url=https://www.techradar.com/computing/artificial-intelligence/a-new-openai-sora-rival-just-landed-for-ai-videos-and-you-can-use-it-right-now-for-free |website=TechRadar |access-date=June 19, 2024 |date=June 13, 2024 |archive-date=June 19, 2024 |archive-url=https://web.archive.org/web/20240619114000/https://www.techradar.com/computing/artificial-intelligence/a-new-openai-sora-rival-just-landed-for-ai-videos-and-you-can-use-it-right-now-for-free |url-status=live }} For Tom's Guide, Ryan Morrison called Dream Machine "one of the best prompt following and motion understanding AI video models yet" and "an impressive next step in generative AI video", but that "it is still falling short of what is needed".{{cite web |last1=Morrison |first1=Ryan |title=I put Luma Dream Machine to the test with 7 AI videos — here's how it stacks up to Sora |url=https://www.tomsguide.com/ai/ai-image-video/i-put-luma-dream-machine-to-the-test-with-7-ai-videos-heres-how-it-stacks-up-to-sora |website=Tom's Guide |access-date=June 19, 2024 |date=June 13, 2024 |archive-date=June 17, 2024 |archive-url=https://web.archive.org/web/20240617011105/https://www.tomsguide.com/ai/ai-image-video/i-put-luma-dream-machine-to-the-test-with-7-ai-videos-heres-how-it-stacks-up-to-sora |url-status=live }} Mashable{{'}}s Chase DiBenedetto described user-created Dream Machine videos circulating on social media as "eerily-moving" and "Harry Potter-esque".

{{reflist}}

• {{Official website|https://lumalabs.ai/dream-machine}}

{{Artificial intelligence navbox}}

Category:2024 software

Category:Artificial intelligence art

Category:Video processing

Category:Film and video technology

Category:Applications of artificial intelligence

Category:Text-to-video generation