• Alberto Taiuti – World Models, the restyle and control AI technology that could displace 3D

    https://substack.com/inbox/post/153106976

    https://techcrunch.com/2024/12/14/what-are-ai-world-models-and-why-do-they-matter/

    A model that can generate the next frame of a 3D scene based on the previous frame(s) and user input, trained on video data, and running in real-time.

    World models enable AI systems to simulate and reason about their environments, pushing forward autonomous decision-making and real-world problem-solving.

    The key insight is that by training on video data, these models learn not just how to generate images, but also:

    • the physics of our world (objects fall down, water flows, etc)
    • how objects look from different angles (that chair should look the same as you walk around it)
    • how things move and interact (a ball bouncing off a wall, a character walking on sand)
    • basic spatial understanding (you can’t walk through walls)

    Some companies, like World Labs, are taking a hybrid approach: using World Models to generate static 3D representations that can then be rendered using traditional 3D engines (in this case, Gaussian Splatting). This gives you the best of both worlds: the creative power of AI generation with the multiview consistency and performance of traditional rendering.

    https://diamond-wm.github.io

  • Ethan Roffler interviews CG Supervisor Daniele Tosti

    , ,

    Ethan Roffler
    I recently had the honor of interviewing this VFX genius and gained great insight into what it takes to work in the entertainment industry. Keep in mind, these questions are coming from an artist’s perspective but can be applied to any creative individual looking for some wisdom from a professional. So grab a drink, sit back, and enjoy this fun and insightful conversation.



    Ethan

    To start, I just wanted to say thank you so much for taking the time for this interview!

    Daniele
    My pleasure.
    When I started my career I struggled to find help. Even people in the industry at the time were not that helpful. Because of that, I decided very early on that I was going to do exactly the opposite. I spend most of my weekends talking or helping students. ;)

    Ethan
    That’s awesome! I have also come across the same struggle! Just a heads up, this will probably be the most informal interview you’ll ever have haha! Okay, so let’s start with a small introduction!

    (more…)
  • FFmpeg – examples and convenience lines

    , ,

    # extract one frame at the end of a video
    ffmpeg -sseof -0.1 -i intro_1.mp4 -frames:v 1 -q:v 1 intro_end.jpg

    -sseof -0.1: This option tells FFmpeg to seek to 0.1 seconds before the end of the file. This approach is often more reliable for extracting the last frame, especially if the video’s duration isn’t an exact multiple of the frame interval.
    Super User
    -frames:v 1: Extracts a single frame.
    -q:v 1: Sets the quality of the output image; 1 is the highest quality.

    # extract one frame at the beginning of a video
    ffmpeg -i speaking_4.mp4 -frames:v 1 speaking_beginning.jpg

    # check video length
    ffmpeg -i C:\myvideo.mp4 -f null –

    # Convert mov/mp4 to animated gifEdit
    ffmpeg -i input.mp4 -pix_fmt rgb24 output.gif
    Other useful ffmpeg commandsEdit

    (more…)