video ai researcher in bay area, CA • cinema, art, perception • movies are prompts

Joined August 2024
705 Photos and videos
Pinned Tweet
Jan 31
AI cinematography series - EP1: Can AI understand a DUTCH ANGLE? In cinema, tilting the camera creates psychological unease (think The Third Man). I tested this with Runway and Grok, paid subs. Both completely failed. Here's why that matters:
2
1
536
Feb 8
honestly, people are sleeping on Video AI. this is just ByteDance Seedance 2.0. imagine what 3.0 does - probably forces a completely new paradigm in moviemaking altogether. think about it: not much has changed in how we *perceive* cinema. screens got bigger. that's... it? maybe this is where cinema actually starts changing. maybe the new cinema is spheres? immersive spaces instead of flat rectangles? especially when the cost to produce these experiences is dropping to near-zero. the distribution changed. the medium? still stuck in 1960. that might be about to break.
Feb 7
this is much better than many hollywood scenes! bytedance seedance 2.0 is cinema
1
2
179
Feb 7
this is much better than many hollywood scenes! bytedance seedance 2.0 is cinema

1
346
Feb 7
this is literally how the next billion-view YouTube music videos are going to be made!

1
43
Feb 6
Damn, this building doesn't need VFX to feel like a sci-fi set. That's the whole point. Brutalist architecture does what most CGI can't - it creates mood through mass and void, not decoration. Clean sight lines, natural framing, built-in depth. The camera just shows up and the shot composes itself. Otani understood cinematography without ever touching a camera.
The Kyoto International Conference Centre designed by Sachio Otani
2
91
Feb 6
AI cinematography series - EP7: I tested 7 cinematography techniques against Grok and Runway. Final test - CHIAROSCURO: Caravaggio-style lighting. Half the face in light, half swallowed by shadow. Tutorial: youtube.com/watch?v=NzCXVfzQ… This was the only test about LIGHT, not cameras. And both nailed it. Runway: cinema-grade detail, skin textures, deep shadows. But temporal flickers on skin broke the illusion. Grok: rock-solid consistency frame to frame. But the fine details weren't there. After 7 days, the pattern is clear: AI understands what a scene LOOKS like. It doesn't understand how to FILM one. Lighting, mood, atmosphere - yes. Camera angles, movement, lens physics - still broken. These models were trained on frames, not cameras. Final score (see table attached): Grok: 5 | Both passed: 1 | Both failed: 1 Runway: 0 This series taught me more about how AI 'sees' than any paper I've read. #AIVideo #Cinematography #AIFilmmaking #Runway #Grok
71
Feb 5
AI cinematography series - EP6: Can AI understand SPLIT DIOPTER? (Near object AND far object both in sharp focus - defying normal depth of field rules) After Grok's dominance on camera movement, does it understand lens OPTICS? Let's find out:
1
91
Feb 5
We're at Day 6. The conclusion is forming: If you want AI that understands how CAMERAS work → Grok If you want AI that creates PRETTY VISUALS → Runway But cinematography is about the camera, not just the image. One more test tomorrow to solidify this.
1
39
Feb 5
TOMORROW: CHIAROSCURO LIGHTING (High contrast light/shadow) Final test. This is about LIGHTING technique, not camera mechanics. Will Runway finally win one? Or does Grok understand visual techniques too? EP7 drops 8am. Series finale.
29
Feb 5
we're watching temporal coherence become a "commodity"
Kling 3 is a remarkable model. This was a one-shot generation from an input image and text prompts - the model retained character, scene, and voice consistency across cuts 🤯 IMO this is a step-function change in capabilities. If you haven't tried it yet, head over to @fal!
70
verq retweeted
Kling 3 is a remarkable model. This was a one-shot generation from an input image and text prompts - the model retained character, scene, and voice consistency across cuts 🤯 IMO this is a step-function change in capabilities. If you haven't tried it yet, head over to @fal!
20
15
195
16,786
Feb 4
at most 1 to 1.5 years - it's over. It's time to rethink the production pipeline.
RIP Hollywood. AI is now 100% photorealistic with the launch of Kling 3.0 In just two days, I created the opening sequence from The Way of Kings by Brandon Sanderson You have to try this new Multi-Shot technique that makes making films much faster and cheaper 🧵👇
49
Feb 4
AI cinematography series - EP5: Can AI understand a DOLLY ZOOM? (The Vertigo Effect - camera dollies backward while zooming in, background distorts while subject stays same size) The most technically complex shot yet. Requires coordinating two opposing movements. Grok vs Runway.
1
55
Feb 4
We're halfway through the series. Pattern emerging: AI trained on camera mechanics > AI trained on visual fidelity For cinematography techniques that require spatial understanding of where/how the camera moves, Grok is dominant.
1
32
Feb 4
TOMORROW: SPLIT DIOPTER (Near object and far object both in sharp focus - defies normal depth of field) This requires understanding of optical physics, not just camera movement. Will Grok's camera understanding extend to lens optics? EP6 drops 8am. Following this series.
32