The scenes coming out of The Latent Space (a collaboration with Alejandro Cartagena / @halecar2 ) are now becoming explorable world fragments. Using the LoRAs trained on Alejandro's datasets, paper compositions on my desk are passed through the realtime Diffusion pipeline, then turned into 3D Gaussian Splats using ML Sharp.⁣ ⁣ #diffsuion #GaussianSplatting #MLSharp #SparkJS #AI

A sample of the world fragments from yesterday's Hands-on Hallucination session. Physical interfaces → real-time img2img diffusion → 3D GS → real-time rendering in a browser on desktop, mobile and AVP.⁣ #diffsuion #GaussianSplatting #MLSharp #SparkJS #AI

Accelerated capture from yesterday's Hands-on Hallucination session. I started out testing the system alone, then my son joined in and quickly took control; deciding which generated frames to freeze and transform into 3D Gaussian Splats. We ended up with a series of strange little world fragments.⁣⁣ ⁣ Physical interfaces → real-time img2img diffusion → 3D GS → real-time rendering in a browser on desktop, mobile and AVP.⁣ ⁣⁣ #GaussianSplatting #AppleML #MLSharp #SparkJS

I resumed work on my Hands-on Hallucination ML Sharp experiments from ~5 months ago. I manipulate paper, clay, etc. in front of a camera, watch a real-time diffusion pipeline hallucinate a world from them, press a knob, and the frozen frame becomes a 3D Gaussian Splat, instantly explorable in the browser or in VR. #GaussianSplatting #AppleML #MLSharp #SparkJS

むっちゃんさまのmacOSアプリ「MLSharp」のソースコードを元に、Google Antigravityで遊ばせていただいております。

Mac版MLSharp(2D画像を3Dガウシアンスプラッティング（3DGS）モデルに変換し3D表示）をWindowsに移植中 Macでは、CoreMLモデルで処理も早かったが、Win版は、Onnxモデルを使用し私の環境では、1枚約1分(動画は処理中画面飛ばしてます）～ GPUがあれば、早くなるのかなぁ～

引用元のMLSharpで 今無きUSJのBTTF the RIDEの写真をトレーニングさせてみました 処理も早いので古い写真を３DGS化するツールとして良さげ！ 一枚目　処理後 二枚目　元画像

MacOS用アプリ[MLSharp]を公開します。 MLSharpは、たった1枚の2D画像から、高品質な3D Gaussian Splatting (3DGS)モデルを生成するmacOS向けツールです。 生成した3DGSはもちろん、汎用の3DGS用3Dビューワーとしても使えます。 suto.bex.jp/mac/mlsharp/inde…

I am releasing the “MLSharp” app for macOS. MLSharp is a premium macOS application that transforms 2D images into immersive 3D Gaussian Splatting (3DGS) models using state-of-the-art AI. suto.bex.jp/mac/mlsharp/inde…

Music driven 3DGS dreamcore experiences… Created with MLsharp, Suno, and 3DGS unity shader pack. #unity #3dgs #vfx

I’m using Blender natively to import Apple ML-Sharp Gaussian Splatting. ✨ Controlling focal point, camera parameters and parallax directly inside Blender opens the door to entirely new workflows. The result is seriously impressive. 🔥 #b3d #MLSharp #GaussianSplatting

built a synthetic drone perception pipeline: - photorealistic scene generation and temporal dynamics to create (real synth data) for robust models - real-time detection tracking trajectory prediction models - temporal 3D reconstruction using #mlsharp visualised in @playcanvas supersplat

Almost ready for a huge update, finishing the final touches. Stay tuned! #GaussianSplatting #mlsharp

Agreed, #MLSharp uses a minimal amount of ram. #Apple

Couldn’t resist testing ML-Sharp by @Apple. Both Pano2Room and ML-Sharp share the same issue: unseen angles in the input lead to sparse point clouds. Using Sony’s open-source as a preprocessing step gives some interesting improvements. #mlsharp #supersplat

天使の輪が背景扱いになっちゃった StableDiffusionで生成した画像をml-shapで点群にして、SuperSplatで動画化 #AIart #mlsharp #supersplat