Mocap for 2D 3D Vtubers. Start Vtubing with just your browser webcam! hello@kalidoface.com

Joined January 2021
5 Photos and videos
Pinned Tweet
Itโ€™s finally here! Kalidoface has an official Discord server! discord.gg/XMqdfzVZ2E

1
3
18
Kalidoface | KalidoKit retweeted
Kalidoface Lab 0.1.0 Updates: ๐ŸฅบVroid VRM blendshape support ๐Ÿ‘€ Eye movement for Vroid models ๐Ÿ’ƒPreset resting poses ๐Ÿ’กScene light editor (ARKit rigging is still highly recommended ๐Ÿ˜‰)
Replying to @yeemachine
Kalidoface Lab was rewritten from the ground up so not all features have been ported over from Kalidoface. It supports ARKit rigged VRM models. Youโ€™ll be able to fine tune the blendshape tracking and adjust your camera angle/position ๐Ÿ“in app. lab.kalidoface.com
8
36
207
18,494
Kalidoface | KalidoKit retweeted
Kalidoface Lab was rewritten from the ground up so not all features have been ported over from Kalidoface. It supports ARKit rigged VRM models. Youโ€™ll be able to fine tune the blendshape tracking and adjust your camera angle/position ๐Ÿ“in app. lab.kalidoface.com
4
16
84
24,865
Kalidoface | KalidoKit retweeted
Thank you for your support at #GoogleIO ๐Ÿ™. Hereโ€™s whatโ€™s next! Kalidoface Lab is a #Vtuber web app powered by the latest motion capture tech from MediaPipe. Starting with ARKit blendshapes. ๐Ÿ˜‰ You can try it hereโ€ฆ ๐Ÿ‘‡
Itโ€™s finally here! ๐ŸŽŠ We open sourced our #vtuber motion capture solution at #GoogleIO! Our new MediaPipe model predicts 478 face landmarks 52 blendshapes from your webcam and is compatible with any ARKit rigged avatar! ๐Ÿ˜บ๐Ÿงต
8
87
530
51,443
It's finally time to make it official.
Itโ€™s finally here! ๐ŸŽŠ We open sourced our #vtuber motion capture solution at #GoogleIO! Our new MediaPipe model predicts 478 face landmarks 52 blendshapes from your webcam and is compatible with any ARKit rigged avatar! ๐Ÿ˜บ๐Ÿงต
6
24
1,818
Soonโ€ฆ
Itโ€™s finally here! ๐ŸŽŠ We open sourced our #vtuber motion capture solution at #GoogleIO! Our new MediaPipe model predicts 478 face landmarks 52 blendshapes from your webcam and is compatible with any ARKit rigged avatar! ๐Ÿ˜บ๐Ÿงต
2
7
1,452
Thank you for all your support ๐Ÿ™‡ The Live2D version of Kalidoface will be graduating on Nov 20th, 2022. We werenโ€™t able to come to an agreement with the licensing team to keep the app free and so it will be shut down for now. Donโ€™t worry, Kalidoface 3D will still remain free.
2
18
Kalidoface | KalidoKit retweeted
Happy 1st anniversary, @kalidoface 3D! ๐ŸŽ‚ Thank you for all your support. I've met a ton of cool people along the way and am grateful to now be working alongside the AI researchers that made this app possible. Gonna continue accelerating Vtuber tech from the inside ๐Ÿ˜‰!
Launching my newest #Vtuber web app, Kalidoface 3D! ๐ŸŽŠ Face and full-body tracking for 3D models now available for anyone with a browser and a webcam! #MadeWithTFJS and Mediapipe Powered by @glitch ๐ŸŽ Try it out here! โžก๏ธ 3d.kalidoface.com โฌ…๏ธ
4
10
53
Mediapipe just shared their newest model for 3D avatars. You will be able to get joint rotations for 3D avatars directly from the Mediapipe graph. KalidoKitโ€™s pose and hand calculator will be deprecated. Thank you so much for the support over these few months!
It still feels like a dream. Yes, I am working on #Vtuber tech at Google AI! ๐Ÿ’ช๐Ÿ˜Ž๐Ÿ’ช Our new BlazePose GHUM Holistic model predicts full body and hand joint rotations for 3D avatars. Available soon at mediapipe.dev. ๐ŸŽ๐Ÿ’ƒ๐ŸŽต Paper and live demo at @CVPR for #CVPR2022.
1
1
12
Thank you so much for almost 4000 stars!
8
Kalidoface | KalidoKit retweeted
Is this the first #Vtuber feature at the @TheWebbyAwards ? ๐ŸŽ‰๐ŸŽ‰๐ŸŽ‰ Happy to share @kalidoface was an Honoree for Technical Achievement at this year's #Webbys! ๐Ÿ’ช๐Ÿ‘๏ธ๐Ÿ‘„๐Ÿ‘๏ธ๐Ÿ’ช Yet again, I was the only solo developer among a sea of corporate winners ๐Ÿ˜…! winners.webbyawards.com/winnโ€ฆ
8
8
40
Kalidoface | KalidoKit retweeted
Oya? Is that a @kalidoface cameo at #GoogleIO ? ๐Ÿฅฐ We should have Vtubers on the main stage with Sundar next year. JKโ€ฆunless ๐Ÿ‘€???? youtube.com/watch?v=GbgjafMdโ€ฆ
4
4
26
Kalidoface | KalidoKit retweeted
Replying to @kalidoface
@kalidoface desktop app in development...
2
1
26
Itโ€™s Leg Day! ๐Ÿฆต๐Ÿฆต๐Ÿฆฟ Kalidoface 3D and KalidoKit v1.1.5 released with updated leg tracking. Not perfect yet, but should be enough for some #Vtuber squats! Pomu not included. ๐Ÿƒ Test it here โžก๏ธ 3d.kalidoface.com Code stuff โžก๏ธ github.com/yeemachine/kalidoโ€ฆ
2
46
105
Thanks to a generous contributor, better leg tracking is coming soon!
5
20
Mobile Safari has been upgraded in the latest version of iOS. Now, we can finally use Mediapipe tracking on iOS devices. Kalidoface and Kalidoface 3D have been updated and should have significantly faster face tracking on iOS. (Full body still not recommended on mobile)
3
4
28
Bug patch: Fixed an issue with older Cubism 2.0 Live2D models that would freeze the app.
4
๐Ÿฅณ๐Ÿง๐ŸŽˆ
1
13
Kalidoface | KalidoKit retweeted
The #kalidokit Live2D face tracker template is now available on Github and Glitch! Feel free to remix this sample and make it your own! Was fun working with @ElmouradiAmine on this! KalidoKit: github.com/yeemachine/kalidoโ€ฆ Template: glitch.com/edit/#!/kalidokitโ€ฆ
2
19
107
Kalidoface | KalidoKit retweeted
Found an easier way to get camera working directly in OBS browser. No need for scary command prompts to use Kalidoface, just edit your OBS shortcut. Apologies for the shakycam rip. 1/ Open up properties for the OBS shortcut. 2/ Add launch parameters to the โ€˜targetโ€™ path.
4
11
35