designing tools for making. assistant professor of computer science @barnardcollege. mostly at @scientiffic@mas.to

Joined October 2009
3,286 Photos and videos
I'm going to give bluesky a try bsky.app/profile/scientifficโ€ฆ

1
3
173
the @BarnardCollege computer science dept is hiring 2 tenure-track assistant professors this year! review of applications will begin on october 18th: barnard.wd1.myworkdayjobs.coโ€ฆ ๐Ÿป ๐Ÿ’ป ๐Ÿ™๏ธ

1
5
746
Very much looking forward to joining the @columbiahci community! ๐Ÿ˜ƒ
GREAT NEWS: we have the amazing @scientiffic joining soon :) so excited!!! now @columbiahci is becoming bigger and bigger for sure โœจ
1
40
5,648
I'm so happy to share that I'm joining @BarnardCollege @Columbia as an Assistant Professor of Computer Science starting in July 2024! Excited and thankful for this opportunity to start my own lab developing design tools for creativity and learning. ๐Ÿ˜Š See you back in NYC! ๐Ÿ™๏ธ
20
2
151
12,373
๐ŸŒŸhere's a pre-print of our new paper applying LLMs to animation design! our system Keyframer lets people iteratively animate static images using natural language direct editors. arxiv.org/pdf/2402.06071.pdf awesome collaborating with @ReginaRCheng and @jwnichls on this project ๐Ÿ˜Š

12 Feb 2024
Apple presents Keyframer Empowering Animation Design using Large Language Models paper page: huggingface.co/papers/2402.0โ€ฆ Large language models (LLMs) have the potential to impact a wide range of creative domains, but the application of LLMs to animation is underexplored and presents novel challenges such as how users might effectively describe motion in natural language. In this paper, we present Keyframer, a design tool for animating static images (SVGs) with natural language. Informed by interviews with professional animation designers and engineers, Keyframer supports exploration and refinement of animations through the combination of prompting and direct editing of generated output. The system also enables users to request design variants, supporting comparison and ideation. Through a user study with 13 participants, we contribute a characterization of user prompting strategies, including a taxonomy of semantic prompt types for describing motion and a 'decomposed' prompting style where users continually adapt their goals in response to generated output.We share how direct editing along with prompting enables iteration beyond one-shot prompting interfaces common in generative tools today. Through this work, we propose how LLMs might empower a range of audiences to engage with animation creation.
3
4
54
24,049
excited to share a demo video of how our Keyframer prototype works! users input their own SVG images and enter prompts to animate them. because animations are created with code, you can edit generated designs directly for greater creative control. machinelearning.apple.com/reโ€ฆ
1
7
655
Tiffany Tseng ๐Ÿก retweeted
Our preprint paper is featured by @huggingface! Also: arxiv.org/pdf/2402.06071.pdf We present Keyframer, a LLM-based system for users to create & iterate on animation designs ๐ŸŽจ This is part of my ongoing residency at @Apple - so grateful to collaborate w @scientiffic & @jwnichls ๐Ÿ’ฏ

12 Feb 2024
Apple presents Keyframer Empowering Animation Design using Large Language Models paper page: huggingface.co/papers/2402.0โ€ฆ Large language models (LLMs) have the potential to impact a wide range of creative domains, but the application of LLMs to animation is underexplored and presents novel challenges such as how users might effectively describe motion in natural language. In this paper, we present Keyframer, a design tool for animating static images (SVGs) with natural language. Informed by interviews with professional animation designers and engineers, Keyframer supports exploration and refinement of animations through the combination of prompting and direct editing of generated output. The system also enables users to request design variants, supporting comparison and ideation. Through a user study with 13 participants, we contribute a characterization of user prompting strategies, including a taxonomy of semantic prompt types for describing motion and a 'decomposed' prompting style where users continually adapt their goals in response to generated output.We share how direct editing along with prompting enables iteration beyond one-shot prompting interfaces common in generative tools today. Through this work, we propose how LLMs might empower a range of audiences to engage with animation creation.
4
5
38
5,299
Tiffany Tseng ๐Ÿก retweeted
I'm biased, but I think this is pretty great work led by @scientiffic and @ReginaRCheng! We apply a human-centered design process to investigate how LLMs can be used by designers of all experience levels to create animations.
12 Feb 2024
Apple presents Keyframer Empowering Animation Design using Large Language Models paper page: huggingface.co/papers/2402.0โ€ฆ Large language models (LLMs) have the potential to impact a wide range of creative domains, but the application of LLMs to animation is underexplored and presents novel challenges such as how users might effectively describe motion in natural language. In this paper, we present Keyframer, a design tool for animating static images (SVGs) with natural language. Informed by interviews with professional animation designers and engineers, Keyframer supports exploration and refinement of animations through the combination of prompting and direct editing of generated output. The system also enables users to request design variants, supporting comparison and ideation. Through a user study with 13 participants, we contribute a characterization of user prompting strategies, including a taxonomy of semantic prompt types for describing motion and a 'decomposed' prompting style where users continually adapt their goals in response to generated output.We share how direct editing along with prompting enables iteration beyond one-shot prompting interfaces common in generative tools today. Through this work, we propose how LLMs might empower a range of audiences to engage with animation creation.
7
42
13,427
๐Ÿ“ข New journal article for @acmtoce! We explored how youth developed Data Design Practices by building their own ML models and apps in AIML summer camps @kodewithklossy. Through working together, they examined the role data plays in model performance. machinelearning.apple.com/reโ€ฆ
6
544
hi I generally donโ€™t use this site anymore, but sometimes I share into the void on mastodon mas.to/@scientiffic
8
654
excited to share a new project! we've developed Co-ML: a collaborative experience for building machine learning models on iPads. we show how families can learn about ML together using Co-ML in a playful at-home activity. pre-print for @IDC_ACM 2023: machinelearning.apple.com/reโ€ฆ
8
13
126
17,785
grateful that @IDC_ACM recognized our Co-ML project with an Honorable Mention for Best Paper. โ˜บ๏ธ congrats to the team! Jennifer King Chen, Mona Abdelrahman, @mbkery, @fredhohman, @adrianafresca, R. Ben Shapiro paper available here: dl.acm.org/doi/abs/10.1145/3โ€ฆ
7
645
instead of Twitter, I'm trialing posting some short updates that I'll replace every ~month here: scientiffic.notion.site/TT-Uโ€ฆ
3
11
here's an RSS feed for those who requested! tifftseng.com/ttupdate.xml @knandersen @eso_logic @shaanmasala

2
4
some folks reached out to me to notify me that the Stencilfy app was down after Heroku switched their pricing model โ€“โ€“ย I've moved it over to Render here: stencilfy.onrender.com/ happy stencil-ing!

2
6
Finals of Tetris World Championships is on now, and the level of skill is unprecedented m.twitch.tv/classictetris ๐Ÿ˜ฎ

1
wow, the food exhibit at the new Studio Ghibli Park looks so fun! washingtonpost.com/world/202โ€ฆ
1
14
interested in designing & researching new learning technologies? come intern with us at Apple!
4