Excited for our #CSCW2024 panel at 2:30 pm today in the Heredia room - "Is Human-AI Interaction CSCW?" This will be presented as a formal debate with me and @msbernst competing against @andresmh and @jeffbigham
Queenie officially retired from the @cmuhcii today — as PHD Program Director since the beginning, she has been a part of literally every one of our HCI PhDs journeys, and from the outpouring of thanks it’s clear she is highly appreciated!
HCI would be a different field without Queenie’s care, compassion and leadership!
ALT To envision things that have never before existed, designers innovate by engaging in reflective conversations with design materials [32]. Schön describes how designers reflect in action, how they conceive of what they want to make while in the act of making it [31]. Reflection in action works well when designers have a tacit understanding of the materials they are using, of the materials’ capabilities. This creative process happens less readily with new technology, because designers lack a ready-at-hand knowledge of what it is and what it can do. Neither Louridas or Schön described how designers become familiar with new and emerging technology in order to innovate with it.
here's a paper by ME from 2009, it used a large corpus of web automation scripts to learn to predict the next action given a description (look familiar??)… we had the user choose which to go forward on to protect agency
webinsight.cs.washington.edu…
ALT Figure 8. Suggestions are presented to users within the page context,
inserted into the DOM of the web page following the last element with
which they interacted. In this case, the user has just entered “105” into
the “Flight Number” textbox and TrailBlazer recommends clicking on
the “Check” button as its first suggestion.
pretty good performance for 15 years before LLMs!
benchmarks are very different (we didn't try to generate the text to enter into a form field, for instance), but really not that far off ;P
ALT Figure 9. The fraction of the time that the correct action appeared
among the top suggestions provided by TrailBlazer for varying numbers of suggestions. The correct suggestion was listed first in 41.4%
cases and within the top 5 in 75.9% of cases.
It was fun chairing #UIST2024 with @lining_yao and @hciprof! And it was great to have @wobbrockjo give the closing talk on his super impactful work.
He started his talk with this quote from Scott Hudson.
I brought my two older kids to the #uist2024 demo session last night -- @AmandaL79938988 & @jasonwuishere did a great job presenting our work on user interface design evaluation to them, …
but I think they were more excited about the VR demos :)
understanding whether a UI design is good is important for understanding user interfaces & vital for automatic UI generation
at #uist2024, we presented a significant step forward in automatic UI evaluation - check out thread below!
(paper: arxiv.org/abs/2404.12500)
When you ask an LLM to generate a UI, how do you know if it's good? It is often easy to recognize a good design but difficult to explain why and reason about/evaluate tradeoffs. UIClip is a data-driven model that assigns numerical scores to represent quality of UI screenshots
another heads up for #UIST2024 folks -- the buses from downtown (westin) to CMU are pretty fast and frequent -- best is the 67 (but it's hourly), the 61s come every 10 minutes or so -- buy a ticket in the Transit app ($2.75) or on board
ALT bus from downtown to CMU, 18 minutes is the fastest on the 67, but the 61s are pretty fast too, 27 minutes
Queenie has been the foundation of the @cmuhcii program for its whole existence -- amazing impact on HCI as a field through development and support of everyone who has graduated from our program!
Please join us in congratulating longtime staff member, Queenie Kravitz, on her retirement today. She started @CarnegieMellon in 1993 and the HCII in 2004, and as graduate program coordinator certified our very first HCI PhD and master's degrees. Congrats, Queenie!
#CMUhcii
I've learned a lot about robotics from @hadmoni -- now you can too! It's kind of a kids book, but I'm learning a lot, great accessible overview!
amazon.com/Robots-Explore-Wo…
ALT Jeff holding Henny Admoni's new book, "Robots: Explore the world of robotics and AI"
Police departments run marketing campaigns blaming pedestrians for not being visible enough. But they know visibility doesn't slow down drivers.
Here's an SFPD speed trap 👇