Prof @csaudk, #HCI #XR, eye-gaze UI. sharing things from research etc

Joined June 2014
100 Photos and videos
Pinned Tweet
Excited to finally announce that we got a bunch of new upcoming research papers on eye and hand HCI for XR! 👁️🖐️ 📝1 paper at #UIST2025 📝3 conference 3 workshop papers at #ISMAR2025 Stay tuned for details. Thanks to the amazing students at XI lab collaborators🙏
4
12
60
5,823
XR user input is fragmented across devices - but over time, standards emerged. This infographic summarizes the evolution of XR input over the last 12 years. Made this infogram while preparing talks on eye-hand symbiosis and thought it might be useful to share.
1
5
20
732
Ken Pfeuffer retweeted
We had an amazing four-day NII Shonan Meeting on "AR and AI: Everyday AR through AI-in-the-Loop", co-organized with @da_lind, @margonmora, Misha Sra. shonan.nii.ac.jp/seminars/24… Thanks for joining! Let's shape the future of AR and AI.
1
6
22
2,260
👁️✋Pinch-to-zoom, but where you look is where it zooms. This 2015 example explores multimodal-bimanual-direct-manipulation with gaze (mouthful!). The hand stays away in comfort zone, the pen at the center. They don't interfere, just symbiosis. From bit.ly/4rKnY2H
1
7
312
👁️🖐️What makes and breaks the gaze pinch UI, what challenges remain? Here are 5 design issues, illustrated from the below article. #uiux #xr #spatialcomputing #hci #gesture #gaze
New article on 👀✋: Design Principles & Issues for Gaze and Pinch Interaction Inspired by HCI research and the upcoming @Apple #VisionPro release. Medium: bit.ly/48Ei75A LinkedIn: bit.ly/3SnH4g3 #arvr #uiux Below the 5 principles in short:
4
10
316
With a mouse or touchpad, this would require a lot of cursor dragging. In 2014, I explored fluid and simple gaze touch UI (eye tracker under the table). Why don’t we have this on laptops yet, eg. using gaze touchpads...?
2
9
455
Ken Pfeuffer retweeted
Thanks to @rkmt Prof. Jun Rekimoto and the team @PFU_HHKB!
世界的研究者 石井裕(@ishii_mit)氏と暦本純一(@rkmt)氏が語る「テクノロジーとアートの間にある美学」とは youtube.com/watch?v=kWmwmtFE…
1
8
34
6,799
New research incoming for #CHI2026 - on multimodal interaction in XR: - how to teleport with👀 ✏️ - how we preshape our hands with 👀 🖐️ and 👀 🎮 - how to multi-select objects with 👀 🖐️ 🎤 Huge thanks 🙏to all students & collabs @csaudk @Concordia @LancasterUni @GoogleARVR
3
1
22
1,069
Ken Pfeuffer retweeted

2
29
220
18,916
Ken Pfeuffer retweeted
JUST IN: Google unveiled its smart glasses project with XREAL, called Project Aura. • 70° FOV for a giant virtual screen anywhere • run full Android apps in floating windows • Circle to Search on anything you look at • lightweight frame powered by a small compute puck • hand tracking for pinch, zoom and window control Launching in 2026.
148
186
1,908
259,245
Ken Pfeuffer retweeted
We're taking the next step to make #AndroidXR even more helpful and seamless in your daily life. So much to share from The Android Show | XR Edition today in partnership with @SamsungMobile and @Qualcomm. We introduced powerful new features for Galaxy XR, including Travel Mode for using your device on the go, PC Connect for streaming high fidelity desktop and laptop experiences to XR, and representing you as a photoreal avatar, with our Likeness feature. We also shared updates on our AI glasses which we are building with @SamsungMobile, @WarbyParker and @_GentleMonster_. The Developer Preview 3 of the Android XR SDK brings new tools to all developers and opens up development for AI Glasses! Finally, we also showed how we are expanding Android XR to the broader ecosystem, with Project Aura from @XREAL_Global. Read more on the blog: blog.google/products/android… Here’s a recap: youtu.be/oy_ayfHcVWA And you can watch the full keynote here: youtube.com/live/a9xPC_FoaG0
8
19
86
6,166
Ken Pfeuffer retweeted
I know it's not exactly the "hottest" part of Valves announcement, but I am really excited for the Steam Frame's "Eye Tracked Foveated Streaming". Things like this are one of the many reasons why I've been obsessed with headsets shipping natively with eye tracking.
45
85
2,270
57,164
Ken Pfeuffer retweeted
When will Apple let you use gaze chopsticks as input
10
7
264
33,945
Ken Pfeuffer retweeted
9 Nov 2025
Surfer takes us through what it looks like while riding a perfect wave [📹 gabrielmbenetton]

260
2,906
27,711
1,864,038
Ken Pfeuffer retweeted
Pressure to publish jumps. And researchers have no time to do science. (New survey from Elsevier) Survey of 3200 researchers: 1. Only 45% of scientists have sufficient time for actual research. 2. For 68%, the pressure to publish today is greater than 2-3 years ago. 3. 29% of researchers are considering relocating to another country (for better funding, work‐life balance, or greater research freedom). 4. 58% of researchers use AI tools in their work. 5. Reported benefits from AI: saving time (58%), helping with literature summaries (61%), literature reviews (51%), data analysis (38%), drafting proposals (41%), and drafting papers (38%). Globally, life in academia is getting worse. For students & postdocs - it’s especially hard to decide on an academic career. ❗️ A few days ago, I gave a lecture on this topic. “PhD: Dreams, Reality and Consequences” Watch it here: lnkd.in/dA_GhYwd (I’ll appreciate if you ‘like’ this video - you will GREATLY help it reach more students.)
42
517
1,957
145,869
Ken Pfeuffer retweeted
9 Jun 2024
From: Bill Buxton re: James Landay – I give up on CHI/UIST dubfuture.blogspot.com/2009/…
2
5
35
8,491
Ken Pfeuffer retweeted
Good luck to everyone on the CHI deadline today. Whatever happens, make sure to take time for yourself to appreciate the hard work you’ve done.
2
47
4,578
Ken Pfeuffer retweeted
1 Nov 2025
We are being flooded by ‘research papers’. It is not a joke. As an editor of Software: Practice and Experience… I review over a thousand papers a year. Increasingly, papers have been written by AI. My students hand in work done by AI. I have recently got a PhD thesis that the student admitted was AI generated. So what do we do about it? We leave the Soviet model of science: science as a bureaucracy. Focus on doing great and useful work, and then (only then) write about it. Do you do work so that you can publish it? Bring back your focus to doing great work. It should always have been thus. To put it another way, the research paper is not the end point of the research. It has a supportive role. At this point, some people object: “nobody cares about my work, how will they know that it is good if I don’t have a peer-reviewed paper?” Oh brother: if you cure cancer, they will care. And if they don’t care about your work, they won’t read your paper. And your paper may have been generated by AI, and if nobody cares about it, it may as well have been AI generated. Daniel Lemire. 2024. Will AI Flood Us with Irrelevant Papers? Commun. ACM 67, 9 (September 2024), 9. doi.org/10.1145/3673649
48
101
712
73,553
Ken Pfeuffer retweeted
Having a PhD means you can find the word “unfortunately” in an email faster that the search function
36
254
3,670
119,901
Ken Pfeuffer retweeted
Only a million?! People need to show a little more respect towards Mr. Rachmad of Indonesia, the greatest researcher of all time (according to the metrics)
Our Founder and Scientific Director @Yoshua_Bengio has become the first living researcher to surpass 1 million citations on Google Scholar, a testament to the foundational and global impact of his work. Congratulations Yoshua!
23
94
619
128,979
Ken Pfeuffer retweeted
While reviewing for #CHI2026, I noticed four new writing issues, likely due to increased use of LLMs. I describe them here - and how to fix them: dbuschek.medium.com/when-llm…
20
87
18,069