Asst Prof @RiceSocSci. Proud alum @PsychIllinois. Into #iopsych #psychometrics #personality. Here for academic fun and games. Aspiring (b)icon. Views my own.

Joined November 2020
9 Photos and videos
24 Sep 2024
Our 100-page (!) report (from the 💯 team yooo) also highlighted key limitations with #LLM responses, including social desirability bias and poor item-level fit. These fine details reveal how AI cannot fully replicate the complexity of human responses in psychometrics... yet. ‍🥸
24 Sep 2024
Can AI replace human respondents in psych research? 🤖 We compared #LLM-generated and human responses using BFI-2 & HEXACO scales. AI mimics broad patterns but misses subtle human nuances at the item level. 📊 Validation is key! osf.io/preprints/osf/rwy9b #AI #Psychometrics
1
12
1,075
23 Sep 2024
🚨PhD Opportunities!🚨 I'm recruiting 1-2 #PhD students for Fall 2025 in #IOPsych @RiceSocSci @RiceUniversity! 🏅 Interested in #personnelselection, #personalityscience, #AI, & #psychometrics? Join our SMART Lab! 💻👥 Deadline: Dec 1, 2024. More info: tinyurl.com/SMART-phd-ads

4
112
219
19,363
Tianjun Sun retweeted
I'm excited to share that Rice is hiring TWO new faculty members in Cognitive Neuroscience (1 Assistant level, 1 Associate/Full)! Asst ad: apply.interfolio.com/153086 Assoc/full ad: apply.interfolio.com/153384 Please share, and reach out if you have questions!
79
114
20,525
Tianjun Sun retweeted
On putting the horse (raters and criteria) before the cart (variance components in ratings) | Industrial and Organizational Psychology | Cambridge Core - bit.ly/4cHSOkg Congratulations to @PanDwww and Hwayeon Meyong!

2
3
15
1,112
where do I find a first-year like this 🙏
1st year PhD student showing up at the 8 am panel with 25 expertly crafted slides, 57 backup slides, and print-outs prepared four weeks in advance vs Tenured professor giving the keynote with two slides of mood pictures clicked together in the hotel lobby 15 minutes earlier
1
5
622
Tianjun Sun retweeted
The IRT Song, another Psychometric Jazz hit dropping in your timeline. "In the land of stars and stripes, they turned away, From Rasch's simple truths, they chose a complex way, Item Response Theory, oh what a tangled dance, They missed the Rasch measurement advantage, didn't give it a chance. To the tune of assumptions, they built a lofty throne, With parameters three or more, complexity overblown. Meanwhile, Rasch with its elegance stood quietly alone, One parameter to rule them all, yet largely unknown. Oh, in the halls of academia, they debate with such glee, "Is it IRT or Rasch that truly holds the key?" But those who've seen the light, they all agree, The beauty of Rasch is in its simplicity. So let's raise a glass to Georg Rasch, a visionary so bright, His model cuts through the noise, brings the data to light. And to those still lost in the IRT night, May you find your way by Rasch's clear sight."
1
3
19
2,514
Tianjun Sun retweeted
Because the Psych Job Wiki is ending, I’ve worked with Amedee Martella to create a new Psych Job Wiki for the 2024-25 academic job cycle! This site has TT jobs, non-TT jobs, and postdoc positions. Feel free to spread the word, use the site, and contribute: sites.google.com/view/psychj…
2
88
171
25,698
Tianjun Sun retweeted
A feature on @KState’s Center for Artificial Intelligence and Date Science (#CAIDS), a consortium of labs led by our colleague @pascalhitzler, PI of @DaSeLab. This article also covers the work of @handekucuk & @tspsyched.
5 May 2024
Faculty and student researchers at K-State are helping to make AI magic happen. Learn more about how they are making artificial intelligence smarter and safer at: bit.ly/4a7DNqR #KStateResearch | #KState
3
10
531
Tianjun Sun retweeted
#WCP2024 (personality) and #SIOP2024 (I/O psych) conferences were back-to-back. Research silos are a major pet peeve, so here's a comparison 🧵to facilitate conversations between the two. (1/16)
2
5
21
5,279
22 Apr 2024
Wonderful thread! But wanna particularly highlight this one. *bow in crowd fave* 🤓
#5. Both conferences had loads on AI. Crowd favorites were Heron, Sylvara, & @tspsyched exploring the ouroboros of job applicants using ChatGPT to fake a chatbot personality inventory and Foster using AI to create narrative feedback reports based on personality scores. (9)
2
378
Tianjun Sun retweeted
Many people have no idea how these things work. For example, right now, as a Brazilian, I can't accept invitations to speak at conferences in Europe because my visa to work in the U.S. has expired. I am not illegal; I have a work contract with the University of California until 2027. Still, I must travel outside the U.S. and get a visa stamp on my passport to allow me to move freely to talk about science. I have to do this every single year I stay in the U.S. The costs of the visa, traveling, time lost, etc, are all on me. Not every international scientist can handle this.
This is a reminder that international scientists face various hurdles and citizenship in some countries is worse than others. I had 2 students miss 4-6 weeks this year JUST to renew their visas (India and China). (have to admit that global south was confusing, coming from NZ)
42
699
2,938
508,232
16 Apr 2024
See what our “always online” group just put out! 🤓This was our international March madness for the win! 🏆Catch me at #siop24 or @guenolen at #imps24 or anyone on the team anywhere to chat more about LLM psychometrics! 🚀
1/In our preprint we proposed PseudoFactorAnalysis (PFA) as methodology based on LLM embedding to assess psychometric properties’ with no data. We compared the results of PFA with those of validation studies. The results were very promising and left space for future development!
1
7
468
Tianjun Sun retweeted
4 Apr 2024
A fascinating paradox: People rate AI responses to their emotional problems as more empathic than human responses, but not if they *know* the response comes from AI. They feel most "heard" by an AI they think is human, least by a human they think is AI. pnas.org/doi/10.1073/pnas.23…
5
45
169
23,142
Tianjun Sun retweeted
Super fun project on investigating the prediction behavior of LLMs from a psychological perspective🧠 🚨GPT-4 can fall into a cognitive trap and make mistakes even when it has the correct knowledge, like us humans🤯 ✅A simple hint helps Check out our paper for more details👇
Will the Real Linda Please Stand up...to Large Language Models? Examining the Representativeness Heuristic in LLMs arxiv.org/abs/2404.01461 @PanDwww @ZilinXiao2 @hanjie_chen
6
41
6,027
14 Mar 2024
ooooohh 🥂🍻🐖
Champaign, Illinois is a far more attractive city than I realised
235
Now that it's official I can share! I'm moving to @HoustonTX this June and joining @RiceSocSci @RiceUniversity as an Assistant Professor of #IOPsych and #QuantMethods in Fall 24! Very excited to join this fantastic community and very thankful for all who made it possible!! 👐🏼🦉💙
3
1
41
2,194
The decision to move has been and will always be bittersweet. I’ll forever cherish the time and memories from @KSUPsychSci and am grateful for @KState for the past ~three years of incredible professional growth. 💜
1
4
265
Tianjun Sun retweeted
Here are our prompts for educators and students, released under Creative Commons license. They are built around the pedagogical approaches we discuss in our papers, and have worked well in class. I hope others experiment with them, improve them, & share. moreusefulthings.com/
7
140
704
79,451
Tianjun Sun retweeted
I just heard a PhD student say "I just need to get through one more week and then things will be less busy..." I didn't have the heart to say anything
39
206
4,031
292,703