NEW PAPER ACCEPTED AT NEURIPS WITH SPOTLIGHT
I am excited that our work on Holistic Evaluation of Text-to-Image Models is accepted to NeurIPS with Spotlight. Congratulations to Tony, Michi, Chenlin and everyone!
NEW PAPER ACCEPTED AT TRANSACTIONS IN MACHINE LEARNING RESEARCH (TMLR)
Our work on Evaluating Human-Language Model Interaction was accepted to Transactions in Machine Learning Research (TMLR). Congratulations Mina and everyone!
I WILL SPEAK AT TED AI
I will be at the global TED AI event this October as one of its 28 speakers, where I will speak about simulating human behavior using techniques from human-computer interaction and natural language processing. I am humbled and excited to be joined by an incredible group of colleagues on the stage. Please find more information shared on TED's official page.
GENERATIVE AGENTS WILL BE PRESENTED AT UIST'23, SAN FRANCISCO!
I'm thrilled that our paper, "Generative Agents: Interactive Simulacra of Human Behavior," will be preseted at UIST'23, taking place in San Francisco! In this paper, we introduce the concept of and the techniques for creating generative agents to simulate believable human behavior.
If you would like to learn more about our work, some of the talks and interviews I gave on generative agents are available publicly (e.g., the UC Berkeley MARL Seminar, NBC interview, a colleague-led interview back in April, a more recent talk at the London ML Meetup). Meetup. This work has also been covered in various venues such as The Guardian, The Times, The New York Times, SBS, Nikkei, and Science.
ORGANIZAING A NEW WORKSHOP @ UIST'23
We will be organizing a workshop at UIST'23 on "Architecting Novel Interactions With Generative AI Models"! If you are interested in the intersection of generative AI and interaction, please consider joining our program this October!
ORGANIZING A NEW SPECIAL INTEREST GROUP @ CSCW'23
Our proposal for CSCW'23 Special Interest Group on "Shaping the Emerging Norms of Using Large Language Models in Social Computing Research" was accepted! Please join our program this October!
A NEW RESEARCH HIGHLIHGT IN THE COMMUNICATIONS OF THE ACM
Our work on Mixed Abilities and Varied Experiences: A Group Autoethnography of a Virtual Summer Internship is appearing in the latest issue of the Communication of the ACM. Congratulations to everyone on the team!
A NEW PREPRINT ON LANGUAGE MODEL EVALUATION
Our new paper on "Evaluating the Interactability of Language Models" is out! Excited to see this effort go online!
A NEW PAPER ACCEPTED AT CSCW'23
Our new paper, "Working With AI to Persuade: Examining a Large Language Model’s Ability to Generate Pro-vaccination Messages," was accepted at CSCW'23! Congratulations to the wonderful team, Elise, Sunny, and Jeff!
AWARDED THE MICROSOFT RESEARCH PH.D. FELLOWSHIP
I am really honored to receive the 2022 Microsoft Research Ph.D. Fellowship given to candidates pursuing a Ph.D. in computing-related areas (13 in North America; 36 globally).
Thank you so much to my advisers, Michael Bernstein and Percy Liang, as well as Meredith Ringel Morris and Karrie Karahalios, and many other mentors and collaborators who helped shape me as a researcher. This award is a testament to how amazing you all are.
METHOD AWARD AT CSCW'22
Our paper, "Measuring the Prevalence of Anti-Social Behavior in Online Communities", won a method award at CSCW'22! Congratulations to all my coauthors!
JOEY WON AN OUTSTANDING POSTER AWARD :)
My student, Joey O'Brien, who worked with me, Michael and Percy over the summer presented our work at the poster session for the CURIS program (Stanford CS Dept.'s internal summer research internship program for undergraduate students) and won its one of only two Outstanding Poster awards!
A NEW PAPER ACCEPTED AT UIST'22
I am thrilled to share that our work on "Social Simulacra: Creating Populated Prototypes for Social Computing Systems" will appear at UIST'22!!
And our accompanying demo is located "here". Please take a look if you want to explore what sorts of social simulacra we can create today.
Finally, a big thank you and congratulations to my amazing collaborator, Lindsay, my mentors, Carrie and Merrie, and my advisors, Percy and Michael!
A NEW PAPER ACCEPTED AT CSCW'22
I'm excited to share that our paper, "Measuring the Prevalence of Anti-Social Behavior in Online Communities" was accepted to CSCW'22! Thank you, and congratulations to Joseph and Michael!
BEST PAPER AWARD AT CHI'22
Our paper, "Jury Learning: Integrating Dissenting Voices into Machine Learning Models' was recognized with the Best Paper award at CHI'22! Big congratulations to all my amazing co-authors!
TWO NEW PAPERS ACCEPTED AT ICA'22
Thrilled that our papers 'Can AI Persuade? Examining a Large Language Model's Ability to Generate Pro-Vaccination Messages' and 'Guidelines for Algorithm Auditing' were accepted at ICA'22! Congratulations to everyone, and particularly to Elise for successfully leading and publishing her first paper!
A NEW PAPER ACCEPTED AT CSCW'22
I'm excited that our paper titled 'Power Distribution and Conflicts in Designing, Using, and Maintaining Algorithmic Socio-Technical Systems' was accepted at CSCW'22! Congratulations to all my amazing collaborators!
A NEW PAPER ACCEPTED AT CHI'22
I'm excited that our paper titled '"Jury Learning: Integrating Dissenting Voices into Machine Learning Models' was accepted at CHI'22. Congratulations to all my amazing co-authors!
A New Paper to Appear in Foundations and Trends in Human-Computer Interaction
Our paper that summarizes the practice of "algorithm auditing" will appear in Foundations and Trends in Human-Computer Interaction. We hope that this will be a useful guidelines-paper for those interested in conducting algorithm audits.
Best Paper Nominated at ASSETS'21
Our full paper that will appear at ASSETS this year was nominated for the Best Paper award! Congratulations to the amazing team!
OUR REPORT ON FOUNDATION MODELS IS OUT
Our report "On the Opportunities and Risks of Foundation Models" that we've been working on as a part of the Center for Research on Foundation Models (CRFM) is now publicly available.
In this report, we describe a paradigm shift that's happening in AI with the rise of models that are trained on broad data at scale and are adaptable to a wide range of downstream tasks (e.g., BERT, DALL-E, GPT-3). We delve into the opportunities and risks this shift may bring to us, including the way we interact with computers and AI.
A NEW PAPER ACCEPTED AT ASSETS'21
Congratulations to the Microsoft Research Ability team for "Mixed Abilities and Varied Experiences: A Group Auto-Ethnography of a Virtual Summer Internship" paper accepted at ASSETS'21!
Best Paper Honorable Mention at CHI'21
I'm excited to share that our full paper that will appear at CHI this year on smart home stakeholders' perspectives won Best Paper Honorable Mention! Congratulations to all my wonderful co-authors!
A NEW PAPER ACCEPTED AT FAccT'21
I'm thrilled to share that our paper "Designing an Online Infrastructure for Collecting AI Data From People With Disabilities" was accepted at FAccT'21! I'm really grateful to have gotten to know and worked with my amazing mentors from MSR -- Merrie, Ece, and Danielle -- on this project.
A NEW PAPER ACCEPTED AT CHI'21
I'm excited that our paper exploring the user dynamics of home technology and algorithms titled '"We Just Use What They Give Us": Understanding Passenger User Perspectives in Smart Homes' was accepted at CHI'21! Congratulations to all my amazing collaborators!
Joining Stanford Computer Science Dept.
I will be joining Stanford to pursue my PhD in computer science this fall supported by the Stanford School of Engineering Fellowship! I am really looking forward to working with all the colleagues in the department!
Deposited MS Thesis at UIUC
I reached a personal milestone of depositing my master's thesis on the role of response time in human-algorithm interaction at UIUC!! I’m deeply grateful to my amazing adviser Professor Karrie Karahalios for making the past two years truly fun and meaningful.
A new paper accepted at CSCW'20
Our paper entitled "Emotional Amplification During Live-Streaming: Evidence from Comments During and After News Events" was accepted at CSCW'20! Congrats to all my co-authors :)
Best Paper Honorable Mention at CHI'20
I'm excited to share that our full paper that will appear at CHI this year on Finstagram won Best Paper Honorable Mention!! Congratulations to all my wonderful co-authors!
A new paper to appear at ICA'20
I'm happy to note that our paper on people's emotionality on live chat titled "Live Streaming Intensifies Emotions: Evidence from Live and Retrospective Comments on YouTube" will appear at ICA'20!
A new paper accepted at CHI'20
I'm excited that our paper exploring Finsta usage titled "Random, Messy, Funny, Raw: Finstas as Intimate Reconfigurations of Social Media" was accepted at CHI'20!
Congratulations to all my amazing collaborators!
A new article on ACM CSCW's Medium page
I wrote a new article titled "Faster is not always better: benefits of slower interaction with algorithmic systems." summarizing some of the findings from our CSCW'19 paper about Slow Algorithm! Please check it out here.
Awarded Siebel Scholarship, class of 2020!!
I was chosen as one of the 42 Siebel Scholars class of 2020 working in the field of computer science! The scholarship is awarded to the top graduate students in the world’s leading engineering schools.
Sincere thank you to my amazing adviser, Professor Karrie Karahalios, and all my mentors and collaborators who made this possible.
Won the SV t-shirt competition for CSCW ;)
Are you going to be at CSCW this year? Then check out the t-shirt SV's and PC's will be wearing featuring my t-shirt design with a hand-drawn view of Austin, Texas where CSCW is happening this year. Oh, and I am serving as an SV this year, so see everyone soon!
Two full papers accepted at CSCW'19!
I am thrilled that two of our works were accepted at CSCW'19 as full papers!
"A Slow Algorithm Improves Users’ Assessments of the Algorithm’s Quality" delves into the benefits of slowness in technology (and it is also my first, first-authored paper!).
"Search Media and Elections: A Longitudinal Investigation of Political Search Results in the 2018 U.S. Elections" presents a longitudinal audit of the Google search engine.
Congratulations and thank you to all my amazing collaborators!
A new paper to appear at ICA'19
Our paper entitled "Search Media and Elections: Investigating Partisanship in Political Search Results" will appear at ICA'19!
Starting @ UIUC
I will be joining the CS Department at UIUC for my M.S starting this month. My adviser for the coming semester is Professor Karrie Karahalios.
Graduated from Swarthmore College.
After four unforgettable years, I graduated with a major in Computer Science and a minor in Asian Studies. I was advised by Professor Tia Newhall (CS), Professor Bryce Wiedenbeck (CS), and Professor William Gardner (Asian Studies). I thank them for years of care and generosity.
SAN FRANCISCO, CA. OCTOBER 29th ~ NOVEMBER 1st, 2023
Panel: 2023 STANFORD HAI Fall Conference
STANFORD, CA. OCTOBER 24th, 2023
Talk: STANFORD COMPUTATIONAL SOCIOLOGY WORKSHOP
STANFORD CA. OCTOBER 19TH, 2023
Panel: TED AI – After Party
SAN FRANCISCO, CA. OCTOBER 18th, 2023
Talk: TED Talk -- TED AI
SAN FRANCISCO, CA. OCTOBER 17th, 2023
Guest Appearance: TED AI Hackathon -- Judge
SAN FRANCISCO, CA. OCTOBER 15th, 2023
Talk: Generative Agents at Sutter Hill
Palo Alto, CA. SEPTEMBER 28th, 2023
Panel: ANDREESSEN HOROWITZ, AI Town
SAN FRANCISCO, CA. SEPTEMBER 21st, 2023
Guest Lecture: STANFORD AI AND DELIBERATIVE DEMOCRACY
STANFORD CA. SEPTEMBER 14th, 2023
Talk: UNIVERSITY OF SYDNEY
VIRTUAL. SEPTEMBER 14th, 2023
Talk: STANFORD HAI X COMMONWEALTH BANK OF AUS
STANFORD CA. SEPTEMBER 13th, 2023
Talk: APPLE, Internal Seminar
CUPERTINO, CA. AUGUST 24th, 2023
Talk: RIOT GAMES, Internal Seminar
LOS ANGELES, CA. AUGUST 11th, 2023
Panel: ZHEN x GOOGLE
SAN FRANCISCO, CA. AUGUST 10th, 2023
Talk: LONDON MACHINE LEARNING MEETUP
VIRTUAL. AUGUST 2nd, 2023
Talk: MICROSOFT RESEARCH, Montreal Seminar
VIRTUAL. AUGUST 1st, 2023
Fireside Chat: UNUSUAL VENT., AI Studio
MENLO PARK. JULY 20th, 2023
Panel: AUTOMATED DECISION-MAKING AND SOCIETY (ADM+S) SYMPOSIUM
VIRTUAL. JULY 13th, 2023
Talk: TENCENT, Internal Seminar
VIRTUAL. JULY 11th, 2023
Talk: STANFORD HAI: ACCENTURE FOUNDATION MODEL SCHOLAR PROGRAM
VIRTUAL. JULY 10th, 2023
Talk: SELECTSTAR, Public Seminar
VIRTUAL. JULY 6th, 2023
Fireside Chat: SCALE VENT., The Agents Are Coming
SAN FRANCISCO. JUNE 26th, 2023
Talk: THE BANK OF ENGLAND
VIRTUAL. JUNE 20th, 2023
Guest Appearance: THE GRADIENT
VIRTUAL. JUNE 15th, 2023
Guest Appearance: THE TWIML AI PODCAST
VIRTUAL. JUNE 5th, 2023
Talk: SIMULATION SUMMIT
SAN FRANCISCO, CA. JUNE 8th, 2023
Panel: GRADIENT VENTURES, Founder Summit
REDWOOD CITY, CA. JUNE 1st, 2023
Talk: UNIVERSITY COLLEGE LONDON, Information Security Seminar
VIRTUAL. MAY 25th, 2023
Panel: ANDREESSEN HOROWITZ, Games x AI Roundtable
SAN FRANCISCO, CA. MAY 25th, 2023
Guest Appearance: SEOUL BROADCASTING SYSTEM(SBS), 8 PM News
VIRTUAL. MAY 19th, 2023
Talk: UC BERKELEY, MARL Seminar
BERKELEY, CA. MAY 19th, 2023
Panel: AN AI WEEK FOR BUILDER
SAN FRANCISCO, CA. MAY 17th, 2023
Guest Lecture: STANFORD UNIVERSITY, CS329X Human-Centered NLP
STANFORD, CA. MAY 17th, 2023
Talk: REDDIT, Internal Seminar
VIRTUAL. MAY 17th, 2023
Talk: FOUNDATION CAPITAL, Generative AI Unconference
SAN FRANCISCO, CA. MAY 10th, 2023
Talk: GOOGLE, Internal Seminar
VIRTUAL. MAY 3rd, 2023
Talk: IBM, Accelerated Discovery Seminar
VIRTUAL. MAY 3rd, 2023
Talk: CHAT LLM
VIRTUAL. APR. 27th, 2023
Talk: KRAFTON, Deep Learning Seminar
SEOUL, SOUTH KOREA. APR. 27th, 2023
Guest Appearance: NBC, 6 PM News
VIRTUAL. APR. 11th, 2023
Talk: UC BERKELEY, BiD Seminar
BERKELEY, CA. APR. 11th, 2023
Talk: UC SAN DIEGO, Interactive Computing Seminar
SAN DIEGO, CA. FEB. 15th, 2023
UC SAN DIEGO, CSE SAN DIEGO. CA, FEB. 15th, 2023
SEOUL SEOUL, SOUTH KOREA, DEC. 16h - Jan 2nd, 2022
GENERATED WORLD & FICTIONAL EMBODIMENTS SAN FRANCISCO, CA, DEC. 15h, 2022
CSCW REMOTE †, NOV. 8th - NOV 22nd, 2022
CONF. ON AI IN THE LOOP: HUMANS IN CHARGE STANFORD, CA, NOV 15th, 2022
UIST BEND, OR, OCT. 29th - NOV 2nd, 2022
GOOGLE PAIR VIRTUAL, OCT. 12th, 2022
HAI-GOOGLE: RESEARCH UPDATES AND NEW ADVENTURES
VIRTUAL, OCT. 11th, 2022
WORKSHOP: DIGITIZATION, DEMOCRACY, AND CIVIL DISCOURSE
STANFORD, CA, OCT. 7th, 2022
HPI-HPDTRP COMM. WORKSHOP
POTSDAM, GERMANY †, SEP. 15th, 2022
BERKELEY SIMONS INSTITUTE
BERKELEY, CA, JUL. 28th, 2022
HPDTRP COMMUNITY WORKSHOP
STANFORD, CA, MAY 23rd - MAY 25th, 2022
CHI NEW ORLEANS, LA, APR. 30th - MAY 6th, 2022
HAI-GOOGLE RESEARCH UPDATE
REMOTE †, APR. 21ST, 2022
SEOUL SEOUL, SOUTH KOREA, DEC. 12th - Jan 2nd, 2022
NEURIPS REMOTE †, Dec. 6th - 15th, 2021
CSCW REMOTE †, OCT. 23th - 27th, 2021
WORKSHOP ON FOUNDATION MODELS
REMOTE †, AUG. 23TH - 24TH, 2021
SOCIAL COMPUTING SUMMER CAMP
REMOTE †, JUN. 7TH - 9TH, 2021
AIES REMOTE †, MAY. 19TH - 21TH, 2021
CHI YOKOHAMA, JAPAN†, MAY. 8TH - 13TH, 2021
FAccT REMOTE †, MAR. 3TH - 10TH, 2021
SEOUL SEOUL, SOUTH KOREA, DEC. 4TH - JAN. 4TH, 2020
CHIIR VANCOUVER, CANADA †, AUG. 13TH - 14TH, 2020
STANFORD UNIV. STANFORD, CA, JULY. 26TH -, 2020
MSR SEATTLE, WA †,, MAY. 25TH - AUG. 14TH, 2020
CHI HONOLULU, HI †,, APR. 25TH - 30TH, 2020
CMU PITTSBURGH, PA †,, MAR. 19TH - 21TH, 2020
U WASHINGTON SEATTLE, WA †,, MAR. 17TH - 18TH, 2020
UC BERKELEY BERKELEY, CA †,, MAR. 15TH - 16TH, 2020
STANFORD UNIV. STANFORD, CA, †, MAR. 13TH - 14TH, 2020
UIUC URBANA, IL, MAR. 8TH - 10TH, 2020
SEOUL SEOUL, SOUTH KOREA, JAN. 4TH - 22TH, 2020
TOKYO TOKYO, JAPAN, DEC. 24TH - JAN. 3TH, 2019
CSCW AUSTIN, TX. NOV. 9TH-13TH 2019
SIEBEL CONF. CHICAGO, IL. OCT. 11ST-13TH, 2019
STANFORD UNIV. STANFORD, CA. JUN. - JUL., 2019
ICA WASHINGTON D.C., MAY 24TH - 28TH, 2019
† Virtual travels due to COVID-19.