I am an assistant researcher in the Department of Computer Science and Technology at Tsinghua University. I received my bachelor’s and doctorate degrees from Tsinghua University in 2016 and 2021. My research focuses on intelligent human-computer interaction, including text entry, context-aware technology, wearable devices, and accessibility. I proposed a Bayesian model of finger movement control ability, which has been used as a critical feature in the Sogou input method. This method now benefits over 600 million users, facilitating the input of approximately 90 billion words daily, and has markedly enhanced recall and correction click rate. I also proposed the world’s first smart keyboard for visually impaired people, significantly reducing the input error rate. I have won the ACM CHI Honorable Mention Award and the first prize in the China Human-Factors Engineering Design Competition.
🔥 News
- 2024.10: 🎉🎉 Two papers are accepted by IMWUT 2024.
- 2024.10: 🎉🎉 Our smart ring is exhibited on Lenovo Tech World 2024. See introduction in this video.
📝 Publications
IMWUT 2024
AngleSizer: Enhancing Spatial Scale Perception for the Visually Impaired with an Interactive Smartphone Assistant, Xiaoqing Jing, Chun Yu, Kun Yue, Liangyou Lu, Nan Gao, Weinan Shi*, Mingshan Zhang, Ruolin Wang, Yuanchun ShiIMWUT 2024
EasyAsk: An In-App Contextual Tutorial Search Assistant for Older Adults with Voice and Touch Inputs, Weiwei Gao, Kexin Du, Yujia Luo, Weinan Shi*, Chun Yu, Yuanchun ShiCHI 2024
ContextCam: Bridging Context Awareness with Creative Human-AI Image Co-Creation, Xianzhe Fan, Zihan Wu, Chun Yu, Fenggui Rao, Weinan Shi*, Teng TuPreprint
PromptRPA: Generating Robotic Process Automation on Smartphones from Textual Prompts, Tian Huang, Chun Yu, Weinan Shi, Zijian Peng, David Yang, Weiqi Sun, Yuanchun ShiUIST 2023
From Gap to Synergy: Enhancing Contextual Understanding through Human-Machine Collaboration in Personalized Systems, Weihao Chen, Chun Yu, Huadong Wang, Zheng Wang, Lichen Yang, Yukun Wang, Weinan Shi, Yuanchun ShiIMWUT 2023
Interaction Proxy Manager: Semantic Model Generation and Run-time Support for Reconstructing Ubiquitous User Interfaces of Mobile Services, Tian Huang, Chun Yu, Weinan Shi, Bowen Wang, David Yang, Yihao Zhu, Zhaoheng Li, Yuanchun ShiCHI 2019
VIPBoard: Improving screen-reader keyboard for visually impaired people with character-level auto correction, Weinan Shi*, , Chun Yu, Shuyi Fan, Feng Wang, Tong Wang, Xin Yi, Xiaojun Bi, Yuanchun ShiHonorable Mention Award
IMWUT 2018
TOAST: Ten-finger eyes-free typing on touchable surfaces, Weinan Shi, Chun Yu, Xin Yi, Zhen Li, Yuanchun ShiUIST 2018
Lip-interact: Improving mobile device interaction with silent speech commands, Ke Sun, Chun Yu, Weinan Shi, Lan Liu, Yuanchun ShiIJHCS 2017
Is it too small?: Investigating the performances and preferences of users when typing on tiny QWERTY keyboards, Xin Yi, Chun Yu, Weinan Shi, Yuanchun ShiCHI 2017
Word clarity as a metric in sampling keyboard test sets, Xin Yi, Chun Yu, Weinan Shi, Xiaojun Bi, Yuanchun Shi
🎖 Honors and Awards
- 2024.10 Third prize in Ubiquitous Intelligent Sensing Technology Innovation Application Competition
- 2021.06 Outstanding Graduate, Department of CS, Tsinghua University
- 2021.04 Second prize in “Challenge Cup” Academic Science and Technology Works Competition, Tsinghua University
- 2020.10 First prize in the China Human-Factors Engineering Design Competition
- 2019.10 National Scholarship, Ministry of Education, China
- 2019.09 First prize in 84 “Future Innovation” Scholarship (Only 1), Department of CS, Tsinghua University
- 2019.05 Honorable Mention Award (Top 5%), ACM CHI 2019
- 2019.01 Qingfeng Scholarship, Tsinghua University
- 2016.06 Outstanding Graduate, Department of CS, Tsinghua University
📖 Experience
- 2023.08 - Present, Assistant Researcher, Department of Computer Science and Technology, Tsinghua University.
- 2021.07 - 2023.07, Postdoctoral Researcher, Department of Computer Science and Technology, Tsinghua University.
- 2016.09 - 2021.06, Ph.D., Department of Computer Science and Technology, Tsinghua University.
- 2013.09 - 2016.06, B.Econ., School of Economics and Management, Tsinghua University.
- 2012.09 - 2016.06, B.E., Department of Computer Science and Technology, Tsinghua University.
💬 Invited Talks
- 2024.10, Smart Human Computer Interaction Based on Context Awareness. China Graph 2024.
- 2024.08, Understanding Context in Natural Human-Computer Interaction Using Large Language Models. HCIX Project.
- 2024.06, Natural Human-Computer Interaction Technology Based on Context Awareness. Usability Engineering course, Academy of Arts & Design, Tsinghua Univerisity.
- 2024.03, Natural Human-Computer Interaction Technology Based on Context Awareness. Workshop, MSRA.