Who is in Control? Understanding User Agency in AR-assisted Construction Assembly

Authors. Xiliu Yang, Prasanth Sasikumar, Felix Amtsberg, Achim Menges, Michael Sedlmair, Suranga Nanayakkara

Venue. CHI (2025) Full Paper

Type. Full Paper

Materials. DOI ACM

Abstract. Adaptive AR assistance can automatically trigger content to support users based on their context. Such intelligent automation offers many benefits but also alters users’ degree of control, which is seldom explored in existing research. In this paper, we compare high- and low-agency control in AR-assisted construction assembly to understand the role of user agency. We designed cognitive and physical assembly scenarios and conducted a lab study (N=24), showing that low-agency control reduced mental workloads and perceived autonomy in several tasks. A follow-up domain expert study with trained carpenters (N=8) contextualised these results in an ecologically valid setting. Through semi-structured interviews, we examined the carpenters’ perspectives on AR support in their daily work and the trade-offs of automating interactions. Based on these findings, we summarise key design considerations to inform future adaptive AR designs in the context of timber construction.

@inproceedings{10.1145/3706598.3713765,
    title        = {Who is in Control? Understanding User Agency in AR-assisted Construction Assembly},
    author       = {Yang, Xiliu and Sasikumar, Prasanth and Amtsberg, Felix and Menges, Achim and Sedlmair, Michael and Nanayakkara, Suranga},
    year         = {2025},
    booktitle    = {Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems},
    publisher    = {Association for Computing Machinery},
    series       = {CHI '25},
    doi          = {10.1145/3706598.3713765},
    url          = {https://doi.org/10.1145/3706598.3713765},
    abstract     = {Adaptive AR assistance can automatically trigger content to support users based on their context. Such intelligent automation offers many benefits but also alters users' degree of control, which is seldom explored in existing research. In this paper, we compare high- and low-agency control in AR-assisted construction assembly to understand the role of user agency. We designed cognitive and physical assembly scenarios and conducted a lab study (N=24), showing that low-agency control reduced mental workloads and perceived autonomy in several tasks. A follow-up domain expert study with trained carpenters (N=8) contextualised these results in an ecologically valid setting. Through semi-structured interviews, we examined the carpenters' perspectives on AR support in their daily work and the trade-offs of automating interactions. Based on these findings, we summarise key design considerations to inform future adaptive AR designs in the context of timber construction.},
    articleno    = {1230},
    numpages     = {15},
    keywords     = {Augmented Reality, Worker Assistance, User Agency, Construction Industry}
}