Exploring Changes in Communication between Native English Speakers (NES) and Non-native English Speakers (NNES) with the Aid of Facial Expression Recognition Feedback in Group Videoconferencing

Abstract

One of the frequent communication challenges in group meetings between native English speakers (NES) and non-native English speakers (NNES) is confusion experienced by the NNES while communicating in English with the NES. To address this, I proposed integrating a facial expression recognition tool with a video conferencing platform to help NES enhance their ability to identify NNES’ confused moments and promote effective communication with NNES. The study was conducted on a video conferencing platform to investigate how precisely the NES and the facial expression recognition tool identify the confused moments of the NNES in comparison with the self-report of the NNES. Furthermore, this study explored the impact of such identification on how the NES adjusted their communication approach when interacting with the NNES in subsequent group meetings. The findings revealed that the self-reports of NNES played a significant role over the facial expression recognition tool, enabling the NES to better perceive the confused moments of the NNES. As a result, the NES gained a better understanding of the NNES and improved their ability to communicate effectively during the meeting. Although using the facial expression recognition tool to detect the NNES’ confusion during the meeting was underestimated by the NES in this study, it provided me a valuable opportunity to investigate the context of how NNES, NES, and the tool identify the confused moments of the NNES. This highlighted the importance of considering the NNES’ self-reports and their facial expressions within the context to improve the current facial expression recognition tool.