10/25/2024 | Press release | Distributed by Public on 10/25/2024 10:43
Oct. 25, 2024
Toyota Motor Corporation's Frontier Research Center (hereafter referred to as Toyota) and the Toyota Central R&D Labs., Inc. (hereafter referred to as TCRDL) are working on visualizing communication through conversation using sensing data, with the aim of enhancing the vitality of individuals and organizations. This project emphasizes theoretical research and the pursuit of value, focusing on real-world experiments in settings like internal training and workplaces. In this article, would like to share the details of this initiative.
- First, could you tell us about the background of starting this project?
MitsudaYes. At the beginning of the project, we wanted to use mathematical and data science to solve everyday problems in life and work. We therefore launched a project to create new value for the future by solving familiar problems.
The theme we focused on is communication through direct dialogue. In modern society, values and choices are diversifying, so that broadening perspectives through direct dialogue is increasingly important. However, many people struggle with effective speech and empathy.
We believed that by objectively and quantitatively understanding the state of communication through data, we could gain multi-faceted insights that would improve the vitality and growth of individuals and organizations.
- It would be amazing to visualize invisible communication. What specific technology did you use?
- What kind of experiments did you conduct using the Badge System?
MitsudaThe challenge and interesting point is how to extract useful information in the field from the simple data of the sound pressure of the subject's voice and the body acceleration data obtained from the Badge. For example, while analyzing sound pressure data, the quantity of conversation often draws attention, but silence can also be an important indicator, depending on the situation.
To specify the indicators and validate their value, we visited workplaces where people faced problems, had them use the Badge System for a certain period, and collected their feedback. We focused on the characteristics of individuals and groups, introducing a case study on group work in internal training(conducted by Toyota) as an example focused on individuals and a case study on everyday workplace applications(conducted by TCRDL) as an example focused on groups.
- Now, could you tell us about the case study on applying the Badge System to group work in internal training, focusing on the issues at the site?
SugataIn this internal training, there is one instructor for about 20 participants, who are divided into groups of four or five to discuss their mindset about work. Since the instructor is an employee and not a professional evaluator, there are limitations to evaluating each participant carefully and objectively.
So, we had the participants wear the Badges during group work. We analyzed the sound pressure and acceleration data collected from the Badges and created communication analysis reports for each participant, as shown in Figure 2. We developed 11 indicators to evaluate participants from multiple perspectives.
- Were there any difficulties in determining the communication indicators?
SugataUnderstanding the instructor's perspective was challenging. For example, it was difficult to verbalize how the instructor viewed the participants regarding the evaluation item "Do you respect the other person?" and translate that into a quantitative indicator. As a result, we set indicators for the number of nods during others' speech, speech occupancy rate, and posture during spontaneous speech.- How was the feedback on the communication analysis report?
SugataNot only when the instructor advises participants but also by presenting this report to the participants' workplace supervisors, we were able to provide an objective explanation of the participants' communication tendencies. This aspect has been very well received and has significantly contributed to improving the participants' communication skills.- Next, please tell us about the case study conducted at TCRDL, focusing on the group.
NagayaYes. At TCRDL, to visualize daily communication in the workplace, we had about 100 employees in the administrative department wear the Badges for about three months, collected communication data during work hours, and visualized the data for two months that were analyzable.- What kind of visualization did you perform?
NagayaFor example, based on the conversation time between pairs of individuals, we created and analyzed a communication network. Figure 3 shows the communication network based on all conversations that occurred over the two months. Each circle represents one person.- What changed?
NagayaThe communication networks for each period are shown in Figure 5. From Figure 5, we can see that a new community (in blue) emerged in the second half, including the individual with high betweenness centrality, indicating that this community is acting as a new mediator of information. We could say that the pathways through which information flows have diversified.- I see, it seems we've gained insight into group communication. What other visualizations were performed?
NagayaWe conducted a detailed analysis of communication within meeting rooms. In regular conversations, it can be difficult to determine what constitutes a continuous conversation, but in meetings held in meeting rooms, it is relatively clear when the conversation starts and ends. At TCRDL, we can check everyone's schedules on Outlook, so with the participants' consent, we obtained scheduled data and linked it with conversation data. Over two months, we extracted and analyzed more than 3,000 meetings and discussions.- Even within conversations held in meeting rooms, there are various types, such as formal meetings, team discussions, and casual chats. In what situations would this be useful?
NagayaActually, that was our concern. After some trial and error, we concluded that one-on-one conversations between managers and members would be ideal. Therefore, we extracted meetings explicitly titled "1-on-1" in the scheduler. Figure 6 shows the analysis results of four such one-on-one meetings.- Did you share these results with the managers?
NagayaAfter the project ended, we held explanation sessions for the approximately 100 employees who cooperated, sharing the analysis results of the acquired data by the workplace. When we conveyed the results of the one-on-one meetings, managers who spoke a lot reflected, "I might not have been doing that," while those who spoke less seemed indifferent, saying, "Is that so?"- I see. Communication analysis can indeed be approached from various angles. Finally, could you tell us about future prospects?
MitsudaClarifying the correlation between communication characteristics (such as leadership) and psychological states (positive or negative) with indicators calculable from the Badge System will be a research task. Additionally, the relationship between non-verbal signals and communication is a fascinating academic theme with implications for exploring the origins of sociality, mental health, robotics, and education. We also plan to use the Badge System for measuring the effects of plant greenery in our other articles on this site titled "Genki-KûkanTM."
Takayuki Nagaya
After joining Toyota Central R&D Labs., Inc. in 1991, he worked on the development of expert systems before engaging in the development of QR codes. His main responsibilities included implementing and evaluating the error correction function of QR codes, as well as developing programs for encoding and decoding the codes. Currently, in addition to analyzing communication using badges, he is involved in research topics related to well-being.
Eiji Mitsuda
He joined Toyota Motor Corporation in 2016. During graduate school, he majored in astrophysics. After working on molecular simulations for material development at Toyota, he was in charge of leading the Badge Project. He has a curious personality that crosses scales from space (parsecs) to molecules (angstroms) to people (meters) as research targets. Currently, he is engaged in management of service science research based on informatics and psychology.
Hikaru Sugata
He joined Toyota Motor Corporation in 2007. During his graduate school years, he majored in Information Science and Engineering (Control Theory). At Toyota, he was involved in R&D and new business planning, including robot development. He is currently seconded to Toyota Ventures in Silicon Valley, where he is working on creating synergies between Toyota and startups with cutting-edge technologies.
*1 | K. Yano, S. Lyubomirsky, and J. Chancellor, Sensing happiness: Can technology make you happy? IEEE Spectrum, pp. 26-31, Dec. 2012. |
*2 | Open Badges, MIT Media Lab |
*3 | Oren Lederman, Dana Calacci, Angus MacMullen, Daniel C. Fehder, Fiona E. Murray, and Alex "Sandy" Pentland, 2016. Open Badges: A Low-Cost Toolkit for Measuring Team Communication and Dynamics. SBP-BRiMS, IN_105. |