Presentation Information
[WS-3-01]How to Visualize Learning Outcomes in International Education — Reading, Using, and Leveraging BEVI and AI
*Hajime Nishitani1, *Yoshinobu Ohnishi2, *Mitsuyuki Ichimura3, *Mina Mizumatsu4, *Yun Meng5, *Yuko Kobayakawa6, *Hiroyuki Takagi7 (1. Hiroshima University/Soka University, 2. Chiba University, 3. Yokohama National University, 4. Toyo University, 5. Niigata University, 6. Kanazawa Institute of Technology, 7. Tamagawa University)
Keywords:
BEVI: Beliefs,Events,and Values Inventory,Assessment of International Education Program,AI-Assisted Data Analysis,Intercultural Competence,Visualization of Learning Outcomes
受講者に求められる 事前の知識・経験等
BEVI（Beliefs, Events, and Values Inventory）に関する基本的な知識があることが望ましいですが、未経験の方も歓迎いたします。
当日のセッションをより深く理解いただくため、事前Zoomセッション（複数回実施予定／任意参加）への参加を推奨します。これまでの実施経験から、事前セッションにご参加することで、当日のディスカッションやデータ分析への理解が大きく深まります。
事前Zoomセッションへの申込みは、以下のフォームよりお願いいたします。日時が決まり次第、登録いただいた方へ個別にご案内いたします。
申込フォーム：https://forms.gle/sumJjqYQ8nnCWNj8A
受講者が受講前に取り組む 事前課題等
必須の事前課題はありません。ただし、当日のセッションをより楽しんでいただくため、希望者向けに以下の機会を用意してあります。
① 個人としてのBEVIトライアル受検（任意・無料）
ご自身でBEVIを受検することで、当日扱う個人レポートおよびグループレポートの尺度データとの比較ができ、理解が一段と深まります。受検方法は、事前Zoomセッションの後に案内をお送りします。
② 自校データとの比較準備（任意・無料）
所属校（または関係するプログラム）の参加者を対象に、Time 1/Time 2のBEVIデータをトライアルベースで取得し、当日の分析に活用することも可能です。所属校に限らずデータ収集も可能ですのでご相談ください。実施人数・期間に制限はありません。なお、BEVIは受検者本人の同意取得プロセスがシステムに組み込まれています。
申込方法
上記いずれも、事前Zoomセッションと同じ申込フォームのコメント欄にご希望をご記入ください。お申込みいただいた順に、こちらから個別にご連絡します。自校データ収集の準備には一定の期間がかかりますので、ご希望の方はお早めにどうぞ。
申込フォーム：https://forms.gle/sumJjqYQ8nnCWNj8A
概要
Purpose
How can we move beyond "participant satisfaction" to visualize the effects of international education programs based on objective psychometric data? In this workshop, participants will experience the process of "reading" data as a team, using the psychometric instrument BEVI (Beliefs, Events, and Values Inventory) and its built-in AI function. The goal is for participants to develop a concrete picture of how BEVI can be utilized in their own educational settings and research.
Target Audience
Practitioners and researchers involved in the planning, implementation, and evaluation of international education programs. No prior experience with BEVI is required.
Program Structure
BEVI Fundamentals and Analytical Perspectives (Introductory Session) (approx. 1/3 of total time)
Facilitator: Nishitani
- Theoretical background of BEVI and overview of its 17 scales
- What BEVI measures: the multi-layered structure of beliefs, values, and identity
- Basics of data interpretation: decile profiles, Aggregate by (disaggregation by attributes), and individual report structure
- Introduction to three analytical perspectives:
- Within-group analysis: identifying diversity and characteristics within a cohort
- Between-group comparison: reading differences in tendencies across distinct groups
- Pre-post program change (T1–T2): detecting transformation resulting from educational intervention
Read, Analyze, and Apply" as a Team (Group Work) (approx. 2/3 of total time)
Facilitators: Ohnishi, Ichipura, Meng, Kobayakawa, Takagi, Nishitani
Participants will work with real datasets (multiple patterns) from student cohorts in international programs, prepared by the presenters.
Step 1: "Read" the Data
- Each team receives a dataset and identifies group characteristics from decile profiles and attribute-based disaggregation
- Teams articulate: "What tendencies does this group exhibit?"
Step 2: "Analyze" with AI
- Teams use "Being Bevi," the specialized AI built into the BEVI system, to deepen their interpretation of the data
- Using the questions and perspectives generated by the AI as prompts, teams discuss the meaning behind the numbers
Step 3: "Apply" to Educational Practice
- Based on the analysis, each team proposes: "What educational interventions would be effective for this group?"
- Teams share their proposals in plenary, comparing and discussing different interpretations and intervention strategies
*Note: Participants who bring their own BEVI data may use it as material during the group work.*
Learning Objectives
1. Understand the fundamentals of reading BEVI data
2. Experience the process of AI-assisted data interpretation
3. Develop a concrete vision for introducing BEVI into one's own educational setting or research
BEVI（Beliefs, Events, and Values Inventory）に関する基本的な知識があることが望ましいですが、未経験の方も歓迎いたします。
当日のセッションをより深く理解いただくため、事前Zoomセッション（複数回実施予定／任意参加）への参加を推奨します。これまでの実施経験から、事前セッションにご参加することで、当日のディスカッションやデータ分析への理解が大きく深まります。
事前Zoomセッションへの申込みは、以下のフォームよりお願いいたします。日時が決まり次第、登録いただいた方へ個別にご案内いたします。
申込フォーム：https://forms.gle/sumJjqYQ8nnCWNj8A
受講者が受講前に取り組む 事前課題等
必須の事前課題はありません。ただし、当日のセッションをより楽しんでいただくため、希望者向けに以下の機会を用意してあります。
① 個人としてのBEVIトライアル受検（任意・無料）
ご自身でBEVIを受検することで、当日扱う個人レポートおよびグループレポートの尺度データとの比較ができ、理解が一段と深まります。受検方法は、事前Zoomセッションの後に案内をお送りします。
② 自校データとの比較準備（任意・無料）
所属校（または関係するプログラム）の参加者を対象に、Time 1/Time 2のBEVIデータをトライアルベースで取得し、当日の分析に活用することも可能です。所属校に限らずデータ収集も可能ですのでご相談ください。実施人数・期間に制限はありません。なお、BEVIは受検者本人の同意取得プロセスがシステムに組み込まれています。
申込方法
上記いずれも、事前Zoomセッションと同じ申込フォームのコメント欄にご希望をご記入ください。お申込みいただいた順に、こちらから個別にご連絡します。自校データ収集の準備には一定の期間がかかりますので、ご希望の方はお早めにどうぞ。
申込フォーム：https://forms.gle/sumJjqYQ8nnCWNj8A
概要
Purpose
How can we move beyond "participant satisfaction" to visualize the effects of international education programs based on objective psychometric data? In this workshop, participants will experience the process of "reading" data as a team, using the psychometric instrument BEVI (Beliefs, Events, and Values Inventory) and its built-in AI function. The goal is for participants to develop a concrete picture of how BEVI can be utilized in their own educational settings and research.
Target Audience
Practitioners and researchers involved in the planning, implementation, and evaluation of international education programs. No prior experience with BEVI is required.
Program Structure
BEVI Fundamentals and Analytical Perspectives (Introductory Session) (approx. 1/3 of total time)
Facilitator: Nishitani
- Theoretical background of BEVI and overview of its 17 scales
- What BEVI measures: the multi-layered structure of beliefs, values, and identity
- Basics of data interpretation: decile profiles, Aggregate by (disaggregation by attributes), and individual report structure
- Introduction to three analytical perspectives:
- Within-group analysis: identifying diversity and characteristics within a cohort
- Between-group comparison: reading differences in tendencies across distinct groups
- Pre-post program change (T1–T2): detecting transformation resulting from educational intervention
Read, Analyze, and Apply" as a Team (Group Work) (approx. 2/3 of total time)
Facilitators: Ohnishi, Ichipura, Meng, Kobayakawa, Takagi, Nishitani
Participants will work with real datasets (multiple patterns) from student cohorts in international programs, prepared by the presenters.
Step 1: "Read" the Data
- Each team receives a dataset and identifies group characteristics from decile profiles and attribute-based disaggregation
- Teams articulate: "What tendencies does this group exhibit?"
Step 2: "Analyze" with AI
- Teams use "Being Bevi," the specialized AI built into the BEVI system, to deepen their interpretation of the data
- Using the questions and perspectives generated by the AI as prompts, teams discuss the meaning behind the numbers
Step 3: "Apply" to Educational Practice
- Based on the analysis, each team proposes: "What educational interventions would be effective for this group?"
- Teams share their proposals in plenary, comparing and discussing different interpretations and intervention strategies
*Note: Participants who bring their own BEVI data may use it as material during the group work.*
Learning Objectives
1. Understand the fundamentals of reading BEVI data
2. Experience the process of AI-assisted data interpretation
3. Develop a concrete vision for introducing BEVI into one's own educational setting or research