Normung Insight 2.0
Instrument and Delivery Design in the First Pilot of a Value-Driven Blended Training Pathway at a National Standards Body
DOI:
https://doi.org/10.59490/jos.2026.9080Keywords:
Education about Standardization (EaS), Value-Based Intended Learning Outcomes (ILOs), Innovative Teaching Concept of Standardisation (ITCoS), EDU4Standards.eu, Blended Learning, Formative Evaluation, Evaluation Instrument Design, National Standards Bodies (NSBs)Abstract
National Standards Bodies (NSBs) acknowledge a responsibility for Education about Standardisation (EaS), yet instrument-level accounts of what they deliver remain rare. This paper reports the formative evaluation of the first pilot of Normung Insight 2.0, the redesigned introductory pathway of Austrian Standards International: a self-paced online module (N1) and two in-person modules on a single training day (N2, N3), aligned with the value-based Intended Learning Outcomes (ILOs) framework and the Innovative Teaching Concept of Standardisation (ITCoS) of EDU4Standards.eu. The design rationale, presented at EURAS 2026 without data, is confronted with first-cohort data (N = 7). Two anonymous instruments returned four online responses and six in-person submissions, so 85.7% is an upper bound on the in-person response rate; no baseline, knowledge test or observation of delivery was collected. Confidence ratings clustered at the top point, 25 of 36 for N2 and 26 of 36 for N3; the three lowest-rated N2 outcomes are the three whose practice elements the curriculum records as reduced or omitted; 23 of 24 value-cluster ratings were at the top point, so that item set did not discriminate; and three rating items without verbal anchors produced uninterpretable data. The pilot records post-training self-rated confidence, not a measured learning gain: its transferable yield is the instrument design itself. Five items are stated for the second pilot, planned for May 2027: one pedagogical hypothesis, one implementation lesson and three instrument corrections. An interim iteration, in which the serious game was replaced by a trainer-led session, bears on the implementation lesson.
References
Alliger, G. M., & Janak, E. A. (1989). Kirkpatrick’s levels of training criteria: Thirty years later. Personnel Psychology, 42(2), 331–342. https://doi.org/10.1111/j.1744-6570.1989.tb00661.x
Austrian Standards International. (2022). Geschäftsordnung von Austrian Standards International (Ausgabe 1. Juli 2022) [Rules of procedure of Austrian Standards International, edition of 1 July 2022]. https://www.austrian-standards.at/geschaeftsordnung
Austrian Standards International. (2026a). Tätigkeitsbericht 2025 (Stand 31. Dezember 2025) [Activity report 2025, as at 31 December 2025]. https://cdn.austrian-standards.at/asset/reb_dokumente/Ueber-uns/Ueber-AS/ASI/Austrian_Standards_International_T%C3%A4tigkeitsbericht_2025.pdf
Austrian Standards International. (2026b). Normung Insight 2.0, module N2: Detailed curriculum, 20 June 2026 [Internal course document].
Austrian Standards International. (2026c). Normung Insight 2.0, module N3: Detailed curriculum, 20 June 2026 [Internal course document].
Austrian Standards International. (2026d). Normung Insight 2.0, module N2: Participant handout, version 3, 20 June 2026 [Internal course document].
Austrian Standards International. (2026e). Normung Insight 2.0, module N2: Deepening handout, final version 3, 20 June 2026 [Internal course document].
Austrian Standards International. (2026f). Standardization Professional, first pilot: Reminder to complete the feedback questionnaire, 20 July 2026 [Internal e-mail].
Austrian Standards International. (2026g). Standardization Professional: Wie Standards unsere Welt gestalten (Teil I) und Rollen und Prozesse der Normung (Teil II) [How standards shape our world (Part I) and Roles and processes of standardisation (Part II); course description].https://www.austrian-standards.at/en/shop/academy/standardization-professional-standardisierung-verstehen-und-aktiv-mitgestalten~p4775197
Austrian Standards International. (2026h). Normung Insight 2.0, module N1: Course build and screenplay [Internal course document].
Austrian Standards International. (2026i). Normung Insight 2.0, module N1: Completion records [Learning-platform export, Articulate].
Austrian Standards International. (2026j). Normung Insight 2.0, module N2: Slides, version 9, 20 June 2026 [Internal course document].
Bates, R. (2004). A critical analysis of evaluation practice: The Kirkpatrick model and the principle of beneficence. Evaluation and Program Planning, 27(3), 341–347. https://doi.org/10.1016/j.evalprogplan.2004.04.011
Bishop, J. L., & Verleger, M. A. (2013). The flipped classroom: A survey of the research. In 2013 ASEE Annual Conference & Exposition Proceedings. American Society for Engineering Education. https://doi.org/10.18260/1-2--22585
Blind, K., & Drechsler, S. (2020). Necessary competences of employees in the field of standardization. In S. O. Idowu, H. J. de Vries, I. Mijatovic, & D. Choi (Eds.), Sustainable development: Knowledge and education about standardisation (pp. 113–137). Springer. https://doi.org/10.1007/978-3-030-28715-3_8
Blind, K., & von Laer, M. (2022). Paving the path: Drivers of standardization participation at ISO. The Journal of Technology Transfer, 47(4), 1115–1134. https://doi.org/10.1007/s10961-021-09871-4
Bulc, T.-L. (2026). Normung Insight 2.0: A value-driven, micro-modular pathway for standardisation education. “Austrian Standards” practitioner experience in re-designing education on standardisation. In K. Jakobs, B. Reiter, & E. Staudegger (Eds.), Proceedings EURAS 2026: Values in standards (pp. 35–40). Wissenschaftsverlag Mainz.
Bundesministerium für Arbeit und Wirtschaft. (2024). Österreichische Normungsstrategie 2024 [Austrian standardisation strategy 2024]. https://www.bmwet.gv.at/Themen/Technik-und-Vermessung/Normung/%C3%96sterreichische-Normungsstrategie.html
Catalani Gabriel, L., de Vries, H. J., & Cleeland, B. (2022). Stimulating education about standardization: Activities and perspectives of national standards bodies. Journal of Standardisation, 1. https://doi.org/10.18757/jos.2022.6298
CEN-CENELEC. (2025). Guideline for harmonized training on standardization for higher education within the European Union: Workshop description form (Parts A and B). https://www.cencenelec.eu/news-events/news/2025/workshop/2025-11-17-edu4standards/
CEN-CENELEC. (2026a). Guideline for education and training on standards and standardisation (CWA 18456:2026). European Committee for Standardization.
CEN-CENELEC. (2026b). Internal Regulations Part 2: Common rules for standardization work (January 2026 edition). https://boss.cen.eu/media/BOSS%20CEN/ref/ir2_e.pdf
Choi, D. G., & de Vries, H. J. (2011). Standardization as emerging content in technology education at all levels of education. International Journal of Technology and Design Education, 21(1), 111–135. https://doi.org/10.1007/s10798-009-9110-z
de Vries, H. J. (2020a). Addressing sustainability in education about standardisation: Lessons from the Rotterdam School of Management, Erasmus University. In S. O. Idowu, H. J. de Vries, I. Mijatovic, & D. Choi (Eds.), Sustainable development: Knowledge and education about standardisation (pp. 57–76). Springer. https://doi.org/10.1007/978-3-030-28715-3_5
de Vries, H. J. (2020b). Sustainable development: Knowledge and education about standardisation: Discussion. In S. O. Idowu, H. J. de Vries, I. Mijatovic, & D. Choi (Eds.), Sustainable development: Knowledge and education about standardisation (pp. 211–214). Springer. https://doi.org/10.1007/978-3-030-28715-3_13
de Vries, H. J., Trietsch, J., & Wiegmann, P. M. (2020). Learning in communities of standardisation professionals. In S. O. Idowu, H. J. de Vries, I. Mijatovic, & D. Choi (Eds.), Sustainable development: Knowledge and education about standardisation (pp. 179–190). Springer. https://doi.org/10.1007/978-3-030-28715-3_11
del Álamo, J., & Parada, H. (2025). D3.1: Pilot design report (Version 2, approved) [Project deliverable]. EDU4Standards.eu. https://doi.org/10.5281/zenodo.17721120
European Commission. (n.d.). High-Level Forum on European Standardisation. Retrieved 29 October 2026, from https://single-market-economy.ec.europa.eu/single-market/goods/european-standards/standardisation-policy/high-level-forum-european-standardisation_en
European Commission. (2022). An EU strategy on standardisation: Setting global standards in support of a resilient, green and digital EU single market (COM/2022/31 final). https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:52022DC0031
Fomin, V. V. (2020). From boring to intriguing: Personal perspective on making education about standardization appealing to students. In S. O. Idowu, H. J. de Vries, I. Mijatovic, & D. Choi (Eds.), Sustainable development: Knowledge and education about standardisation (pp. 31–43). Springer. https://doi.org/10.1007/978-3-030-28715-3_3
ISO/IEC. (2021). ISO/IEC Directives, Part 2: Principles and rules for the structure and drafting of ISO and IEC documents (9th ed.). International Organization for Standardization; International Electrotechnical Commission. https://www.iso.org/sites/directives/current/part2/index.xhtml
Garrison, D. R., & Kanuka, H. (2004). Blended learning: Uncovering its transformative potential in higher education. The Internet and Higher Education, 7(2), 95–105. https://doi.org/10.1016/j.iheduc.2004.02.001
Graham, C. R. (2006). Blended learning systems: Definition, current trends, and future directions. In C. J. Bonk & C. R. Graham (Eds.), The handbook of blended learning: Global perspectives, local designs (pp. 3–21). Pfeiffer.
Grün, K. (2015). Wege, um Normen und Standards mitzugestalten [Ways to help shape standards]. Zeitschrift für Recht des Bauwesens, 2015(1), I–IV. https://doi.org/10.33196/zrb201501I01
Heß, P., Buggenhagen, M., & Blind, K. (2025). The impact of standard-setting knowledge networks on firm innovation. Journal of Business Research, 200, 115626. https://doi.org/10.1016/j.jbusres.2025.115626
Holton, E. F., III. (1996). The flawed four-level evaluation model. Human Resource Development Quarterly, 7(1), 5–21. https://doi.org/10.1002/hrdq.3920070103
Idowu, S. O., de Vries, H. J., Mijatovic, I., & Choi, D. (Eds.). (2020). Sustainable development: Knowledge and education about standardisation. Springer. https://doi.org/10.1007/978-3-030-28715-3
Jakobs, K. (2020). Responsibility by design?! On the standardisation of “smart” systems. In J.-S. Gordon (Ed.), Smart technologies and fundamental rights (pp. 285–315). Brill.
Kirkpatrick, J. D., & Kirkpatrick, W. (2016). Kirkpatrick’s four levels of training evaluation. ATD Press.
Menold, N. (2020). Rating-scale labeling in online surveys: An experimental comparison of verbal and numeric rating scales with respect to measurement quality and respondents’ cognitive processes. Sociological Methods & Research, 49(1), 79–107. https://doi.org/10.1177/0049124117729694
Menold, N., & Bogner, K. (2016). Design of rating scales in questionnaires. GESIS Leibniz Institute for the Social Sciences. https://www.gesis.org/fileadmin/admin/Dateikatalog/pdf/guidelines/design_rating_scales_questionnaires_menold_bogner_2016.pdf
Mijatović, I. (2020). Teaching standardization to generation Z: Learning outcomes define teaching methods. In S. O. Idowu, H. J. de Vries, I. Mijatovic, & D. Choi (Eds.), Sustainable development: Knowledge and education about standardisation (pp. 191–208). Springer. https://doi.org/10.1007/978-3-030-28715-3_12
Mijatović, I. (2025). D2.3: Innovative teaching concept on standardisation: Use guide for standardisation education [Project deliverable]. EDU4Standards.eu. https://doi.org/10.5281/zenodo.14850705
Mosakas, K., Fomin, V. V., Veljanova, H., Reiter, B., Staudegger, E., Bierbauer, D., & Kuzmuk, O. (2025). Bringing values to standardisation: From policy concepts to a value-based framework for education about standardisation. Ethics and Information Technology, 27(3), Article 38. https://doi.org/10.1007/s10676-025-09833-6
Puiu, S. (2020). Strategies on education about standardization in Romania. In S. O. Idowu, H. J. de Vries, I. Mijatovic, & D. Choi (Eds.), Sustainable development: Knowledge and education about standardisation (pp. 95–110). Springer. https://doi.org/10.1007/978-3-030-28715-3_7
Regulation (EU) No 1025/2012 of the European Parliament and of the Council of 25 October 2012 on European standardisation. (2012). Official Journal of the European Union, L 316, 12–33. https://eur-lex.europa.eu/eli/reg/2012/1025/oj
Regulation (EU) 2019/1020 of the European Parliament and of the Council of 20 June 2019 on market surveillance and compliance of products and amending Directive 2004/42/EC and Regulations (EC) No 765/2008 and (EU) No 305/2011. (2019). Official Journal of the European Union, L 169, 1–44. https://eur-lex.europa.eu/eli/reg/2019/1020/oj
Scoppetta, S. (2025, December 13). Das unsichtbare Sicherheitsnetz [The invisible safety net; article with interview]. Kurier, Standort Österreich, p. 6.
Treaty on European Union (consolidated version). (2012). Official Journal of the European Union, C 326, 13–45. https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:12012M/TXT
University of Graz. (2026). Technical standards and law (Course no. 232.990, winter semester 2026/27) [Course record]. Institut für Rechtswissenschaftliche Grundlagen. https://online.uni-graz.at/kfu_online/ee/ui/ca2/app/desktop/#/slc.tm.cp/student/courses/1001373
Van den Bossche, P. (2020). A look behind the curtain: Standardization education for engineers from the electric vehicle standardization shopfloor. In S. O. Idowu, H. J. de Vries, I. Mijatovic, & D. Choi (Eds.), Sustainable development: Knowledge and education about standardisation (pp. 17–29). Springer. https://doi.org/10.1007/978-3-030-28715-3_2
Vasileva, E. (2020). Education about standardization in the context of sustainable development. In S. O. Idowu, H. J. de Vries, I. Mijatovic, & D. Choi (Eds.), Sustainable development: Knowledge and education about standardisation (pp. 79–94). Springer. https://doi.org/10.1007/978-3-030-28715-3_6
Veljanova, H. (2025). D2.1: Intended learning outcomes (ILOs) for standardisation education [Project deliverable]. EDU4Standards.eu. https://doi.org/10.5281/zenodo.17721151
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Teodora-Luiza Bulc

This work is licensed under a Creative Commons Attribution 4.0 International License.
