A validation regarding effectiveness of Scenario Graph

Hiroyuki Yagita, Akira Tose, Madoka Nakajima, Sun K. Kim, Takashi Maeno

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Scenario Graph is a structured mind mapping methodology that aids design teams to generate potential scenarios for new products and services while visually organizing contextual information. Since its introduction in industry and academia, the Scenario Graph has helped design teams to capture new values and behaviors of potential customers during the problem formulation stage. At the same time, the Scenario Graph, sharing a common challenge with various design methods, has faced difficulty regarding validation of its effectiveness as a design method. This paper describes a validation framework for a method in problem formulation stages and an experiment, which compare ideation results of 87 people-43 people with the Scenario Graph method (as a test group) and 44 people with the Brainstorming (as a control group) - to solve an identical problem. While the results show no statistically significant difference in the number of ideas generated, the data reveals statistically significant differences in the quality of ideas. The test group, which used the Scenario Graph, yielded ideas that were more novel, feasible, and abstract than the control group, which used the Brainstorming, did. These metrics represent a way to measure the quality of ideas in the domain of engineering design. Our experiment confirms the hypotheses that the Scenario Graph is effective in improving the performance of idea generation sessions, which is consistent with qualitative evaluations. The lessons, gained from this experiment, provide an insight on how this method can be effectively used during the early stages of concept generation of a company's process for product and/or service development.

Original languageEnglish
Title of host publicationProceedings of the ASME Design Engineering Technical Conference
Pages385-394
Number of pages10
Volume9
DOIs
Publication statusPublished - 2011
EventASME 2011 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC/CIE 2011 - Washington, DC, United States
Duration: 2011 Aug 282011 Aug 31

Other

OtherASME 2011 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC/CIE 2011
CountryUnited States
CityWashington, DC
Period11/8/2811/8/31

Fingerprint

Scenarios
Graph in graph theory
Design aids
Experiments
Design Method
Industry
Experiment
Formulation
Engineering Design
Sharing
Customers
Metric
Methodology
Evaluation
Design

Keywords

  • Brain storming
  • Creative thinking
  • Innovation
  • New business
  • Scenario Graph
  • Validation framework

ASJC Scopus subject areas

  • Mechanical Engineering
  • Computer Graphics and Computer-Aided Design
  • Computer Science Applications
  • Modelling and Simulation

Cite this

Yagita, H., Tose, A., Nakajima, M., Kim, S. K., & Maeno, T. (2011). A validation regarding effectiveness of Scenario Graph. In Proceedings of the ASME Design Engineering Technical Conference (Vol. 9, pp. 385-394) https://doi.org/10.1115/DETC2011-48047

A validation regarding effectiveness of Scenario Graph. / Yagita, Hiroyuki; Tose, Akira; Nakajima, Madoka; Kim, Sun K.; Maeno, Takashi.

Proceedings of the ASME Design Engineering Technical Conference. Vol. 9 2011. p. 385-394.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Yagita, H, Tose, A, Nakajima, M, Kim, SK & Maeno, T 2011, A validation regarding effectiveness of Scenario Graph. in Proceedings of the ASME Design Engineering Technical Conference. vol. 9, pp. 385-394, ASME 2011 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC/CIE 2011, Washington, DC, United States, 11/8/28. https://doi.org/10.1115/DETC2011-48047
Yagita H, Tose A, Nakajima M, Kim SK, Maeno T. A validation regarding effectiveness of Scenario Graph. In Proceedings of the ASME Design Engineering Technical Conference. Vol. 9. 2011. p. 385-394 https://doi.org/10.1115/DETC2011-48047
Yagita, Hiroyuki ; Tose, Akira ; Nakajima, Madoka ; Kim, Sun K. ; Maeno, Takashi. / A validation regarding effectiveness of Scenario Graph. Proceedings of the ASME Design Engineering Technical Conference. Vol. 9 2011. pp. 385-394
@inproceedings{dee27ef5cd074cd59164ba5914cdc40b,
title = "A validation regarding effectiveness of Scenario Graph",
abstract = "Scenario Graph is a structured mind mapping methodology that aids design teams to generate potential scenarios for new products and services while visually organizing contextual information. Since its introduction in industry and academia, the Scenario Graph has helped design teams to capture new values and behaviors of potential customers during the problem formulation stage. At the same time, the Scenario Graph, sharing a common challenge with various design methods, has faced difficulty regarding validation of its effectiveness as a design method. This paper describes a validation framework for a method in problem formulation stages and an experiment, which compare ideation results of 87 people-43 people with the Scenario Graph method (as a test group) and 44 people with the Brainstorming (as a control group) - to solve an identical problem. While the results show no statistically significant difference in the number of ideas generated, the data reveals statistically significant differences in the quality of ideas. The test group, which used the Scenario Graph, yielded ideas that were more novel, feasible, and abstract than the control group, which used the Brainstorming, did. These metrics represent a way to measure the quality of ideas in the domain of engineering design. Our experiment confirms the hypotheses that the Scenario Graph is effective in improving the performance of idea generation sessions, which is consistent with qualitative evaluations. The lessons, gained from this experiment, provide an insight on how this method can be effectively used during the early stages of concept generation of a company's process for product and/or service development.",
keywords = "Brain storming, Creative thinking, Innovation, New business, Scenario Graph, Validation framework",
author = "Hiroyuki Yagita and Akira Tose and Madoka Nakajima and Kim, {Sun K.} and Takashi Maeno",
year = "2011",
doi = "10.1115/DETC2011-48047",
language = "English",
isbn = "9780791854860",
volume = "9",
pages = "385--394",
booktitle = "Proceedings of the ASME Design Engineering Technical Conference",

}

TY - GEN

T1 - A validation regarding effectiveness of Scenario Graph

AU - Yagita, Hiroyuki

AU - Tose, Akira

AU - Nakajima, Madoka

AU - Kim, Sun K.

AU - Maeno, Takashi

PY - 2011

Y1 - 2011

N2 - Scenario Graph is a structured mind mapping methodology that aids design teams to generate potential scenarios for new products and services while visually organizing contextual information. Since its introduction in industry and academia, the Scenario Graph has helped design teams to capture new values and behaviors of potential customers during the problem formulation stage. At the same time, the Scenario Graph, sharing a common challenge with various design methods, has faced difficulty regarding validation of its effectiveness as a design method. This paper describes a validation framework for a method in problem formulation stages and an experiment, which compare ideation results of 87 people-43 people with the Scenario Graph method (as a test group) and 44 people with the Brainstorming (as a control group) - to solve an identical problem. While the results show no statistically significant difference in the number of ideas generated, the data reveals statistically significant differences in the quality of ideas. The test group, which used the Scenario Graph, yielded ideas that were more novel, feasible, and abstract than the control group, which used the Brainstorming, did. These metrics represent a way to measure the quality of ideas in the domain of engineering design. Our experiment confirms the hypotheses that the Scenario Graph is effective in improving the performance of idea generation sessions, which is consistent with qualitative evaluations. The lessons, gained from this experiment, provide an insight on how this method can be effectively used during the early stages of concept generation of a company's process for product and/or service development.

AB - Scenario Graph is a structured mind mapping methodology that aids design teams to generate potential scenarios for new products and services while visually organizing contextual information. Since its introduction in industry and academia, the Scenario Graph has helped design teams to capture new values and behaviors of potential customers during the problem formulation stage. At the same time, the Scenario Graph, sharing a common challenge with various design methods, has faced difficulty regarding validation of its effectiveness as a design method. This paper describes a validation framework for a method in problem formulation stages and an experiment, which compare ideation results of 87 people-43 people with the Scenario Graph method (as a test group) and 44 people with the Brainstorming (as a control group) - to solve an identical problem. While the results show no statistically significant difference in the number of ideas generated, the data reveals statistically significant differences in the quality of ideas. The test group, which used the Scenario Graph, yielded ideas that were more novel, feasible, and abstract than the control group, which used the Brainstorming, did. These metrics represent a way to measure the quality of ideas in the domain of engineering design. Our experiment confirms the hypotheses that the Scenario Graph is effective in improving the performance of idea generation sessions, which is consistent with qualitative evaluations. The lessons, gained from this experiment, provide an insight on how this method can be effectively used during the early stages of concept generation of a company's process for product and/or service development.

KW - Brain storming

KW - Creative thinking

KW - Innovation

KW - New business

KW - Scenario Graph

KW - Validation framework

UR - http://www.scopus.com/inward/record.url?scp=84863601409&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84863601409&partnerID=8YFLogxK

U2 - 10.1115/DETC2011-48047

DO - 10.1115/DETC2011-48047

M3 - Conference contribution

AN - SCOPUS:84863601409

SN - 9780791854860

VL - 9

SP - 385

EP - 394

BT - Proceedings of the ASME Design Engineering Technical Conference

ER -