Measuring the Impact of ChatGPT on Fostering Concept Generation in Innovative Product Design

Round 1

Reviewer 1 Report

The research seems interesting. The author compared the impact of ChatGPT and other classic methods in innovative product design. The results provide some perspectives about whether the ChatGPT will be helpful or not in generating innovative ideas. Overall the study is innovative and of high value. However, the language needs to be improved to make the study more clear.  

The language need to be improved.

Author Response

Please see the attachment.

Author Response File: Author Response.pdf

Reviewer 2 Report

The author has built a solid research on a topic of great interest in the field of design, whose methodology can be implemented in other areas (graphic design, for example) in the future.

There are some doubts about the methodology, which are discussed below:

- Why, in the Quantity table (p. 7), is there no mention of the global results between both groups (G1 and G2)? In the beginning of the Discussion (p. 10), both groups are mentioned but it is not previously clear enough.

- It would be interesting to go deeper into the type of questions or statements made by the students to ChatGPT: the author only partially formulates them on page 11. It could be interesting to know the use given by the students to generate concepts through AI.

- In this sense, have the students received any information about the use of ChatGPT? Or, at least, do they have any previous experience?

- As the author acknowledges, the number of participants (18) is too low to provide definitive conclusions. In such a small number, the profile of the students (performance, training, etc.) seems relevant. How old are they and which is their experience? This information may be useful. Nor is it explained why they are distributed in pairs.

- In this sense, which is the content of the "Product Interaction and Innovation” course? Is the task linked to its content?

- The references seem enough. It would seem interesting, however, to include the following doctoral thesis on the subject: Rico Sesé, J. (2023). Nuevos retos para el diseño y la comunicación. La inteligencia artificial en los procesos creativos del diseño gráfico. Doctoral thesis. Universidad Politécnica de València.

Author Response

Please see the attachment.

Author Response File: Author Response.pdf

Reviewer 3 Report

use of chat GPT not clear at all. the paper should also contain flowcharts and examples of prompts given. The paper tries to quantify quality of innovation- which is a strange approach- it would have been more interesting to present and report on the interaction with ChatGPT itself and how humans interact with it compared to utilising TRIZ. a huge part of the paper seems missing and it appears rushed. 

ok, however the references seem irrelevant. 

Author Response

Please see the attachment.

Author Response File: Author Response.pdf

Round 2

Reviewer 3 Report

Overall the initial trajectory is interesting, however it would be good to conduct more experiments before reporting. 

the edits have improved the style of language. 

Author Response

Please see the attachment.

Author Response File: Author Response.pdf

Round 3

Reviewer 3 Report

The experimental design should be improved in the context of product design exploration/ ideation and crucial design methods, such as the double diamond approach. The cohort of participants should be improved and the complexity of tasks related to product augmentation is not sufficiently demonstrated. 

adequate

Author Response

Please see the attachment.

Author Response File: Author Response.pdf