Abstract and 1. Introduction

  1. Methods
  2. Quantitative Results and Creativity Support Index
  3. Qualitative Results from Focus Group Discussions
  4. Discussion
  5. Mitigations and Conclusion and Acknowledgments
  6. Ethical Guidance References

A. Related Work on Computational Humour, AI and Comedy

B. Participant Questionaire

C. Focus

B PARTICIPANT QUESTIONNAIRE

B.1 Your past experience with AI systems in general.

Please answer based on your past experience, before this workshop.

• Have you used AI systems to write comedy material in the past? [Yes, and I used that material in some of my performances / Yes, but only to explore ideas / No]

• Have you used AI systems to generate content (including audio, video, text, etc.) for some of your performances? [Yes, and I operated the AI system myself / Yes, but someone else operated the AI system / No]

• In fewer than 10 words, why did you use AI in your artistic process? For example: trendy topic, glitch aesthetic, inspiration, etc.

• In fewer than 10 words, what is your background with AI? (Please do not give personally identifiable information)

• In few than 10 words, what is your performance background? For example: full-time comedian, dancer, years of experience, etc. (Please do not give personally identifiable information)

Note that the wording of these questions (for example: trendy topic, glitch aesthetic, inspiration) could be considered as potentially biasing, but we believed it was ultimately helpful to prompt study participants.

B.2 Your experience with the AI system for writing comedy material

Please answer based on your interaction with the AI system in this morning’s writing session.

• I found the AI system helpful. [1 to 5]

• I felt like I was collaborating with the AI system. [1 to 5]

• I found it easy to write with the AI system. [1 to 5]

• I enjoyed writing with the AI system. [1 to 5]

• I was able to express my creative goals while writing with the AI system. [1 to 5]

• The comedy material written with the AI system feel unique. [1 to 5]

• I feel I have ownership over the comedy material written with the AI system. [1 to 5]

• I was surprised by the responses from the AI system. [1 to 5]

• I’m proud of the comedy material written with the AI system. [1 to 5]

In the questions above, 1 corresponds to Strongly disagree and 5 to Strongly agree.

B.3 Creativity Support Index of the AI writing tool

This section contains questions that will allow us to compute a Creativity Support Index for the AI writing tool. Most of these questions overlap with those in the previous section.

• The AI system allowed other people to work with me easily. [1 to 10]

• It was really easy to share ideas and designs with other people inside this system or tool. [1 to 10]

• I would be happy to use this system or tool on a regular basis. [1 to 10]

• I enjoyed using the system or tool. [1 to 10]

• It was easy for me to explore many different ideas, options, designs, or outcomes, using this system or tool. [1 to 10]

• The AI system was helpful in allowing me to track different ideas, outcomes, or possibilities. [1 to 10]

• I was able to be very creative while doing the activity inside this system or tool. [1 to 10]

• The system or tool allowed me to be very expressive. [1 to 10]

• My attention was fully tuned to the activity, and I forgot about the AI system that I was using. [1 to 10]

• I became so absorbed in the activity that I forgot about the AI system that I was using. [1 to 10]

• What I was able to produce was worth the effort I had to exert to produce it. [1 to 10]

• I was satisfied with what I got out of the system or tool. [1 to 10]

In the questions above, 1 corresponds to Strongly disagree and 10 to Strongly agree.

• Be creative and expressive

• Become immersed in the activity

• Enjoy using the system or tool

• Explore many different ideas, outcomes, or possibilities

• Produce results that are worth the effort I put in

• Work with other people

All the questions listed in this section B.3 are directly taken from [25] and the NASA Task Load Index [43], and are used as is for easy of reproduction of results. Note that the questions pertaining to human-human collaboration are less pertinent to our study

B.4 Free-form questions about the AI system for writing.

• What is one thing that the AI system did well?

• What is one improvement for the AI system?

• Please provide any comments, reflections, or open questions that came up for you during the writing session.

• Please provide any other comments, reflections, or open questions that came up for you when answering this survey.

Authors:

(1) Piotr W. Mirowski∗, Google DeepMind London, UK (piotrmirowski@deepmind.com);

(2) Juliette Love∗, Google DeepMind London, UK ( juliettelove@deepmind.com);

(3) Kory Mathewson, Google DeepMind Montréal, QC, Canada (korymath@deepmind.com);

(4) Shakir Mohamed, Google DeepMind London, UK (shakir@deepmind.com).


This paper is available on arxiv under CC BY 4.0 license.