For GenAI to produce the kind of content you’re looking for, you need to tell it what you want. The words you put into a GenAI tool hugely influence the quality of output generated, so you need to carefully consider the words you are using to get the best result.
Consider how you currently ask a GenAI tool to create content. How useful do you find the content it creates?
Getting the best possible content from GenAI tools means being aware of the what, the why and the how of prompt engineering. As GenAI models enter everyday life, prompting skills will become more in-demand. For students, being able to work effectively with GenAI directly impacts successful study and learning experiences.
Becoming a prompt expert means having a clear working idea of what prompts, outputs and prompt engineering are.
Prompts or commands are crucial to working with technology. They’re the instructions you use to interact with the program or system. Think of how you ask Google or Library Search to find information you need. Or the way you request Siri, Alexa or other virtual assistants to do something for you.
The prompt is the instructions you input to guide content generation whether it’s text, image, audio or a combination output. Prompts are typically word-based. However, you can also provide visual or audio prompts in addition to written instruction in some GenAI tools.
Outputs are the results or content GenAI tools produce, in response to the input elements or prompts you provide. Outputs can be text, image, or audio based (or a combination). Outputs are not fixed or final and can be edited, modified, or improved. The quality of the prompt input used with the GenAI tool will directly impact on the quality and effectiveness of an output.
What makes a good prompt is the art of prompt engineering. Prompt engineering is the practice of building and refining prompts to ensure quality output is produced by the GenAI tool. Crafting clear and effective instructions or questions for GenAI tools helps them to produce content that matches your expectations.
Taking some time to consider the various elements of the content you would like the GenAI tool to produce for you will help you to develop a more effective prompt.
Great prompts have some or all of the following elements:
Try the following two prompts in Microsoft Copilot and see the difference:
Generating different forms of content (text, visual, audio, etc.) usually means using different GenAI tools. Different tools to generate different forms also means you need different approaches in prompt design to get effective and desired results.
Well-crafted prompts are the grounding for good quality content to be generated. However, just like when you are drafting something it takes a few versions. Usually a series of prompts are used in conversation with the GenAI tool to get a good result.
Clarity: Your prompt should be clear and specific. Vague prompts can lead to vague outputs.
Leading: You can set the tone, style, or context in your prompt. E.g., "Write a horror story about a haunted piano" vs. "Write a romantic story about a piano in a Parisian cafe."
Constraints: You can limit or guide the model's response by adding constraints, such as word limits or specific structures.
Descriptive: Since you're trying to visualize a concept, your description needs to be detailed. E.g., "A serene sunset over a mountainous landscape with a river flowing in the foreground."
Input Images: Some models allow you to input an image as a starting point, and then describe modifications or elements you want to add or change.
Iteration: You might not get the perfect image on the first try. Refining your prompts or giving feedback on initial outputs can help in achieving the desired result.
Descriptive Soundscapes: Describe the audio environment you want. E.g., "A busy city street with distant sounds of a jazz band, honking cars, and nearby footsteps."
Musical Details: If generating music, you might specify instruments, tempo, mood, or genre. E.g., "A calm piano melody with a slow tempo, accompanied by a soft cello in the background."
Duration: You may need to specify the length of the audio clip.
Feedback Loops: For nuanced compositions, iterative feedback might be required.
Except where otherwise noted, content on this site is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Australia License.
QUT acknowledges the Traditional Owners of the lands where QUT now stands.