FEI 2024, held this past June, which focused its educational sessions on human and AI themes, leveraged this trend during the conference by holding an onsite workshop featuring prompt engineering.
The “Prompt Engineering Mindset Workshop” at FEI was a special event that highlighted and demonstrated this growing specialty field. But prompt engineering is not necessarily a tool used only by the experts. In fact, it is quite accessible for the novice user with a bit of experimentation, and it goes beyond text to other mediums such as audio and video. Imagine tapping into a technology that not only enhances productivity but also redefines the creative process. Generative AI is doing just that—reshaping storytelling, music, and visual arts by offering new tools for innovation.
You’ve likely tested Generative AI for your own productivity. But you’re missing out, if you’re simply focused on text. The FEI session provided key examples of completed projects from “first prompt” to “desired outcome.”
For example, Amal Irgashev who runs AudioVerse Lab, an innovation initiative at Berklee College of Music focused on music technology, provided a prompt engineering mindset case study. Irgashev took us behind the scenes of music production, using generative AI to create an entire song from conception to completion.
Other guests at the workshop included Donald High, Chief Data Scientist, Internal Revenue Service, who took a more text-based approach to creating a visual report presentation with AI. Paul Greenberg, CEO, Butter Works, demonstrated various ways text prompts can be transformed into versatile and useful videos. And Matt Marcus, CEO and founder of Rhombus Ventures, showcased how you can leverage real-time image-to-image AI generation to create usable storyboards and concept videos.
Ultimately, the session’s focus on music, film, text and image case studies highlighted that the prompt itself is simply a tool, and your mindset going into the prompt is actually the first step to ensuring your objectives and outcomes are met. Taking a holistic approach to your prompt engineering mindset is key. With that mindset, you can simply optimize your text-based GenAI libraries, strategies and projects while expanding your outcomes to include audio, image and film. In addition, in this way humans can add another layer of value to their collaborations with AI.
Prompting Progress
Want to learn more about prompt engineering? All Things Innovation’s “Positioning the Role of Prompt Engineering,” explores the subject in more detail. Prompt engineering is one of the latest buzzwords when it comes to artificial intelligence, but what is this evolving and complex job function? Some may think it’s just another form of data engineering, but ultimately prompt engineering is a primary cog in the AI and machine learning world, one in which it plays a crucial role in AI progression. According to Giskard, an AI and data science practice, it “consists of the generation and refinement of prompts, steering language models towards the intended responses.” Despite appearing as a fundamental foundational tool on the surface, prompt engineering is an intricate undertaking that intertwines the creativity of the human element with AI expertise.
Editor’s note: All three “Prompt Hacks” demonstrated at the FEI workshop are available at https://streamly.video/category/innovation.
Video courtesy of Streamly
