What is Prompt Tuning

updated 17 Aug 2023

Prompt tuning is a technique used to optimize the performance of large language models, such as generative AI models, for specific tasks without the need for extensive retraining. It involves introducing task-specific cues or prompts to guide the model's output towards a desired decision or prediction. These prompts can be in the form of additional words inserted by humans or AI-generated numbers integrated into the model's embedding layer. The goal of prompt tuning is to fine-tune a pre-existing model for a narrow task by providing cues at inference time, rather than training a new model from scratch or extensively retraining an existing one. This technique is especially useful for tailoring models to perform specialized tasks quickly and efficiently.

What is Prompt Tuning?

Optimizing Specialized Task Performance with Prompt Tuning