Prompts are critical for guiding LLMs towards desired outputs, shaping their understanding and capabilities. We partnered with Perplexity, to create a diverse and high-quality dataset of prompts.
Maintaining prompt diversity is essential for effective LLM training. Diverse prompts expose the model to various scenarios, fostering a broader range of skills and preventing bias. However, ensuring 100% natural and authentic prompts became a challenge as our workforce approached creative limitations after generating a significant volume of prompts.
To address this challenge, SoftAge implemented a two-pronged approach:
Through this collaboration, SoftAge successfully created a diverse dataset containing over 50 domains and catering to hundreds of LLM use cases. Perplexity's LLMs benefited from the richness and variety of the prompts.