PERSONA: A Tool for Generating Algorithmic Personas for Reflective Annotations
Designed to address human-annotator bias in machine learning data pipelines, PERSONA is a novel dataset annotation tool that uses large language models (LLMs) to generate diverse, value-driven 'personas'—simulated annotator profiles—to guide users through subjective labelling tasks. Through a two-part user study, PERSONA was shown to increase annotator self-awareness, promote cognitive diversity, and improve dataset inclusivity.
PythonFlaskLangChainWeb DevelopmentAI/MLLarge Language ModelsHuman-Computer InteractionResearch Publication