text quality

Human assessment remains the most trusted form of evaluation in natural language generation, among other areas of NLP, but there is huge variation in terms of both what is assessed and how it is assessed.

Over the last decade, crowdsourcing has become a standard method for collecting training data for NLP tasks and evaluating NLP systems …