Visualizing Linguistic Diversity of Text Datasets Synthesized by Large
  Language Models
Large language models (LLMs) can be used to generate smaller, more refined
datasets via few-shot prompting for benchmarking, fine-tuning or other use
cases. However, understanding and evaluating these datasets is difficult, and
the failure modes of LLM-generated data are still not well understood.
Specifically, the data can be repetitive in surprising ways, not only
semantically but also syntactically and lexically. We present LinguisticLens, a
novel inter-active visualization tool for making sense of and analyzing
syntactic diversity of LLM-generated datasets. LinguisticLens clusters text
along syntactic, lexical, and semantic axes. It supports hierarchical
visualization of a text dataset, allowing users to quickly scan for an overview
and inspect individual examples. The live demo is available at
shorturl.at/zHOUV.
646acd1835c7a57f936c45fb
Emily Reif
extracted_confirmed
2023-05-22T15:24:35.303Z
646b88fb942fd7c135dc0ec1
/avatars/0ebcb6cc72458b947f034ac8e13611e8.svg
Emily Reif
user
emilyreif
646acd1835c7a57f936c45fc
Minsuk Kahng
admin_assigned
2023-05-22T12:47:56.824Z
6301f3fb4ccccaa23d38fb7f
/avatars/4226111991d1788d3d442ffb2f33ea48.svg
Minsuk Kahng
user
minsukkahng
646acd1835c7a57f936c45fd
Savvas Petridis
Visualizing Linguistic Diversity of Text Datasets Synthesized by Large
  Language Models
Large language models (LLMs) can be used to generate smaller, more refined
datasets via few-shot prompting for benchmarking, fine-tuning or other use
cases. However, understanding and evaluating these datasets is difficult, and
the failure modes of LLM-generated data are still not well understood.
Specifically, the data can be repetitive in surprising ways, not only
semantically but also syntactically and lexically. We present LinguisticLens, a
novel inter-active visualization tool for making sense of and analyzing
syntactic diversity of LLM-generated datasets. LinguisticLens clusters text
along syntactic, lexical, and semantic axes. It supports hierarchical
visualization of a text dataset, allowing users to quickly scan for an overview
and inspect individual examples. The live demo is available at
shorturl.at/zHOUV.
LinguisticLens is an interactive tool for visualizing and analyzing syntactic diversity in datasets generated by large language models.
large language models few-shot prompting benchmarking fine-tuning LinguisticLens syntactic diversity lexical diversity semantic diversity hierarchical visualization