Natural Language Commanding via Program Synthesis
We present Semantic Interpreter, a natural language-friendly AI system for
productivity software such as Microsoft Office that leverages large language
models (LLMs) to execute user intent across application features. While LLMs
are excellent at understanding user intent expressed as natural language, they
are not sufficient for fulfilling application-specific user intent that
requires more than text-to-text transformations. We therefore introduce the
Office Domain Specific Language (ODSL), a concise, high-level language
specialized for performing actions in and interacting with entities in Office
applications. Semantic Interpreter leverages an Analysis-Retrieval prompt
construction method with LLMs for program synthesis, translating natural
language user utterances to ODSL programs that can be transpiled to application
APIs and then executed. We focus our discussion primarily on a research
exploration for Microsoft PowerPoint.
647fdc4a80fd1d698c6def57
Apurva Gandhi
claimed_verified
2023-06-23T07:34:00.561Z
6495458d5ba8e6c66e1cd34c
/avatars/f4ee1aa36a496e8d3490643e65741c1b.svg
Apurva Gandhi
user
apurvaga
647fdc4a80fd1d698c6def58
Thong Q. Nguyen
claimed_verified
2023-06-07T19:40:43.329Z
62917972473e457463a7f77e
/avatars/71758e6ddd218f21b915b059bc2c336d.svg
Thong Nguyen
user
thongonary
647fdc4a80fd1d698c6def59
Huitian Jiao
claimed_verified
2023-06-07T19:40:36.984Z
6480c36ccacb1c4a0696e446
/avatars/f262ddaab22ccb331946454831fca19a.svg
Huitian Jiao
user
hjhf
647fdc4a80fd1d698c6def5a
Robert Steen
647fdc4a80fd1d698c6def5b
Ameya Bhatawdekar
claimed_verified
2023-06-07T19:40:48.635Z
630e5b3564f1f8d0c770b8f3
https://cdn-avatars.huggingface.co/v1/production/uploads/630e5b3564f1f8d0c770b8f3/N3P4NJaHQhxV0zCzPGy13.jpeg
Ameya Bhatawdekar
user
ameyab
Natural Language Commanding via Program Synthesis
We present Semantic Interpreter, a natural language-friendly AI system for
productivity software such as Microsoft Office that leverages large language
models (LLMs) to execute user intent across application features. While LLMs
are excellent at understanding user intent expressed as natural language, they
are not sufficient for fulfilling application-specific user intent that
requires more than text-to-text transformations. We therefore introduce the
Office Domain Specific Language (ODSL), a concise, high-level language
specialized for performing actions in and interacting with entities in Office
applications. Semantic Interpreter leverages an Analysis-Retrieval prompt
construction method with LLMs for program synthesis, translating natural
language user utterances to ODSL programs that can be transpiled to application
APIs and then executed. We focus our discussion primarily on a research
exploration for Microsoft PowerPoint.
Semantic Interpreter, a natural language AI system for Microsoft Office, combines large language models with a domain-specific language to execute user intent across Office applications.
large language models LLMs Office Domain Specific Language ODSL Analysis-Retrieval prompt construction program synthesis application APIs