Nougat: Neural Optical Understanding for Academic Documents
Scientific knowledge is predominantly stored in books and scientific
journals, often in the form of PDFs. However, the PDF format leads to a loss of
semantic information, particularly for mathematical expressions. We propose
Nougat (Neural Optical Understanding for Academic Documents), a Visual
Transformer model that performs an Optical Character Recognition (OCR) task for
processing scientific documents into a markup language, and demonstrate the
effectiveness of our model on a new dataset of scientific documents. The
proposed approach offers a promising solution to enhance the accessibility of
scientific knowledge in the digital age, by bridging the gap between
human-readable documents and machine-readable text. We release the models and
code to accelerate future work on scientific text recognition.
64ec766ac782d648d293ebbf
Lukas Blecher
extracted_pending
2023-08-28T10:26:51.380Z
628d313986d23ad156081735
/avatars/64f52fab209d478aaf0be7b64e13be37.svg
Lukas Blecher
user
lukbl
64ec766ac782d648d293ebc0
Guillem Cucurull
claimed_verified
2024-04-26T09:03:51.651Z
64b9069c8815d865211e280c
/avatars/1da1d77db9684960dbf27460b7d50739.svg
Guillem
user
gcucurull
64ec766ac782d648d293ebc1
Thomas Scialom
admin_assigned
2023-08-28T12:24:36.291Z
60c0e0c06c0791283058f0fb
/avatars/84c0fe390a171e68b79a8274405ebf06.svg
Scialom
user
ThomasNLG
64ec766ac782d648d293ebc2
Robert Stojnic
Nougat: Neural Optical Understanding for Academic Documents
Scientific knowledge is predominantly stored in books and scientific
journals, often in the form of PDFs. However, the PDF format leads to a loss of
semantic information, particularly for mathematical expressions. We propose
Nougat (Neural Optical Understanding for Academic Documents), a Visual
Transformer model that performs an Optical Character Recognition (OCR) task for
processing scientific documents into a markup language, and demonstrate the
effectiveness of our model on a new dataset of scientific documents. The
proposed approach offers a promising solution to enhance the accessibility of
scientific knowledge in the digital age, by bridging the gap between
human-readable documents and machine-readable text. We release the models and
code to accelerate future work on scientific text recognition.
Nougat, a Visual Transformer model, performs OCR on scientific documents converting them to markup language, enhancing digital accessibility.
Visual Transformer Optical Character Recognition OCR markup language