search

facebookresearch / nougat

Implementation of Nougat Neural Optical Understanding for Academic Documents
https://facebookresearch.github.io/nougat/
MIT License
8.81k stars 561 forks source link

Nougat is now available in 🤗 Transformers #128

Closed NielsRogge closed 1 year ago

NielsRogge commented 1 year ago

Hi folks,

Thanks for the great model :) Nougat is now available in HF Transformers, it's similar to Donut which was already available.

Docs can be found here: https://huggingface.co/docs/transformers/main/en/model_doc/nougat

Models are on the hub: https://huggingface.co/models?other=nougat.

Tutorial notebooks for inference + fine-tuning can be found here: https://github.com/NielsRogge/Transformers-Tutorials/tree/master/Nougat.

A Gradio demo (hosted as a 🤗 Space) can be found here: https://huggingface.co/spaces/hf-vision/nougat-transformers

lukas-blecher commented 1 year ago

Awesome! thanks a lot for your work

bp-high commented 1 year ago

Hi @NielsRogge @lukas-blecher , I recently built an AI Research Buddy using Nougat , a discussion buddy when it comes to research papers on Arxiv or Acl Anthology. Would love your feedback on this. Video:- https://www.youtube.com/watch?v=c3Ae7DBuE-U Github:- https://github.com/bp-high/research_buddy HF Spaces Link:- https://huggingface.co/spaces/bpHigh/AI-Research-Buddy This was built for the StreamLit LLM Hackathon (https://streamlit.io/community/llm-hackathon-2023)

Built using Modal Labs , Clarifai, LlamaIndex, LangChain, OpenAI, Streamlit and ofcourse Nougat by Meta Facebook .

Deployed on Hugging Face .