Feature Request: Support LightOnOCR-2-1B

[SarcasticBaka29]

Prerequisites

• I am running the latest code. Mention the version if possible as well.
• I carefully followed the README.md.
• I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
• I reviewed the Discussions, and have a new and useful enhancement to share.

Feature Description

A v2 of the LightOnOCR-1B model was just released.

Motivation

The first gen model which is supported by llama.cpp is one the best and fastest small OCR models and this newer version looks to be a substantial improvement on all fronts, so it would cool to see support for it as well.

Possible Implementation

Initial LightOnOCR-1B model implementation.

[vernalan]

Seriously want this!

[staghado]

Hello,
one of LightOnOCR authors here, both versions are architecturally the same.
to run v2 with llama.cpp, the only step required is converting the model weights into GGUF format.

[staghado]

Here are some GGUFs i made:

• https://huggingface.co/staghado/LightOnOCR-2-1B-Q8_0-GGUF
• https://huggingface.co/staghado/LightOnOCR-2-1B-Q4_K_M-GGUF
• https://huggingface.co/staghado/LightOnOCR-2-1B-Q4_K_S-GGUF

also added instructions how to create new ones so you can do it for all model variants, enjoy!

[PaulCrz]

Here are some GGUFs i made:

• https://huggingface.co/staghado/LightOnOCR-2-1B-Q8_0-GGUF
• https://huggingface.co/staghado/LightOnOCR-2-1B-Q4_K_M-GGUF
• https://huggingface.co/staghado/LightOnOCR-2-1B-Q4_K_S-GGUF

also added instructions how to create new ones so you can do it for all model variants, enjoy!

Amazing thank you, already tested it and results are really impressive

[github-actions]

This issue was closed because it has been inactive for 14 days since being marked as stale.