Note: This issue was copied from ggml-org#5276
Original Author: @KnutJaegersberg
Original Issue Number: ggml-org#5276
Created: 2024-02-02T08:06:39Z
Feature Description
Like Phi is supported, it would great to have this Mistral level 2b model ggufable.
Motivation
SOTA 2b model, a piece of art, read how they made it:
https://shengdinghu.notion.site/MiniCPM-Unveiling-the-Potential-of-End-side-Large-Language-Models-d4d3a8c426424654a4e80e42a711cb20
Note: This issue was copied from ggml-org#5276
Original Author: @KnutJaegersberg
Original Issue Number: ggml-org#5276
Created: 2024-02-02T08:06:39Z
Feature Description
Like Phi is supported, it would great to have this Mistral level 2b model ggufable.
Motivation
SOTA 2b model, a piece of art, read how they made it:
https://shengdinghu.notion.site/MiniCPM-Unveiling-the-Potential-of-End-side-Large-Language-Models-d4d3a8c426424654a4e80e42a711cb20