Note: This issue was copied from ggml-org#1776
Original Author: @vvasily
Original Issue Number: ggml-org#1776
Created: 2023-06-09T08:15:53Z
https://github.com/ggerganov/llama.cpp/blob/92f44ff7f778ef1b94028b2ba6d39943b5ca0ada/llama.cpp#L3251
In my implementation of llama based model we use redefined eos and bos symbols from additional tokens. In this code they are hardcoded. I think this possibility should be implemented in this code.
Note: This issue was copied from ggml-org#1776
Original Author: @vvasily
Original Issue Number: ggml-org#1776
Created: 2023-06-09T08:15:53Z
https://github.com/ggerganov/llama.cpp/blob/92f44ff7f778ef1b94028b2ba6d39943b5ca0ada/llama.cpp#L3251
In my implementation of llama based model we use redefined eos and bos symbols from additional tokens. In this code they are hardcoded. I think this possibility should be implemented in this code.