speculative : add tree-based sampling example - #3624

Merged

ggerganov merged 18 commits into

speculative-tree

Oct 18, 2023

Commits on Oct 12, 2023

sampling : one sequence per sampling context
ggerganov
committed
5261aee

Commits on Oct 14, 2023

speculative : add tree-based sampling support
ggerganov
committed
4de5a2d

Commits on Oct 15, 2023

speculative : reuse the n_parallel CLI param
ggerganov
committed
32a67cb
speculative : refactor sampling
ggerganov
committed
4a7f43f
examples : fix build after sampling refactoring
ggerganov
committed
7e48e21
batched : fix n_seq_id
ggerganov
committed
0d96efa
sampling : fix malloc
ggerganov
committed
b5554b9
swift : fix build
ggerganov
committed
b8acb6c
swift : try to fix build
ggerganov
committed
5b34bfa

Commits on Oct 16, 2023

Commits on Oct 17, 2023

Commits on Oct 18, 2023

Merge branch 'master' into speculative-tree
ggerganov
committed
ad2727d