perf(llama3): project only the sampled row through the LM head at prefill - #1969

perf(llama3): project only the sampled row through the LM head at prefill#1969

inureyes merged 1 commit into

mainlablup/mlxcel:mainfrom

update/issue-1968-llama3-last-row-prefilllablup/mlxcel:update/issue-1968-llama3-last-row-prefillCopy head branch name to clipboard