Skip to content

extend preprocess_data_dist to handle jsonl files#60

Open
adammoody wants to merge 76 commits into
bigscience-workshop:mainfrom
adammoody:mpijson
Open

extend preprocess_data_dist to handle jsonl files#60
adammoody wants to merge 76 commits into
bigscience-workshop:mainfrom
adammoody:mpijson

store newline offsets in memory during scan

b9aa845
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs