Machine_Reading_Comprehension_pjt

Naver connect foundation boostcamp AI Tech pjt

1. NLP machine reading comprehension training sample

NLP Question answering task

query - retrieval - passage - reader - answer

retrieval training

reader training

huggingface style

2. mixed precision training

3. embedding

dense embedding(in-batch negative)

TF-IDF sparse embedding

BM25 score

4. reader model inference

sum of logit sum of softmax product of softmax

5. retrieval model inference

single passage multiple passage