Assignment

[zaf-tech]

What changes are you trying to make? (e.g. Adding or removing code, refactoring existing code, adding reports)

What did you learn from the changes you have made?

How to load env, use langchain and deepeval for evaluation, and extract data from pdf.

Was there another approach you were thinking about making? If so, what approach(es) were you thinking of?

Yeah, a few times I went back and forth before settling on what's in the notebook. Here's roughly how that went
the enhancement step, I thought about running two or three rounds of self-correction instead of just one basically having the model critique its own critic but I held off. Partly scope, partly because what I actually saw (the enhanced summary scoring worse than the original on a couple of metrics) made me suspicious that more rounds would just compound that problem rather than fix it. That's actually the approach I'd want to try next if I kept going: instead of one enhancement pass, average several samples at each stage and only keep a revision if it wins on a majority of metrics, rather than trusting a single before/after comparison.

Were there any challenges? If so, what issue(s) did you face? How did you overcome it?

Yes , env setup was a challenge and first assignment submission was also challenge .

How were these changes tested?

In jupyternotebook

A reference to a related issue in your repository (if applicable)

Checklist

• I can confirm that my changes are working as intended