This repository was archived by the owner on Jun 5, 2025. It is now read-only.
Repository navigation
This repository was archived by the owner on Jun 5, 2025. It is now read-only.
[Task]: Refactor the FIM tests for all providers to be more deterministic #854
Description
Activity
- added a parent issue
on Jan 30, 2025 With the recent changes I think we are stable enough for now. If this changes, we'll adjust accordingly 👍
Description
This is motivated by the fact that we are running a simpler model for the integration tests (0.5B). This sometimes results in responses which are not what we expect in the integration tests for FIM and so it fails the tests.
Instead of asking it to generate functions or code, we should refactor the tests to something simpler, i.e. "hello..." -> "hello world"
Additional Context
No response