Token usage lost in OpenAI streaming + cached tokens #219

Is there an existing issue for this?

• I confirm that I have not found an existing or similar issue.

Problem (why)

Token usage in OpenAI streaming shouldn't lost and the cached tokens should be captured and registered in DB.

Impact (who)

This change makes the user view the token usage of streaming calls and retrieve cached tokens.

Existing

No response

Requirements (what)

No response