huge end-to-end latency (observed when using viser-based live pose preview)

[jiwenc-nv]

Describe the bug

tracker-latency.mp4

To reproduce
Steps to reproduce the behavior:

1. cd examples/mcap_record_replay/python
2. python live_hand.py

https://github.com/NVIDIA/IsaacTeleop/blob/main/examples/mcap_record_replay/python/live_hand.py

Expected behavior
Minimum latency (up to 100ms)

Observed behavior
1~2 seconds of latency

Screenshots
If applicable, add screenshots to help explain your problem.

Platforms

• Isaac Teleop Version: [e.g. 1.0.23]
• OS: [e.g. Ubuntu X86, ARM64]
• Integrations: [e.g. Isaac Lab, Isaac Sim, ROS2]
• XR Device: [e.g. Quest 3, Pico 4 Ultra]
• Additional Devices [e.g. Manus]

Additional context
Add any other context about the problem here.