Skip to content

Questions on aligning scene predictions to GT scene #30

Open

Description

@nstar1125

Thanks for your amazing work!
I've been trying to replace CUT3R backbone and found out that Human3R's scene prediction aligns well with the GT depth while other metric-depth estimation like Depth-Anything 3 fails to do so. I think this alignment is critical to train SMPL's translation parameter. Is there any idea how you managed to align the scene points to the GT?

Image

Fig. 1. Initial sample from Human3R training (Grey: prediction, Green: GT)

Image

Fig. 2. DA3-metric result (Blue: prediction, Green: GT)

Activity

  1. fanegg commented on Dec 17, 2025

    @fanegg
    Owner

    Hi @nstar1125 Thank you for your interest! May I ask which test dataset used here? It looks like BEDLAM. Since CUT3R's training set includes BEDLAM, you would need to fine-tune DA3 on BEDLAM to achieve better alignment.

  2. nstar1125 commented on Dec 18, 2025

    @nstar1125
    Author

    Thanks for the quick reply! Yes this was a sample from BEDLAM dataset.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions