Skip to content

fix(judge): import canonicalize_producer_identity from its new module - #1711

Merged
Yunnglin merged 1 commit into
modelscope:mainfrom
ChenCJ-io:fix/judge-mixin-identity-import
Sep 8, 2026
Merged

Yunnglin merged 1 commit into
modelscope:mainfrom
ChenCJ-io:fix/judge-mixin-identity-import

Conversation

@ChenCJ-io

Copy link
Copy Markdown
Contributor

Problem

import evalscope fails on main:

File "evalscope/api/mixin/llm_judge_mixin.py", line 11, in <module>
    from evalscope.metrics.semantics.identity import canonicalize_producer_identity
ModuleNotFoundError: No module named 'evalscope.metrics.semantics.identity'

#1705 moved canonicalize_producer_identity into evalscope/metrics/semantics/naming.py and removed identity.py. #1702 merged afterwards and still imports the old path, so every entry point that touches the benchmark registry is unusable on c31f0f9.

CI Tests Lite is red on main for this reason, and every open PR inherits the failure.

Change

One line: import canonicalize_producer_identity from evalscope.metrics.semantics.naming, where #1705 put it.

Testing

python -c "import evalscope"                 ok (fails on main)
tests/api/judge                              27 passed, 3 pre-existing failures
                                             (test_migrated_adapters arena_hard: `sklearn` not installed)
tests/metrics/test_judge_prompt_rendering.py 4 passed
tests/agent                                  336 passed, 21 skipped, same 7 pre-existing failures
                                             (test_sandbox_service, test_strategy_parsers: optional deps)

modelscope#1705 moved canonicalize_producer_identity from
evalscope.metrics.semantics.identity to evalscope.metrics.semantics.naming;
modelscope#1702 merged afterwards still imports the old path, so `import evalscope`
fails on main and CI Tests Lite is red on c31f0f9.
@Yunnglin
Yunnglin merged commit 50483be into modelscope:main Sep 8, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants