Skip to content

[Known Build Error] iOS UITest screenshot baseline mismatches after ACES pool migration #33879

@PureWeen

Description

@PureWeen

Build Information

Build: https://dev.azure.com/dnceng-public/public/_build/results?buildId=1276073
Leg Name: iOS UITests Mono (v18.4)

Description

iOS screenshot-based UITests are failing after the migration to ACES agent pools (PR #33790). The new macOS 26 (Tahoe) environment renders slightly differently than the previous macOS 15 (Sequoia), causing screenshot comparison failures.

Root Cause: PR #33790 switched CI from MAUI pool to AcesShared pool with different macOS version.

Partially Fixed: PR #33910 updated baselines and added cropBottom/Assert.Ignore for the original 14 tests. The 4 tests below were not covered by that PR and are still failing.

Affected Tests

  • ContentPage_Title_WithBackgroundColor
  • VerifyClearButtonVisiblityWhenTextAlignedVertically
  • VerifyClearButtonVisiblityWhenTextPresentOrEmpty
  • VerifyClearVisiblityButtonWhenTextColorChanged

Error Message

{
  "ErrorPattern": "Snapshot different than baseline: (ContentPage_Title_WithBackgroundColor|VerifyClearButtonVisiblityWhenTextAlignedVertically|VerifyClearButtonVisiblityWhenTextPresentOrEmpty|VerifyClearVisiblityButtonWhenTextColorChanged)\\.png",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=1276073
Error message validated: [Snapshot different than baseline: (ContentPage_Title_WithBackgroundColor|VerifyClearButtonVisiblityWhenTextAlignedVertically|VerifyClearButtonVisiblityWhenTextPresentOrEmpty|VerifyClearVisiblityButtonWhenTextColorChanged)\.png]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 2/9/2026 9:25:22 PM UTC

Report

Build Repository Test Pull Request
3000537 dotnet-maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor
1464606 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearButtonVisiblityWhenTextAlignedVertically #35898
1464366 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearButtonVisiblityWhenTextAlignedVertically
2999170 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1462100 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearButtonVisiblityWhenTextAlignedVertically
1461936 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearButtonVisiblityWhenTextAlignedVertically #35716
2998980 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1461650 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(Mac).VerifyClearButtonVisiblityWhenTextAlignedVertically
2998833 dotnet-maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor
1461187 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearButtonVisiblityWhenTextAlignedVertically
1461034 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearButtonVisiblityWhenTextAlignedVertically #35762
1461287 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearButtonVisiblityWhenTextAlignedVertically #35716
2998115 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
2997946 dotnet-maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor
2996913 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1457243 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearButtonVisiblityWhenTextAlignedVertically #35762
1455464 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearButtonVisiblityWhenTextAlignedVertically #35762
2995332 dotnet-maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor
1454320 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearButtonVisiblityWhenTextAlignedVertically #35762
2993279 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
2993258 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
2992977 dotnet-maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor
1450931 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearButtonVisiblityWhenTextAlignedVertically #35762
2992237 dotnet-maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor
1449357 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearButtonVisiblityWhenTextAlignedVertically #35762
2991453 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
2990578 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
2990403 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
2990517 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
2989385 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1440405 dotnet/maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(Android).ContentPage_Title_WithBackgroundColor #35463
1438626 dotnet/maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(Android).ContentPage_Title_WithBackgroundColor #35463
2982050 dotnet-maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor
2981849 dotnet-maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor
2981132 dotnet-maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor
2979787 dotnet-maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor
2979449 dotnet-maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor
2979158 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
2978899 dotnet-maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor
2978769 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
2977978 dotnet-maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
3 18 41

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions