GitLab root cause analysis (SSI)

[robertomonteromiguel]

Motivation

Changes

Workflow

1. ⚠️ Create your PR as draft ⚠️
2. Work on you PR until the CI passes
3. Mark it as ready for review
   • Test logic is modified? -> Get a review from RFC owner.
   • Framework is modified, or non obvious usage of it -> get a review from R&P team

🚀 Once your PR is reviewed and the CI green, you can merge it!

🛟 #apm-shared-testing 🛟

Reviewer checklist

• Anything but tests/ or manifests/ is modified ? I have the approval from R&P team
• A docker base image is modified?
  • the relevant build-XXX-image label is present
• A scenario is added, removed or renamed?
  • Get a review from R&P team

[github-actions]

CODEOWNERS have been resolved as:

utils/scripts/ci_root_cause_analysis.sh                                 @DataDog/system-tests-core
.gitlab-ci.yml                                                          @DataDog/system-tests-core

[datadog-datadog-prod-us1]

 

✨ Fix all issues with BitsAI

⚠️ Warnings

🚦 8 Pipeline jobs failed

Testing the test | System Tests (golang, prod) / parametric / parametric (1)     

See error

AssertionError: Expected 1 bucket containing the stats, but found 2 buckets instead in test 'test_successes_errors_recorded_separately_TS006'.

🧪 1 Test failed

tests.parametric.test_library_tracestats.Test_Library_Tracestats.test_successes_errors_recorded_separately_TS006[agent_env0-library_env0, parametric-golang] from system_tests_suite   (Fix with Cursor)

AssertionError: There should be one bucket containing the stats
assert 2 == 1
 +  where 2 = len([{'Duration': 10000000000, 'Start': 1780474850000000000, 'Stats': [{'Duration': 2206242, 'ErrorSummary': store: {}}, m...key:0, offset:0, zero_count: 0.0, count: 1.0, sum: 0.0, min: inf, max: -inf, 'Errors': 1, 'GRPCStatusCode': '', ...}]}])

self = <tests.parametric.test_library_tracestats.Test_Library_Tracestats object at 0x7fd3f171cfe0>
test_agent = <utils.docker_fixtures._test_agent.TestAgentAPI object at 0x7fd3bcf04b60>
test_library = <utils.docker_fixtures._test_clients._test_client_parametric.ParametricTestClientApi object at 0x7fd3bca51580>

    @enable_tracestats()
    @enable_agent_version()
...

Testing the test | System Tests (java, dev) / End-to-end #1 / play 1     

See error

1 failed test. ValueError: No span validates this test in tests/integrations/test_inferred_proxy.py:460.

🧪 1 Test failed

tests.integrations.test_inferred_proxy.Test_AWS_API_Gateway_Inferred_Span_Creation_v2.test_api_gateway_inferred_span_creation_with_distributed_context[play] from system_tests_suite   (Fix with Cursor)

ValueError: No span validates this test

self = <tests.integrations.test_inferred_proxy.Test_AWS_API_Gateway_Inferred_Span_Creation_v2 object at 0x7fd65481d2e0>

    def test_api_gateway_inferred_span_creation_with_distributed_context(self):
        assert self.r.text == "ok"
    
>       interfaces.library.validate_one_span(
            self.r,
            validator=mandatory_tags_validator_factory(
...

Testing the test | System Tests (java, prod) / End-to-end #1 / spring-boot 1     

See error

AssertionError: Request failed: None. Expected status code 200 but got None at tests/ffe/test_dynamic_evaluation.py:237.

🧪 1 Test failed

tests.ffe.test_dynamic_evaluation.Test_FFE_Flag_Parse_Error_Isolation.test_malformed_flag_returns_default[spring-boot] from system_tests_suite   (Fix with Cursor)

AssertionError: Request failed: None
assert None == 200
 +  where None = HttpResponse(status_code:None, headers:{}, text:None).status_code
 +    where HttpResponse(status_code:None, headers:{}, text:None) = <tests.ffe.test_dynamic_evaluation.Test_FFE_Flag_Parse_Error_Isolation object at 0x7f2c6d7118e0>.r_malformed

self = <tests.ffe.test_dynamic_evaluation.Test_FFE_Flag_Parse_Error_Isolation object at 0x7f2c6d7118e0>

    def test_malformed_flag_returns_default(self):
>       assert self.r_malformed.status_code == 200, f"Request failed: {self.r_malformed.text}"
E       AssertionError: Request failed: None
...

View all 8 failed jobs.

ℹ️ Info

No other issues found (see more)

❄️ No new flaky tests detected

Useful? React with 👍 / 👎

_{This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 30c1a8c | Docs | Datadog PR Page | Give us feedback!}