[Feature][cicd] Produce complete cicd domain data in plugins with cicd domain

[leric]

Search before asking

• I had searched in the issues and found no similar feature requirement.

Use case

As a Devops engineer, I want to collect data from a CICD data source (e.g. Jenkins), and use the collected CICD domain data in reports. Currently the CICD domain data collected by Jenkins plugin is incomplete,

Description

There's 6 tables in CICD domain, only 4 of them (cicd_scopes, cicd_pipelines, cicd_tasks, cicd_pipeline_commits) are populated in CICD data source plugins, another 2 tables (cicd_deployments, cicd_deployment_commits) are not handled in data source plugin, but in Dora plugin.
And this behavior is not consistant among CICD data source plugins, Jenkins and CircleCI didn't handle cicd_deployments and cicd_deployment_commits, but other CICD plugins (github，gitlab，bitbucket，bamboo) did.
The CICD data convertion and enrichment logic is implemented in Dora plugin, and the Dora plugin only process data scopes wraped in Projects, but the logic involving cicd_deployment and cicd_deployment_commits doesn't require any cross domain data, all it need is the other 4 cicd tables, so it can be done in CICD data source plugins.
I thinks it's better to get the job done in CICD data source plugins, rather than require an extra step to complete the data processing in another plugin.

Related issues

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[leric]

After some discussion, now I understand that all cicd data source plugin did the same incomplete job, they all need another task to normalize deployment data. Take bamboo for example, deployment build already exist in bamboo, and deploy build is collected to cicd_deployments, it still possible for user to use bamboo build to do deploy, and need to mark these build pipeline as deployment, so even bamboo plugin collected deployment data, it still need another task to do this pipeline to deployment convertion.
This issue will be addressed in another way in this new feature request issue #6975