Search before asking
What happened
I am encountering an issue where GitHub release data is not being collected into the cicd_releases table. I'm running DevLake v20250513@a4406df and executing a pipeline that includes the "Extract Releases" and "Convert Releases" subtasks. Although the pipeline completes successfully, no records are inserted into cicd_releases.
Upon investigating the database, I found that the _raw_github_graphql_release table, which I expected to contain raw release data, does not exist. I then located a migration script in the DevLake codebase (https://github.com/apache/incubator-devlake/blob/main/backend/plugins/github_graphql/model/migrationscripts/20240808_flush_rawdata.go#L40) that explicitly drops this table.
This leads me to believe that the method for collecting GitHub release data may have changed or been deprecated. The current pipeline, despite appearing to succeed, is not populating the necessary cicd_releases table.
Pipeline Logs:
time="2025-06-26 12:49:42" level=info msg=" [pipeline service] [pipeline #354] [task #31002] executing subtask Extract Releases"
time="2025-06-26 12:49:42" level=info msg=" [pipeline service] [pipeline #354] [task #31002] subtask Extract Releases finished in 11 ms"
time="2025-06-26 12:49:42" level=info msg=" [pipeline service] [pipeline #354] [task #31002] finished step: 1 / 2"
time="2025-06-26 12:49:42" level=info msg=" [pipeline service] [pipeline #354] [task #31002] executing subtask Convert Releases"
time="2025-06-26 12:49:42" level=info msg=" [pipeline service] [pipeline #354] [task #31002] subtask Convert Releases finished in 5 ms"
time="2025-06-26 12:49:42" level=info msg=" [pipeline service] [pipeline #354] [task #31002] finished step: 2 / 2"
What do you expect to happen
I expect the pipeline to successfully collect GitHub release data and populate the cicd_releases table. If the _raw_github_graphql_release table is indeed deprecated, I need to understand the new, recommended approach for collecting GitHub release data using DevLake.
How to reproduce
- Set up Apache DevLake with a GitHub connection.
- Create a blueprint that includes the "GitHub" plugin.
- Ensure the "Extract Releases" and "Convert Releases" subtasks are enabled in your pipeline for a GitHub repository that has existing releases.
- Run the pipeline.
- After the pipeline completes, check the cicd_releases table in the DevLake database. Observe that it is empty.
- Verify that the
_raw_github_graphql_release table does not exist in the database.
Anything else
Given the migration script dropping _raw_github_graphql_release, I suspect the GitHub releases feature, as implemented via GraphQL, might have been moved to a different collection mechanism.
Version
v20250513@a4406df
Are you willing to submit PR?
Code of Conduct
Search before asking
What happened
I am encountering an issue where GitHub release data is not being collected into the
cicd_releasestable. I'm running DevLake v20250513@a4406df and executing a pipeline that includes the "Extract Releases" and "Convert Releases" subtasks. Although the pipeline completes successfully, no records are inserted into cicd_releases.Upon investigating the database, I found that the
_raw_github_graphql_releasetable, which I expected to contain raw release data, does not exist. I then located a migration script in the DevLake codebase (https://github.com/apache/incubator-devlake/blob/main/backend/plugins/github_graphql/model/migrationscripts/20240808_flush_rawdata.go#L40) that explicitly drops this table.This leads me to believe that the method for collecting GitHub release data may have changed or been deprecated. The current pipeline, despite appearing to succeed, is not populating the necessary cicd_releases table.
Pipeline Logs:
What do you expect to happen
I expect the pipeline to successfully collect GitHub release data and populate the
cicd_releasestable. If the_raw_github_graphql_releasetable is indeed deprecated, I need to understand the new, recommended approach for collecting GitHub release data using DevLake.How to reproduce
_raw_github_graphql_releasetable does not exist in the database.Anything else
Given the migration script dropping
_raw_github_graphql_release, I suspect the GitHub releases feature, as implemented via GraphQL, might have been moved to a different collection mechanism.Version
v20250513@a4406df
Are you willing to submit PR?
Code of Conduct