Skip to content

[Enhancement] Support for multiple dataset as source, sink and in prompts#72

Merged
bidyapati-p merged 14 commits intomainfrom
scratch/multi_dataset
Dec 18, 2025
Merged

[Enhancement] Support for multiple dataset as source, sink and in prompts#72
bidyapati-p merged 14 commits intomainfrom
scratch/multi_dataset

Conversation

@bidyapati-p
Copy link
Collaborator

@bidyapati-p bidyapati-p commented Dec 9, 2025

Summary
Support multiple dataset as input data source and output data sink.
Use cases like reading multiple table and work in a single task or flow, and push data into multiple dataset/tables.

Explain the features implemented:
Feature 1
Ability to configure multiple dataset with different way to merge them.
Feature 2
Ability to use the dataset key with dataset alias prefix
Feature 3
Ability to configure multiple sink.

Performance impact (if any):
This may still depend on fetching whole dataset, so always fetch partial data if working with ServiceNow tables. There will be limitations on streams for this feature.

How to Test the feature
Example task added for reference with servicenow table.

multiple_dataset

Checklist
Lint fixes and unit testing done
End to end task testing
Documentation updated
Notes
Any caveats, future considerations, or known issues.

@bidyapati-p bidyapati-p added the enhancement New feature or request label Dec 11, 2025
@bidyapati-p bidyapati-p self-assigned this Dec 11, 2025
@bidyapati-p bidyapati-p changed the title Support for multiple dataset in sygra [Enhancement] Support for multiple dataset as source, sink and in prompts Dec 11, 2025
@bidyapati-p bidyapati-p marked this pull request as ready for review December 15, 2025 04:42
@bidyapati-p bidyapati-p requested a review from a team as a code owner December 15, 2025 04:42
@bidyapati-p bidyapati-p enabled auto-merge (squash) December 17, 2025 15:42
@bidyapati-p bidyapati-p merged commit fa01cb4 into main Dec 18, 2025
3 checks passed
@bidyapati-p bidyapati-p deleted the scratch/multi_dataset branch December 18, 2025 04:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants