Skip to content

[Kernel] Incremental LogSegment update APIs - #5262

Merged
scottsand-db merged 3 commits into
delta-io:masterfrom
scottsand-db:stack/kernel_post_commit_snapshot_1_log_segment_extension
Oct 1, 2025
Merged

scottsand-db merged 3 commits into
delta-io:masterfrom
scottsand-db:stack/kernel_post_commit_snapshot_1_log_segment_extension

Conversation

@scottsand-db

@scottsand-db scottsand-db commented Sep 26, 2025 •

Copy link
Copy Markdown
Collaborator

🥞 Stacked PR

Use this link to review incremental changes.


Which Delta project/connector is this regarding?

  • Spark
  • Standalone
  • Flink
  • Kernel
  • Other (fill in here)

Description

This PR adds two new internal LogSegment APIs that will help us create updated LogSegments after a transaction.

This is PR 1 as part of the post-commit-snapshot effort.

For the e2e prototype that has already derisked all of this, please see #5213

How was this patch tested?

New UTs.

Does this PR introduce any user-facing changes?

No.

@scottsand-db scottsand-db changed the title done first pass w unit tests [Kernel] Incremental LogSegment update APIs Sep 26, 2025
@scottsand-db scottsand-db self-assigned this Sep 26, 2025
@scottsand-db
scottsand-db force-pushed the stack/kernel_post_commit_snapshot_1_log_segment_extension branch from 028030c to 0acdac5 Compare September 26, 2025 20:09
@scottsand-db
scottsand-db force-pushed the stack/kernel_post_commit_snapshot_1_log_segment_extension branch from 0acdac5 to 94155a8 Compare September 26, 2025 20:11
Comment thread kernel/kernel-api/src/main/java/io/delta/kernel/internal/snapshot/LogSegment.java Outdated
Comment thread kernel/kernel-api/src/main/java/io/delta/kernel/internal/snapshot/LogSegment.java Outdated
Comment thread kernel/kernel-api/src/main/java/io/delta/kernel/internal/snapshot/LogSegment.java Outdated
Comment thread kernel/kernel-api/src/main/java/io/delta/kernel/internal/snapshot/LogSegment.java Outdated
Comment thread kernel/kernel-api/src/main/java/io/delta/kernel/internal/snapshot/LogSegment.java Outdated
@scottsand-db scottsand-db mentioned this pull request Oct 1, 2025
5 tasks
@scottsand-db
scottsand-db merged commit 869779c into delta-io:master Oct 1, 2025
27 checks passed
huashi-st pushed a commit to huashi-st/delta that referenced this pull request Apr 24, 2026
## 🥞 Stacked PR
Use this [link](https://github.com/delta-io/delta/pull/5262/files) to
review incremental changes.
-
[**stack/kernel_post_commit_snapshot_1_log_segment_extension**](delta-io#5262)
[[Files changed](https://github.com/delta-io/delta/pull/5262/files)]
-
[stack/kernel_post_commit_snapshot_2_snapshot_extension](delta-io#5280)
[[Files
changed](https://github.com/delta-io/delta/pull/5280/files/94155a89873b25094372f2de53e3c9346e7e6296..4b5dd1cec83f66a4d7ae70461d9ad479b3263944)]

---------
#### Which Delta project/connector is this regarding?

- [ ] Spark
- [ ] Standalone
- [ ] Flink
- [X] Kernel
- [ ] Other (fill in here)

## Description

This PR adds two new internal LogSegment APIs that will help us create
updated LogSegments after a transaction.

This is PR 1 as part of the post-commit-snapshot effort.

For the e2e prototype that has already derisked all of this, please see
delta-io#5213

## How was this patch tested?

New UTs.

## Does this PR introduce _any_ user-facing changes?

No.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants