Skip to content

[SPARK-54148][INFRA] Add libwebp-dev to all dev/spark-test-image/*/Dockerfile - #52846

Closed
dongjoon-hyun wants to merge 1 commit into
apache:masterfrom
dongjoon-hyun:SPARK-54148
Closed

dongjoon-hyun wants to merge 1 commit into
apache:masterfrom
dongjoon-hyun:SPARK-54148

Conversation

@dongjoon-hyun

@dongjoon-hyun dongjoon-hyun commented Nov 3, 2025 •

Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

This PR aims to add libwebp-dev to all dev/spark-test-image/*/Dockerfile.

Why are the changes needed?

Like we hit this issue before, this happens at all related docker images.

I checked dev directory.

To put it simply consistent with spark-rm/Dockerfile behavior, we need this additionally 13 places because libwebp-dev is used only 3 times while libtiff5-dev is used 16 times.

$ git grep libtiff5-dev dev | wc -l
      16

$ git grep libwebp-dev dev | wc -l
       3

Does this PR introduce any user-facing change?

No behavior change.

How was this patch tested?

Manual review.

Was this patch authored or co-authored using generative AI tooling?

No.

@github-actions github-actions Bot added the BUILD label Nov 3, 2025
@dongjoon-hyun

Copy link
Copy Markdown
Member Author

Could you review this PR, @LuciferYang ?

@dongjoon-hyun

Copy link
Copy Markdown
Member Author

Thank you, @LuciferYang . Let me merge this to stabilize branch-4.1.

dongjoon-hyun added a commit that referenced this pull request Nov 3, 2025
…/Dockerfile`

### What changes were proposed in this pull request?

This PR aims to add `libwebp-dev` to all `dev/spark-test-image/*/Dockerfile`.

### Why are the changes needed?

Like we hit this issue before, this happens at all related docker images.
- #52290
- #52838

I checked `dev` directory.
- https://github.com/apache/spark/tree/branch-4.1/dev

To put it simply consistent with `spark-rm/Dockerfile` behavior, we need this additionally 13 places because `libwebp-dev` is used only 3 times while `libtiff5-dev` is used 16 times.

```
$ git grep libtiff5-dev dev | wc -l
      16

$ git grep libwebp-dev dev | wc -l
       3
```

### Does this PR introduce _any_ user-facing change?

No behavior change.

### How was this patch tested?

Manual review.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #52846 from dongjoon-hyun/SPARK-54148.

Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
(cherry picked from commit f5bd5d0)
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
@dongjoon-hyun
dongjoon-hyun deleted the SPARK-54148 branch November 3, 2025 05:05
huangxiaopingRD pushed a commit to huangxiaopingRD/spark that referenced this pull request Nov 25, 2025
…/Dockerfile`

### What changes were proposed in this pull request?

This PR aims to add `libwebp-dev` to all `dev/spark-test-image/*/Dockerfile`.

### Why are the changes needed?

Like we hit this issue before, this happens at all related docker images.
- apache#52290
- apache#52838

I checked `dev` directory.
- https://github.com/apache/spark/tree/branch-4.1/dev

To put it simply consistent with `spark-rm/Dockerfile` behavior, we need this additionally 13 places because `libwebp-dev` is used only 3 times while `libtiff5-dev` is used 16 times.

```
$ git grep libtiff5-dev dev | wc -l
      16

$ git grep libwebp-dev dev | wc -l
       3
```

### Does this PR introduce _any_ user-facing change?

No behavior change.

### How was this patch tested?

Manual review.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes apache#52846 from dongjoon-hyun/SPARK-54148.

Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
dongjoon-hyun added a commit that referenced this pull request Mar 17, 2026
…/Dockerfile`

This PR aims to add `libwebp-dev` to all `dev/spark-test-image/*/Dockerfile`.

Like we hit this issue before, this happens at all related docker images.
- #52290
- #52838

I checked `dev` directory.
- https://github.com/apache/spark/tree/branch-4.1/dev

To put it simply consistent with `spark-rm/Dockerfile` behavior, we need this additionally 13 places because `libwebp-dev` is used only 3 times while `libtiff5-dev` is used 16 times.

```
$ git grep libtiff5-dev dev | wc -l
      16

$ git grep libwebp-dev dev | wc -l
       3
```

No behavior change.

Manual review.

No.

Closes #52846 from dongjoon-hyun/SPARK-54148.

Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
(cherry picked from commit f5bd5d0)
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
(cherry picked from commit d29af13)
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
@dongjoon-hyun

Copy link
Copy Markdown
Member Author

Since this happens in branch-4.0 too Today, I backported this to branch-4.0.

#9 570.6 <stdin>:1:10: fatal error: ft2build.h: No such file or directory
#9 570.6 compilation terminated.
#9 570.6 --------------------------------------------------------------------
#9 570.6 ERROR: configuration failed for package 'ragg'

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants