Action for building docker images automatically

[j143]

Tasks

• 1. Run nightly build as cron job
• 2. run test build for each commit
• 3. version build for release version

How to Review?

Published artifact at https://hub.docker.com/r/return01/test-ghactions-systemds

Usage test:

janardhan@cloudshell:~ (ai-experiments-001)$ docker run -it --rm return01/test-ghactions-systemds
Hello from SystemDS
SystemDS Statistics:
Total execution time:           0.020 sec.

---

Secrets: DOCKERHUB_USER and DOCKERHUB_TOKEN
These two variables are already set by INFRA. No need to set from our end.

https://issues.apache.org/jira/browse/INFRA-22430

[Baunsgaard]

I think we can split the images a bit and reduce builds.

1. Build max once a day.
2. Only build the test image if we change R dependencies or the pom.xml
3. Only build the other images if there is changes in src.

Thanks for the help!

[Baunsgaard]

QEMU is for ?

[j143]

It is an add-on, incase we want to build multi arch images. Optional though!

https://github.com/docker/buildx/#building-multi-platform-images

usage

$ docker buildx build --platform linux/amd64,linux/arm64 .

I do not have a about whether we need this. Perhaps, federated feature
might need this (I do not have good understanding yet).

[Baunsgaard]

hmm, then for now lets not include it if it is not needed

[Baunsgaard]

you cannot just comment out a line in this multi-line instruction, then everything after it does not execute.

[j143]

Suggested change

	# rm -r docker && \
	rm -r docker && \

[Baunsgaard]

Not sure what you mean?
just for information the reason why i have this line is to remove the docker folder from the internal copied systemds repository, it does not make a difference for the building of the docker image except it makes the end result slightly smaller.

so therefore, don't out comment it :)

[Baunsgaard]

i'm all for running it but don't remove the copy, so that the only change you make it to add the RUN line.

[j143]

I am having error with running COPY

[j143]

This one

[Baunsgaard]

this is happening because of your out commented line mentioned above.

[Baunsgaard]

this one:

# rm -r docker && \

[Baunsgaard]

I think it is fine if we just add the on commit part of the docker for now,
If it is still working, we should start merging it in.

[Baunsgaard]

@j143
Is the only thing missing not just a Infra ticket to add keys to push the images?

[j143]

Is the only thing missing not just a Infra ticket to add keys to push the images?

There are already secrets available.

the problem seems to be COPY docker/mountFolder/main.dml /input/main.dml statement in the Dockerfile. Let me give a couple of hours to it. :)

#9 [4/4] COPY docker/mountFolder/main.dml /input/main.dml
#9 ERROR: failed to walk /tmp/buildkit-mount645512887/docker/mountFolder: lstat /tmp/buildkit-mount645512887/docker/mountFolder: no such file or directory