Skip to content

Create ubuntu18.04Python #34

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
nadroj94 wants to merge 1 commit into from
Closed

Create ubuntu18.04Python #34

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
40 changes: 40 additions & 0 deletions experimental/ubuntu/Databricks Runtime 7/ubuntu18.04Python
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,40 @@
FROM ubuntu:18.04 as builder

RUN apt-get update && apt-get install --yes \
wget \
libdigest-sha-perl \
bzip2 \
strace

# Download miniconda 4.5.12, then upgrade it to 4.6.12.
RUN wget --quiet --output-document miniconda.sh https://repo.continuum.io/miniconda/Miniconda3-4.5.12-Linux-x86_64.sh \
&& (echo '866ae9dff53ad0874e1d1a60b1ad1ef8 miniconda.sh' | md5sum -c) \
&& (echo 'e5e5b4cd2a918e0e96b395534222773f7241dc59d776db1b9f7fedfcb489157a miniconda.sh' | shasum -a 256 -c) \
# Conda must be installed at /databricks/conda
&& /bin/bash miniconda.sh -b -p /databricks/conda \
&& rm miniconda.sh \
&& /databricks/conda/bin/conda install --name base conda=4.6.12

#This image required an update to start with the base of 18.04 created from containers/ubuntu/minimal this is attached as another dockerfile ubuntu18.04-minimal
#Example from previous build: FROM databricksruntime/minimal:latest
FROM nadroj09/test_jordan:minimal
Copy link
Copy Markdown

@houqp houqp Sep 15, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why is this base image hosted under your personal namespace?

Copy link
Copy Markdown

@bfung bfung Sep 16, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like this PR is blocked/depends on PR #35 to create the databricksruntime/minimal:latest image, and the personal namespace is a placeholder for that.

Copy link
Copy Markdown
Contributor Author

@nadroj94 nadroj94 Nov 22, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Correct, you need to update the databricksruntime/minimal:latest prior to creating this Dockerfile based on the reference.


COPY --from=builder /databricks/conda /databricks/conda

#The env.yml required updating to include the requiired upgrades in libraries with DBR 7 this is included in the file dbr7_env.yml
COPY env.yml /databricks/.conda-env-def/env.yml

RUN /databricks/conda/bin/conda env create --file /databricks/.conda-env-def/env.yml \
# Source conda.sh for all login shells.
&& ln -s /databricks/conda/etc/profile.d/conda.sh /etc/profile.d/conda.sh

# Conda recommends using strict channel priority speed up conda operations and reduce package incompatibility problems.
# Set always_yes to avoid needing -y flags, and improve conda experience in Databricks notebooks.
RUN /databricks/conda/bin/conda config --system --set channel_priority strict \
&& /databricks/conda/bin/conda config --system --set always_yes True

# This environment variable must be set to indicate the conda environment to activate.
# Note that currently, we have to set both of these environment variables. The first one is necessary to indicate that this runtime supports conda.
# The second one is necessary so that the python notebook/repl can be started (won't work without it)
ENV DEFAULT_DATABRICKS_ROOT_CONDA_ENV=dcs-minimal
ENV DATABRICKS_ROOT_CONDA_ENV=dcs-minimal