Skip to content

Use manylinux2010 image to build linux python wheels - #1282

Merged
Raymond Yang (raymondxyang) merged 10 commits into
microsoft:masterfrom
mayeut:manylinux2010
Jun 27, 2019
Merged

Use manylinux2010 image to build linux python wheels#1282
Raymond Yang (raymondxyang) merged 10 commits into
microsoft:masterfrom
mayeut:manylinux2010

Conversation

@mayeut

Copy link
Copy Markdown
Contributor

Description: Use manylinux2010 docker image to build linux python wheels.

Motivation and Context

  • Why is this change required? What problem does it solve?
    Before this change, linux wheels were built on Ubuntu 16.04 and were renamed manylinux1 wheels in order to be uploaded to PyPI. However, they do not respect the manylinux1 policy and the result is that pip install onnxruntime install those none compliant packages on system that don't support them. Building on manylinux2010 docker image allow wheels built to truly be compliant with a manylinux policy in order to provide onnxruntime to a wider audience.
  • If it fixes an open issue, please link to the issue here.
    This fixes Need CentOS support #1001

@mayeut
Matthieu Darbois (mayeut) requested a review from a team as a code owner June 23, 2019 14:29
@mayeut

Copy link
Copy Markdown
Contributor Author

Probably also fixes #1113

@snnn

Copy link
Copy Markdown
Contributor

/azp run

Comment thread tools/ci_build/github/linux/docker/scripts/install_manylinux2010.sh Outdated
@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 22 pipeline(s).

Comment thread tools/ci_build/github/linux/docker/scripts/install_manylinux2010.sh Outdated
Comment thread tools/ci_build/github/linux/docker/scripts/install_deps.sh Outdated
Comment thread tools/ci_build/github/linux/docker/Dockerfile.manylinux2010_gpu Outdated
Comment thread setup.py Outdated
@raymondxyang

Copy link
Copy Markdown

Thanks for the work! The manylinux2010 and auditwheel really helps our distribution. I queued it in release pipeline for validation.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks the changes in cmake is breaking the Windows build. I'll take a look tomorrow

@mayeut

Copy link
Copy Markdown
Contributor Author

I pushed a new commit reverting a change introduced in cmake/CMakeLists.txt. It should solve the windows issue.

@raymondxyang

Raymond Yang (raymondxyang) commented Jun 26, 2019

Copy link
Copy Markdown

I'll unblock the Windows failure tomorrow (some build environment related issue). Sorry for the delay..

@raymondxyang

Copy link
Copy Markdown

Hi Matthieu Darbois (@mayeut) could you pull ziya/update-cuda branch to unblock the windows build? I already altered the VMs for cuda 10.

@raymondxyang

Copy link
Copy Markdown

For the Linux fail on mnist model, it's a known flaky case (we are looking into it) and we will check in your PR first.

Raymond Yang and others added 2 commits June 26, 2019 11:37
Allow wheels built to truly be compliant with a manylinux policy
@mayeut

Copy link
Copy Markdown
Contributor Author

Hi Matthieu Darbois (@mayeut) could you pull ziya/update-cuda branch to unblock the windows build? I already altered the VMs for cuda 10.

Raymond Yang (@raymondxyang), done

@raymondxyang

Copy link
Copy Markdown

/azp run

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 22 pipeline(s).

@raymondxyang
Raymond Yang (raymondxyang) merged commit 04d5819 into microsoft:master Jun 27, 2019
@raymondxyang

Copy link
Copy Markdown

Thanks for the contribution :)))

Comment thread cmake/onnxruntime_python.cmake
Comment thread cmake/onnxruntime_common.cmake
ln -s python /opt/onnxruntime-python/bin/python${PYTHON_VER}
fi
python -m pip install --upgrade --force-reinstall pip==19.1.1
python -m pip install --upgrade --force-reinstall numpy==1.16.3

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This line must be fixed. Raymond Yang (@raymondxyang)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Need CentOS support

3 participants