Skip to content

enable sse4.1 optimizations for gemmlowp - #1529

Merged
Ashwini Khade (askhade) merged 1 commit into
masterfrom
askhade/update_compileflags_gemmlowp
Aug 1, 2019
Merged

enable sse4.1 optimizations for gemmlowp#1529
Ashwini Khade (askhade) merged 1 commit into
masterfrom
askhade/update_compileflags_gemmlowp

Conversation

@askhade

Copy link
Copy Markdown
Contributor

Description: Enable sse4.1 optimizations for gemmlowp

Motivation and Context
For x86 platforms it is important to pass this flag to compiler. Without this gemmlowp will use slow reference code.

@askhade
Ashwini Khade (askhade) requested a review from a team as a code owner July 31, 2019 21:32
Comment thread cmake/onnxruntime_providers.cmake
# For x86 platforms it is important to pass this flag to compiler. Without this gemmlowp will use slow reference code.
# These optimizations are not enabled on MSVC so excluding it.
message("enabling optimizations for gemmlowp")
set_source_files_properties("${ONNXRUNTIME_ROOT}/core/providers/cpu/math/matmul_integer.cc" PROPERTIES COMPILE_FLAGS "-msse4.1")

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

wondering if you tried the gemmlowp avx2 path, does that make a measurable difference?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes I tried that ... it does not

@askhade
Ashwini Khade (askhade) merged commit b599360 into master Aug 1, 2019
@yuslepukhin
Dmitri Smirnov (yuslepukhin) deleted the askhade/update_compileflags_gemmlowp branch August 6, 2019 17:02
Dmitri Smirnov (yuslepukhin) pushed a commit that referenced this pull request Mar 17, 2026
## Describe your changes

- Migrate pipeline linux test to docker image.
- Skip failed tests for further investigation. Potential fail reasons:
  - python 3.10
  - onnxruntime 1.20
  - docker in docker


## Checklist before requesting a review
- [ ] Add unit tests for this change.
- [ ] Make sure all tests can pass.
- [ ] Update documents if necessary.
- [ ] Lint and apply fixes to your code by running `lintrunner -a`
- [ ] Is this a user-facing change? If yes, give a description of this
change to be included in the release notes.
- [ ] Is this PR including examples changes? If yes, please remember to
update [example
documentation](https://github.com/microsoft/Olive/blob/main/docs/source/examples.md)
in a follow-up PR.

## (Optional) Issue link
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants