Skip to content

Consider adding benchmarks from "programming language and compiler benchmarks" site #2167

Description

@danmoseley

https://programming-language-benchmarks.vercel.app/csharp-vs-java

Some are versions from the familiar CLBG, but some are new and Java numbers suggest we have room for improvement.

cc @stephentoub @AndyAyersMS in case either are interested.

The above are 6.0 numbers. Note that the official CLBG maintainer has said he cannot update the numbers for a few months, so we don't have 6.0 numbers from there.

Activity

  1. AndyAyersMS commented on Dec 7, 2021

    @AndyAyersMS
    Member

    cc @kunalspathak

    Seems like are likely measuring startup as dynamic PGO is frequently slower.

  2. danmoseley commented on Dec 10, 2021

    @danmoseley
    ContributorAuthor
  3. danmoseley commented on Dec 22, 2021

    @danmoseley
    ContributorAuthor

    @joperezr @stephentoub in case you're interested, the above site has kindly added regex-redux at the link above. They used CSharp#5, the fastest one that doesn't use PCRE (which IMO is cheating).

    Eyeballing, the Rust- C# - Java ratios for these 6.0 numbers aren't that different to the 5.0 numbers still up at https://benchmarksgame-team.pages.debian.net/benchmarksgame/performance/regexredux.html

  4. stephentoub commented on Dec 22, 2021

    @stephentoub
    Member

    6.0 numbers aren't that different to the 5.0 numbers

    That's what we'd expect; there was little-to-no work done for 6.0 in anything that would meaningfully improve this benchmark. I expect they will improve in 7.0.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions