• Intel caught cheating on benchmarks

    Home » Forums » AskWoody support » PC hardware » PC hardware-General Questions » Intel caught cheating on benchmarks

    Author
    Topic
    #2640358

    Targeted Intel oneAPI DPC++ Compiler Optimization Rules Out 2k+ SPEC CPU Submissions

    SPEC has effectively invalidated more than two thousand SPEC CPU 2017 benchmark submissions after it was discovered the Intel oneAPI DPC++ compiler was effectively “cheating” per their standards with a targeted optimization…

    “SPEC has ruled that the compiler used for this result was performing a compilation that specifically improves the performance of the 523.xalancbmk_r / 623.xalancbmk_s benchmarks using a priori knowledge of the SPEC code and dataset to perform a transformation that has narrow applicability.

    In order to encourage optimizations that have wide applicability (see rule 1.4 https://www.spec.org/cpu2017/Docs/runrules.html#rule_1.4), SPEC will no longer publish results using this optimization.

    This result is left in the SPEC results database for historical reference.”..

    1 user thanked author for this post.
    Reply To: Intel caught cheating on benchmarks

    You can use BBCodes to format your content.
    Your account can't use all available BBCodes, they will be stripped before saving.

    Your information: