Skip to content

Large memory test fails on outerloop #24139

Closed
#131280
Closed
Large memory test fails on outerloop#24139
#131280
Labels
area-System.Memorydisabled-testThe test is disabled in source code against the issuein-prThere is an active PR which will close this issue when it is mergedtest-bugProblem in test source code (most likely)
Milestone
Future

Description

@Drawaes
Drawaes
opened on Nov 14, 2017

/cc @atsushikan

ref dotnet/corefx#24497

From System.Memory.Tests

Suspected test : (thanks @benaadams ) At a guess... would be the ParserTests.2gbOverflow which needs 4 * 2BG > 8 GB to run

Executed on dw7opv3vs0003HH
2017-11-14 20:31:24,865: INFO: scriptrunner(33): _main: BuildTools Helix Script Runner v0.1 starting
2017-11-14 20:31:24,865: INFO: helix_test_execution(24): __init__: Copying execution payload files from C:\dotnetbuild\work\0f6bf7e2-4ce4-4832-b62e-da821b97c51b\Work\4b5eacd6-b225-4ea9-a5f7-441d3c2eba3b\Unzip to C:\dotnetbuild\work\0f6bf7e2-4ce4-4832-b62e-da821b97c51b\Work\4b5eacd6-b225-4ea9-a5f7-441d3c2eba3b\Exec\execution
2017-11-14 20:31:24,865: INFO: io(27): copy_tree_to: Copying 'C:\dotnetbuild\work\0f6bf7e2-4ce4-4832-b62e-da821b97c51b\Work\4b5eacd6-b225-4ea9-a5f7-441d3c2eba3b\Unzip\RunTests.cmd' to 'C:\dotnetbuild\work\0f6bf7e2-4ce4-4832-b62e-da821b97c51b\Work\4b5eacd6-b225-4ea9-a5f7-441d3c2eba3b\Exec\execution\RunTests.cmd'
2017-11-14 20:31:24,865: INFO: io(27): copy_tree_to: Copying 'C:\dotnetbuild\work\0f6bf7e2-4ce4-4832-b62e-da821b97c51b\Work\4b5eacd6-b225-4ea9-a5f7-441d3c2eba3b\Unzip\System.Memory.Tests.dll' to 'C:\dotnetbuild\work\0f6bf7e2-4ce4-4832-b62e-da821b97c51b\Work\4b5eacd6-b225-4ea9-a5f7-441d3c2eba3b\Exec\execution\System.Memory.Tests.dll'
2017-11-14 20:31:24,865: INFO: io(27): copy_tree_to: Copying 'C:\dotnetbuild\work\0f6bf7e2-4ce4-4832-b62e-da821b97c51b\Work\4b5eacd6-b225-4ea9-a5f7-441d3c2eba3b\Unzip\System.Memory.Tests.pdb' to 'C:\dotnetbuild\work\0f6bf7e2-4ce4-4832-b62e-da821b97c51b\Work\4b5eacd6-b225-4ea9-a5f7-441d3c2eba3b\Exec\execution\System.Memory.Tests.pdb'
2017-11-14 20:31:24,880: INFO: io(27): copy_tree_to: Copying 'C:\dotnetbuild\work\0f6bf7e2-4ce4-4832-b62e-da821b97c51b\Work\4b5eacd6-b225-4ea9-a5f7-441d3c2eba3b\Unzip\xunit.console.netcore.exe' to 'C:\dotnetbuild\work\0f6bf7e2-4ce4-4832-b62e-da821b97c51b\Work\4b5eacd6-b225-4ea9-a5f7-441d3c2eba3b\Exec\execution\xunit.console.netcore.exe'
2017-11-14 20:31:24,880: INFO: io(27): copy_tree_to: Copying 'C:\dotnetbuild\work\0f6bf7e2-4ce4-4832-b62e-da821b97c51b\Work\4b5eacd6-b225-4ea9-a5f7-441d3c2eba3b\Unzip\xunit.console.netcore.runtimeconfig.json' to 'C:\dotnetbuild\work\0f6bf7e2-4ce4-4832-b62e-da821b97c51b\Work\4b5eacd6-b225-4ea9-a5f7-441d3c2eba3b\Exec\execution\xunit.console.netcore.runtimeconfig.json'
2017-11-14 20:31:24,880: INFO: proc(23): run_and_log_output: Running: C:\dotnetbuild\work\0f6bf7e2-4ce4-4832-b62e-da821b97c51b\Work\4b5eacd6-b225-4ea9-a5f7-441d3c2eba3b\Unzip\RunTests.cmd C:\dotnetbuild\work\0f6bf7e2-4ce4-4832-b62e-da821b97c51b\Payload
2017-11-14 20:31:24,880: INFO: proc(26): run_and_log_output: CWD: C:\dotnetbuild\work\0f6bf7e2-4ce4-4832-b62e-da821b97c51b\Work\4b5eacd6-b225-4ea9-a5f7-441d3c2eba3b\Unzip
2017-11-14 20:31:24,895: INFO: proc(54): run_and_log_output: Output: Using C:\dotnetbuild\work\0f6bf7e2-4ce4-4832-b62e-da821b97c51b\Payload as the test runtime folder.
2017-11-14 20:31:24,895: INFO: proc(54): run_and_log_output: Output: Executing in C:\dotnetbuild\work\0f6bf7e2-4ce4-4832-b62e-da821b97c51b\Work\4b5eacd6-b225-4ea9-a5f7-441d3c2eba3b\Unzip\ 
2017-11-14 20:31:24,895: INFO: proc(54): run_and_log_output: Output: Running tests... Start time: 20:31:24.89
2017-11-14 20:31:24,895: INFO: proc(54): run_and_log_output: Output: 
2017-11-14 20:31:24,895: INFO: proc(54): run_and_log_output: Output: C:\dotnetbuild\work\0f6bf7e2-4ce4-4832-b62e-da821b97c51b\Work\4b5eacd6-b225-4ea9-a5f7-441d3c2eba3b\Unzip>set XUNIT_PERFORMANCE_MIN_ITERATION=1 
2017-11-14 20:31:24,895: INFO: proc(54): run_and_log_output: Output: 
2017-11-14 20:31:24,895: INFO: proc(54): run_and_log_output: Output: C:\dotnetbuild\work\0f6bf7e2-4ce4-4832-b62e-da821b97c51b\Work\4b5eacd6-b225-4ea9-a5f7-441d3c2eba3b\Unzip>set XUNIT_PERFORMANCE_MAX_ITERATION=1 
2017-11-14 20:31:24,895: INFO: proc(54): run_and_log_output: Output: 
2017-11-14 20:31:24,895: INFO: proc(54): run_and_log_output: Output: C:\dotnetbuild\work\0f6bf7e2-4ce4-4832-b62e-da821b97c51b\Work\4b5eacd6-b225-4ea9-a5f7-441d3c2eba3b\Unzip>call C:\dotnetbuild\work\0f6bf7e2-4ce4-4832-b62e-da821b97c51b\Payload\dotnet.exe xunit.console.netcore.exe System.Memory.Tests.dll  -xml testResults.xml -notrait category=nonnetcoreapptests -notrait category=nonwindowstests  -notrait category=failing 
2017-11-14 20:31:24,990: INFO: proc(54): run_and_log_output: Output: xUnit.net console test runner (64-bit .NET Core)
2017-11-14 20:31:24,990: INFO: proc(54): run_and_log_output: Output: Copyright (C) 2014 Outercurve Foundation.
2017-11-14 20:31:24,990: INFO: proc(54): run_and_log_output: Output: 
2017-11-14 20:31:25,084: INFO: proc(54): run_and_log_output: Output: Discovering: System.Memory.Tests
2017-11-14 20:31:25,411: INFO: proc(54): run_and_log_output: Output: Discovered:  System.Memory.Tests
2017-11-14 20:31:25,693: INFO: proc(54): run_and_log_output: Output: Starting:    System.Memory.Tests
2017-11-14 20:31:27,661: INFO: proc(54): run_and_log_output: Output: [ParseInt32 '0',D to 0)]
2017-11-14 20:31:48,457: INFO: proc(54): run_and_log_output: Output: [ParseInt32 '2',D to 2)]
2017-11-14 20:32:06,128: INFO: proc(54): run_and_log_output: Output: [ParseInt32 '21',D to 21)]
2017-11-14 20:32:23,223: INFO: proc(54): run_and_log_output: Output: [ParseInt32 '+2',D to 2)]
2017-11-14 20:32:40,924: INFO: proc(54): run_and_log_output: Output: [ParseInt32 '-2',D to -2)]
2017-11-14 20:32:57,706: INFO: proc(54): run_and_log_output: Output: [ParseInt32 '2147483647',D to 2147483647)]
2017-11-14 20:33:14,471: INFO: proc(54): run_and_log_output: Output: [ParseInt32 '-2147483648',D to -2147483648)]
2017-11-14 20:33:31,707: INFO: proc(54): run_and_log_output: Output: [ParseInt32 '2147483648',D to (should-not-parse))]
2017-11-14 20:33:48,144: INFO: proc(54): run_and_log_output: Output: [ParseInt32 '-2147483649',D to (should-not-parse))]
2017-11-14 20:34:00,503: INFO: proc(54): run_and_log_output: Output: [ParseInt32 '12345abcdefg1',D to 12345)]
2017-11-14 20:34:11,926: INFO: proc(54): run_and_log_output: Output: [ParseInt32 '1234145abcdefg1',D to 1234145)]
2017-11-14 20:34:23,176: INFO: proc(54): run_and_log_output: Output: [ParseInt32 'abcdefghijklmnop1',D to 0)]
2017-11-14 20:34:34,815: INFO: proc(54): run_and_log_output: Output: [ParseInt32 '1147483648',D to 1147483648)]
2017-11-14 20:34:46,362: INFO: proc(54): run_and_log_output: Output: [ParseInt32 '-1147483649',D to -1147483649)]

Activity

  1. ahsonkhan
    assigned
    ghost
    on Nov 14, 2017

  3. stephentoub commented on Jan 2, 2018

    @stephentoub
    stephentoub
    on Jan 2, 2018
    Member

    is there still a reason for this to be open?

    Yes, tests are still disabled against it.

  5. benaadams commented on Jan 2, 2018

    @benaadams
    benaadams
    on Jan 2, 2018
    Member

    Can it use a MemoryMappedFile instead of allocating 8Gb of RAM? Used to give my computer a fit when it was in corefxlab and I ran it:

    image

    Can the tests potentially run in parallel so need 16Gb?

  6. benaadams commented on Jan 2, 2018

    @benaadams
    benaadams
    on Jan 2, 2018
    Member

    Everything would die on the test with nothing running after; last output when details output was on was:

    2017-11-15 15:46:24,285: INFO: proc(54): run_and_log_output: 
Output:    System.SpanTests.SpanTests.CopyToLargeSizeTest(bufferSize: 4294967296) [STARTING]

    My local experience was Windows was very unhappy working swap for a single contiguous block of memory larger than available memory. It did eventually complete after total system unresponsiveness

  7. Drawaes commented on Jan 2, 2018

    @Drawaes
    Drawaes
    on Jan 2, 2018
    ContributorAuthor

    Yeah but it also doesn't run in isolation, so it truly kills the test run.

  9. benaadams commented on Jan 2, 2018

    @benaadams
    benaadams
    on Jan 2, 2018
    Member

    Don't know; however it only pretends to be contiguous memory and files can often be far larger than RAM - so hopefully the disk cache will be more used to it than the swap with actual live allocated memory

  11. ghost added a commit that references this issue on Jan 10, 2018

    Underlying CoreCLR support for new string slicing overloads (#15811)

    da46977
  12. dotnet-bot
    added a commit that references this issue on Jan 11, 2018

    Underlying CoreCLR support for new string slicing overloads (#15811)

    91bfef2
  13. jkotas
    added a commit that references this issue on Jan 11, 2018

    Underlying CoreCLR support for new string slicing overloads (#15811)

    5a6bca6
  14. dotnet-bot
    added 2 commits that reference this issue on Jan 13, 2018

    Underlying CoreCLR support for new string slicing overloads (#15811)

    19ba65b

    Underlying CoreCLR support for new string slicing overloads (#15811)

    e50a1c6

  15. 20 remaining items

  16. dotnet-policy-service
    removed this from the Future milestone on Sep 15, 2024
  17. dotnet-policy-service
    closed this as completedon Sep 15, 2024
  18. github-actions
    locked and limited conversation to collaborators on Oct 16, 2024
  19. dotnet-policy-service
    removed
    no-recent-activity
    backlog-cleanup-candidateAn inactive issue that has been marked for automated closure.
    on Oct 16, 2024
  20. MihaZupan
    reopened this on Jan 11, 2025
  21. dotnet
    unlocked this conversation on Jan 11, 2025
  22. dotnet-policy-service
    added
    untriagedNew issue has not been triaged by the area owner
    on Jan 11, 2025

  23. MihaZupan commented on Jan 11, 2025

    @MihaZupan
    MihaZupan
    on Jan 11, 2025
    Member

    There are still tests disabled against this issue

  24. MihaZupan
    added this to the Future milestone on Jan 11, 2025
  25. jeffhandley
    removed
    untriagedNew issue has not been triaged by the area owner
    on Jan 16, 2025
  26. dotnet-policy-service
    added
    in-prThere is an active PR which will close this issue when it is merged
    on Jul 23, 2026
  27. tannergooding
    added a commit that references this issue on Jul 24, 2026

    Remove large-memory CopyTo and parser overflow tests (#131280)

    911ee58
  28. tannergooding
    closed this as completedin #131280on Jul 24, 2026
  29. hez2010
    added a commit that references this issue on Jul 26, 2026

    Remove large-memory CopyTo and parser overflow tests (dotnet#131280)

    1442814
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    area-System.Memorydisabled-testThe test is disabled in source code against the issuein-prThere is an active PR which will close this issue when it is mergedtest-bugProblem in test source code (most likely)

    Type

    No type

    Projects

    No projects

      Milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions