Skip to content

install.py should recommend different settings for minimal memory instances, if possible #483

Open

Description

@mmguero

@mmguero cloned issue idaholab/Malcolm#85 on 2022-03-28:

Moved from #204 by @RafnexJr.

When following the default recommendation of the memory allocation the setup script provides and the system has no swap configured Opensearch repeatedly crashed because it can't allocate enough memory. Problems occured when the server has below 12 GB memory and now swap configured, it happend on Ubuntu, Debian and OpenSUSE.

To reproduce

Steps to reproduce the behavior:

  • Server with 8GB memory and no swap

  • Install according to documentation

  • Start Malcolm with the script

Expected behavior

The script should recommend less memory for Opensearch and Logstash when the system has below 12 GB memory and no swap.

Any helpful log output or screenshots

The following output is shown (not exactly copied)

OpenSearch exited with code 137

Activity

  1. added
    install.pyRelating to the install.py configuration script
    opensearchRelating to Malcolm's use of OpenSearch
    performanceRelated to speed/performance
    on Nov 5, 2024
  2. jjrush commented on Oct 18, 2025

    @jjrush
    Contributor

    Can probably investigate this as part of the installer overhaul. Should be pretty simple to integrate given how modular the new ConfigItem approach is.

  3. added 2 commits that reference this issue on Aug 19, 2026
    badd176
    f94e514
  4. mmguero commented on Oct 12, 2026

    @mmguero
    CollaboratorAuthor

    After looking at this again (and at #1188, which tried lowering the OpenSearch and Logstash heap defaults below 12 GB), I don't think smaller heaps are the right fix. Malcolm's full stack doesn't run reliably on a host this small no matter how the heaps are split. Lowering them mostly turns an obvious failure (OpenSearch exiting with code 137) into an unstable system that's harder to diagnose.

    I think a better plan is to handle this in the installer:

    • Detect when the host has less memory than Malcolm's documented minimum (and possibly detect and flag it more strongly when no swap is configured)
    • Warn clearly before any configuration is written that the system is undersized and services are likely to be killed or unstable.
    • Possibly point out which optional services (NetBox, file extraction and scanning, etc.) could be disabled for a test or evaluation system, while being clear that it isn't a supported configuration.

    Leaving this open to track that work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    install.pyRelating to the install.py configuration scriptopensearchRelating to Malcolm's use of OpenSearchperformanceRelated to speed/performance

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    • Status
      No status

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions