OpenAI chat wire throws MissingMethodException — MeshWeaver.AI.OpenAI deployed against an incompatible MeshWeaver.AI build

What is failing

Every streaming chat request through the OpenAI wire in the memex namespace fails at startup of the request with System.MissingMethodException. The MeshWeaver.AI.OpenAI assembly calls ReasoningEffortLevels.IsBuiltIn(IEnumerable<string>) from OpenAIReasoningEffortWire.Rewrite(ChatOptions), but the MeshWeaver.AI assembly actually loaded in the deployment no longer contains that method. This kills the AI thread-execution path outright — the samples show the triage agent's own threads dying on exactly this call.

Probable cause

Assembly version skew inside the deployment — high confidence. A MissingMethodException is a compile-time-vs-runtime mismatch: MeshWeaver.AI.OpenAI was built against a MeshWeaver.AI that had the IsBuiltIn(IEnumerable<string>) signature, but at runtime a different MeshWeaver.AI build is loaded (the method was renamed, re-signed, or removed). Supporting evidence in the stack traces themselves: the OpenAIReasoningEffortWire frames resolve to sources under /repo/src/MeshWeaver.AI.OpenAI/..., while the StreamStallGuardChatClient frames resolve to /home/runner/work/MeshWeaver/MeshWeaver/plugins-repo/src/MeshWeaver.AI/... — i.e. the running process is mixing assemblies built from two different source trees/CI pipelines. Either a partial/stale deployment or the plugins-repo CI published a plugin against an outdated core build.

Impact

5 occurrences in ~3 minutes (19:42–19:45 UTC, 2026-10-02) across both portal pods (memex-portal-deployment-75c8dd5c4b-…). The failure is not intermittent — every request that reaches OpenAIReasoningEffortWire.Rewrite throws, so all AI-driven thread execution in this deployment is effectively down. Incidentally self-confirmed: the incident's own triage sub-threads aborted with this exact exception before a draft could be written.

Where to look

MeshWeaver.AI.OpenAI/OpenAIReasoningEffortWire.cs — Rewrite(ChatOptions options) and GetStreamingResponseAsync (frame cites line 53).
MeshWeaver.AI — ReasoningEffortLevels: confirm whether IsBuiltIn(IEnumerable<string>) still exists, was renamed, or moved.
The deployment/CI for memex-portal-deployment-75c8dd5c4b: check whether the MeshWeaver.AI and MeshWeaver.AI.OpenAI assemblies in the image come from the same build. Aligning the two (or rolling back) should immediately clear the error.

Note: the MeshWeaver.AI / MeshWeaver.AI.OpenAI source trees were not found in this mesh partition, so the exact current signature of ReasoningEffortLevels could not be verified — the skew reading rests on the exception signature and the mixed source paths in the stack.

Evidence


Fingerprint	`a5b727b33fe90155`
Category	`MeshWeaver.AI.AgentChatClient`
Severity	Error
Exception	`System.MissingMethodException`
Top frame	`MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.Rewrite(ChatOptions options)`
Namespace	`memex`
Pods	`memex-portal-deployment-75c8dd5c4b-fm5pf`, `memex-portal-deployment-75c8dd5c4b-wgg9d`
Occurrences	7
First seen	2026-10-02 19:42:26Z
Last seen	2026-10-02 19:46:38Z
Routing	not determined — no configured route matches the category `MeshWeaver.AI.AgentChatClient`. This repository is the configured fallback, not a finding about who owns the fault; the category names the LOGGER, which may not be the subject.

Recent log lines

2026-10-02 19:42:26Z memex-portal-deployment-75c8dd5c4b-fm5pf fail: MeshWeaver.AI.AgentChatClient[0]
      [ThreadExec] ERROR: 19:42:26.020 threadPath=Hosting/Triage/_Thread/review-pull-request-systemorph-meshweave-d548
      System.MissingMethodException: Method not found: 'Boolean MeshWeaver.AI.ReasoningEffortLevels.IsBuiltIn(System.Collections.Generic.IEnumerable`1<System.String>)'.
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.Rewrite(ChatOptions options)
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken) in /repo/src/MeshWeaver.AI.OpenAI/OpenAIReasoningEffortWire.cs:line 53
         at Microsoft.Extensions.AI.DelegatingChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.<>n__0(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /repo/src/MeshWeaver.AI.OpenAI/OpenAIWireStreamGuard.cs:line 49
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
         at System.Threading.Tasks.ValueTask`1.GetTaskForValueTaskSource(IValueTaskSource`1 t)
      --- End of stack trace from previous location ---
         at MeshWeaver.AI.StreamStallGuardChatClient.Swallow(Task task) in /home/runner/work/MeshWeaver/MeshWeaver/plugins-repo/src/MeshWeaver.AI/StreamStallGuardChatClient.cs:line 221
         at MeshWeaver.AI.StreamStallGuardChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /home/runner/work/MeshWeaver/MeshWeaver/plugins…[truncated]
2026-10-02 19:43:28Z memex-portal-deployment-75c8dd5c4b-fm5pf fail: MeshWeaver.AI.AgentChatClient[0]
      [ThreadExec] ERROR: 19:43:28.516 threadPath=Hosting/Triage/_Thread/ci-is-red-on-main-of-systemorph-meshweav-b47c
      System.MissingMethodException: Method not found: 'Boolean MeshWeaver.AI.ReasoningEffortLevels.IsBuiltIn(System.Collections.Generic.IEnumerable`1<System.String>)'.
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.Rewrite(ChatOptions options)
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken) in /repo/src/MeshWeaver.AI.OpenAI/OpenAIReasoningEffortWire.cs:line 53
         at Microsoft.Extensions.AI.DelegatingChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.<>n__0(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /repo/src/MeshWeaver.AI.OpenAI/OpenAIWireStreamGuard.cs:line 49
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
         at System.Threading.Tasks.ValueTask`1.GetTaskForValueTaskSource(IValueTaskSource`1 t)
      --- End of stack trace from previous location ---
         at MeshWeaver.AI.StreamStallGuardChatClient.Swallow(Task task) in /home/runner/work/MeshWeaver/MeshWeaver/plugins-repo/src/MeshWeaver.AI/StreamStallGuardChatClient.cs:line 221
         at MeshWeaver.AI.StreamStallGuardChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /home/runner/work/MeshWeaver/MeshWeaver/plugins…[truncated]
2026-10-02 19:43:34Z memex-portal-deployment-75c8dd5c4b-wgg9d fail: MeshWeaver.AI.AgentChatClient[0]
      [ThreadExec] ERROR: 19:43:34.313 threadPath=Admin/_LogIncident/a5b727b33fe90155/_Thread/triage-the-log-incident-at-admin-loginci-a584
      System.MissingMethodException: Method not found: 'Boolean MeshWeaver.AI.ReasoningEffortLevels.IsBuiltIn(System.Collections.Generic.IEnumerable`1<System.String>)'.
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.Rewrite(ChatOptions options)
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken) in /repo/src/MeshWeaver.AI.OpenAI/OpenAIReasoningEffortWire.cs:line 53
         at Microsoft.Extensions.AI.DelegatingChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.<>n__0(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /repo/src/MeshWeaver.AI.OpenAI/OpenAIWireStreamGuard.cs:line 49
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
         at System.Threading.Tasks.ValueTask`1.GetTaskForValueTaskSource(IValueTaskSource`1 t)
      --- End of stack trace from previous location ---
         at MeshWeaver.AI.StreamStallGuardChatClient.Swallow(Task task) in /home/runner/work/MeshWeaver/MeshWeaver/plugins-repo/src/MeshWeaver.AI/StreamStallGuardChatClient.cs:line 221
         at MeshWeaver.AI.StreamStallGuardChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /home/runner/work/MeshWeav…[truncated]
2026-10-02 19:44:25Z memex-portal-deployment-75c8dd5c4b-fm5pf fail: MeshWeaver.AI.AgentChatClient[0]
      [ThreadExec] ERROR: 19:44:25.865 threadPath=Admin/_LogIncident/a5b727b33fe90155/_Thread/triage-the-log-incident-at-admin-loginci-3a5e
      System.MissingMethodException: Method not found: 'Boolean MeshWeaver.AI.ReasoningEffortLevels.IsBuiltIn(System.Collections.Generic.IEnumerable`1<System.String>)'.
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.Rewrite(ChatOptions options)
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken) in /repo/src/MeshWeaver.AI.OpenAI/OpenAIReasoningEffortWire.cs:line 53
         at Microsoft.Extensions.AI.DelegatingChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.<>n__0(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /repo/src/MeshWeaver.AI.OpenAI/OpenAIWireStreamGuard.cs:line 49
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
         at System.Threading.Tasks.ValueTask`1.GetTaskForValueTaskSource(IValueTaskSource`1 t)
      --- End of stack trace from previous location ---
         at MeshWeaver.AI.StreamStallGuardChatClient.Swallow(Task task) in /home/runner/work/MeshWeaver/MeshWeaver/plugins-repo/src/MeshWeaver.AI/StreamStallGuardChatClient.cs:line 221
         at MeshWeaver.AI.StreamStallGuardChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /home/runner/work/MeshWeav…[truncated]
2026-10-02 19:45:25Z memex-portal-deployment-75c8dd5c4b-fm5pf fail: MeshWeaver.AI.AgentChatClient[0]
      [ThreadExec] ERROR: 19:45:25.540 threadPath=Admin/_LogIncident/a5b727b33fe90155/_Thread/triage-the-log-incident-at-admin-loginci-f339
      System.MissingMethodException: Method not found: 'Boolean MeshWeaver.AI.ReasoningEffortLevels.IsBuiltIn(System.Collections.Generic.IEnumerable`1<System.String>)'.
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.Rewrite(ChatOptions options)
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken) in /repo/src/MeshWeaver.AI.OpenAI/OpenAIReasoningEffortWire.cs:line 53
         at Microsoft.Extensions.AI.DelegatingChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.<>n__0(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /repo/src/MeshWeaver.AI.OpenAI/OpenAIWireStreamGuard.cs:line 49
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
         at System.Threading.Tasks.ValueTask`1.GetTaskForValueTaskSource(IValueTaskSource`1 t)
      --- End of stack trace from previous location ---
         at MeshWeaver.AI.StreamStallGuardChatClient.Swallow(Task task) in /home/runner/work/MeshWeaver/MeshWeaver/plugins-repo/src/MeshWeaver.AI/StreamStallGuardChatClient.cs:line 221
         at MeshWeaver.AI.StreamStallGuardChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /home/runner/work/MeshWeav…[truncated]
2026-10-02 19:46:23Z memex-portal-deployment-75c8dd5c4b-fm5pf fail: MeshWeaver.AI.AgentChatClient[0]
      [ThreadExec] ERROR: 19:46:23.221 threadPath=Admin/_LogIncident/a5b727b33fe90155/_Thread/triage-the-log-incident-at-admin-loginci-5389
      System.MissingMethodException: Method not found: 'Boolean MeshWeaver.AI.ReasoningEffortLevels.IsBuiltIn(System.Collections.Generic.IEnumerable`1<System.String>)'.
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.Rewrite(ChatOptions options)
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken) in /repo/src/MeshWeaver.AI.OpenAI/OpenAIReasoningEffortWire.cs:line 53
         at Microsoft.Extensions.AI.DelegatingChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.<>n__0(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /repo/src/MeshWeaver.AI.OpenAI/OpenAIWireStreamGuard.cs:line 49
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
         at System.Threading.Tasks.ValueTask`1.GetTaskForValueTaskSource(IValueTaskSource`1 t)
      --- End of stack trace from previous location ---
         at MeshWeaver.AI.StreamStallGuardChatClient.Swallow(Task task) in /home/runner/work/MeshWeaver/MeshWeaver/plugins-repo/src/MeshWeaver.AI/StreamStallGuardChatClient.cs:line 221
         at MeshWeaver.AI.StreamStallGuardChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /home/runner/work/MeshWeav…[truncated]
2026-10-02 19:46:38Z memex-portal-deployment-75c8dd5c4b-fm5pf fail: MeshWeaver.AI.AgentChatClient[0]
      [ThreadExec] ERROR: 19:46:38.703 threadPath=Hosting/Triage/_Thread/ci-is-red-on-main-of-systemorph-meshweav-eed2
      System.MissingMethodException: Method not found: 'Boolean MeshWeaver.AI.ReasoningEffortLevels.IsBuiltIn(System.Collections.Generic.IEnumerable`1<System.String>)'.
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.Rewrite(ChatOptions options)
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken) in /repo/src/MeshWeaver.AI.OpenAI/OpenAIReasoningEffortWire.cs:line 53
         at Microsoft.Extensions.AI.DelegatingChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.<>n__0(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /repo/src/MeshWeaver.AI.OpenAI/OpenAIWireStreamGuard.cs:line 49
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
         at System.Threading.Tasks.ValueTask`1.GetTaskForValueTaskSource(IValueTaskSource`1 t)
      --- End of stack trace from previous location ---
         at MeshWeaver.AI.StreamStallGuardChatClient.Swallow(Task task) in /home/runner/work/MeshWeaver/MeshWeaver/plugins-repo/src/MeshWeaver.AI/StreamStallGuardChatClient.cs:line 221
         at MeshWeaver.AI.StreamStallGuardChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /home/runner/work/MeshWeaver/MeshWeaver/plugins…[truncated]

_{Opened automatically from Admin/_LogIncident/a5b727b33fe90155. Recurrences are folded into this issue rather than opening new ones.}
_{It also stands for the whole log site 522233f2b3840c5c: other fingerprints of this site fold in here as comments rather than opening tickets of their own.}

Still occurring: 2 more since the last update (9 total).

Last seen: 2026-10-02 19:47:45Z
Pods: memex-portal-deployment-75c8dd5c4b-fm5pf, memex-portal-deployment-75c8dd5c4b-wgg9d

Recent log lines

2026-10-02 19:46:38Z memex-portal-deployment-75c8dd5c4b-fm5pf fail: MeshWeaver.AI.AgentChatClient[0]
      [ThreadExec] ERROR: 19:46:38.703 threadPath=Hosting/Triage/_Thread/ci-is-red-on-main-of-systemorph-meshweav-eed2
      System.MissingMethodException: Method not found: 'Boolean MeshWeaver.AI.ReasoningEffortLevels.IsBuiltIn(System.Collections.Generic.IEnumerable`1<System.String>)'.
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.Rewrite(ChatOptions options)
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken) in /repo/src/MeshWeaver.AI.OpenAI/OpenAIReasoningEffortWire.cs:line 53
         at Microsoft.Extensions.AI.DelegatingChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.<>n__0(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /repo/src/MeshWeaver.AI.OpenAI/OpenAIWireStreamGuard.cs:line 49
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
         at System.Threading.Tasks.ValueTask`1.GetTaskForValueTaskSource(IValueTaskSource`1 t)
      --- End of stack trace from previous location ---
         at MeshWeaver.AI.StreamStallGuardChatClient.Swallow(Task task) in /home/runner/work/MeshWeaver/MeshWeaver/plugins-repo/src/MeshWeaver.AI/StreamStallGuardChatClient.cs:line 221
         at MeshWeaver.AI.StreamStallGuardChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /home/runner/work/MeshWeaver/MeshWeaver/plugins…[truncated]
2026-10-02 19:47:23Z memex-portal-deployment-75c8dd5c4b-wgg9d fail: MeshWeaver.AI.AgentChatClient[0]
      [ThreadExec] ERROR: 19:47:23.007 threadPath=Admin/_LogIncident/a5b727b33fe90155/_Thread/triage-the-log-incident-at-admin-loginci-c8e3
      System.MissingMethodException: Method not found: 'Boolean MeshWeaver.AI.ReasoningEffortLevels.IsBuiltIn(System.Collections.Generic.IEnumerable`1<System.String>)'.
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.Rewrite(ChatOptions options)
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken) in /repo/src/MeshWeaver.AI.OpenAI/OpenAIReasoningEffortWire.cs:line 53
         at Microsoft.Extensions.AI.DelegatingChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.<>n__0(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /repo/src/MeshWeaver.AI.OpenAI/OpenAIWireStreamGuard.cs:line 49
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
         at System.Threading.Tasks.ValueTask`1.GetTaskForValueTaskSource(IValueTaskSource`1 t)
      --- End of stack trace from previous location ---
         at MeshWeaver.AI.StreamStallGuardChatClient.Swallow(Task task) in /home/runner/work/MeshWeaver/MeshWeaver/plugins-repo/src/MeshWeaver.AI/StreamStallGuardChatClient.cs:line 221
         at MeshWeaver.AI.StreamStallGuardChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /home/runner/work/MeshWeav…[truncated]
2026-10-02 19:47:45Z memex-portal-deployment-75c8dd5c4b-fm5pf fail: MeshWeaver.AI.AgentChatClient[0]
      [ThreadExec] ERROR: 19:47:45.394 threadPath=Hosting/Triage/_Thread/review-pull-request-systemorph-meshweave-b759
      System.MissingMethodException: Method not found: 'Boolean MeshWeaver.AI.ReasoningEffortLevels.IsBuiltIn(System.Collections.Generic.IEnumerable`1<System.String>)'.
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.Rewrite(ChatOptions options)
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken) in /repo/src/MeshWeaver.AI.OpenAI/OpenAIReasoningEffortWire.cs:line 53
         at Microsoft.Extensions.AI.DelegatingChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.<>n__0(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /repo/src/MeshWeaver.AI.OpenAI/OpenAIWireStreamGuard.cs:line 49
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
         at System.Threading.Tasks.ValueTask`1.GetTaskForValueTaskSource(IValueTaskSource`1 t)
      --- End of stack trace from previous location ---
         at MeshWeaver.AI.StreamStallGuardChatClient.Swallow(Task task) in /home/runner/work/MeshWeaver/MeshWeaver/plugins-repo/src/MeshWeaver.AI/StreamStallGuardChatClient.cs:line 221
         at MeshWeaver.AI.StreamStallGuardChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /home/runner/work/MeshWeaver/MeshWeaver/plugins…[truncated]

Still occurring: 145 more since the last update (154 total).

Last seen: 2026-10-03 01:49:17Z
Pods: memex-portal-deployment-75c8dd5c4b-fm5pf, memex-portal-deployment-75c8dd5c4b-wgg9d, memex-portal-deployment-75c8967f48-dflpl, memex-portal-deployment-75c8967f48-cvn6w, memex-portal-deployment-779cc4cc8b-qxt7x, memex-portal-deployment-779cc4cc8b-8gdwf, memex-portal-deployment-779cc4cc8b-6qblk

Recent log lines

2026-10-03 01:40:24Z memex-portal-deployment-779cc4cc8b-6qblk fail: MeshWeaver.AI.AgentChatClient[0]
      [ThreadExec] ERROR: 01:40:24.563 threadPath=Hosting/Triage/_Thread/bug-systemorph-meshweaver-6007
      System.MissingMethodException: Method not found: 'Boolean MeshWeaver.AI.ReasoningEffortLevels.IsBuiltIn(System.Collections.Generic.IEnumerable`1<System.String>)'.
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.Rewrite(ChatOptions options)
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken) in /repo/src/MeshWeaver.AI.OpenAI/OpenAIReasoningEffortWire.cs:line 53
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /repo/src/MeshWeaver.AI.OpenAI/OpenAIWireStreamGuard.cs:line 49
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
         at System.Threading.Tasks.ValueTask`1.GetTaskForValueTaskSource(IValueTaskSource`1 t)
      --- End of stack trace from previous location ---
         at MeshWeaver.AI.StreamStallGuardChatClient.Swallow(Task task) in /home/runner/work/MeshWeaver/MeshWeaver/plugins-repo/src/MeshWeaver.AI/StreamStallGuardChatClient.cs:line 221
         at MeshWeaver.AI.StreamStallGuardChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /home/runner/work/MeshWeaver/MeshWeaver/plugins-repo/src/MeshWeaver.AI/StreamStallGuardChatClient.cs:line 188
         at MeshWeaver.AI.StreamStallGuardChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
         at MeshWeaver.A…[truncated]
2026-10-03 01:40:25Z memex-portal-deployment-779cc4cc8b-6qblk fail: MeshWeaver.AI.AgentChatClient[0]
      [ThreadExec] ERROR: 01:40:25.157 threadPath=Hosting/Triage/_Thread/bug-systemorph-meshweaver-plugins-2715
      System.MissingMethodException: Method not found: 'Boolean MeshWeaver.AI.ReasoningEffortLevels.IsBuiltIn(System.Collections.Generic.IEnumerable`1<System.String>)'.
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.Rewrite(ChatOptions options)
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken) in /repo/src/MeshWeaver.AI.OpenAI/OpenAIReasoningEffortWire.cs:line 53
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /repo/src/MeshWeaver.AI.OpenAI/OpenAIWireStreamGuard.cs:line 49
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
         at System.Threading.Tasks.ValueTask`1.GetTaskForValueTaskSource(IValueTaskSource`1 t)
      --- End of stack trace from previous location ---
         at MeshWeaver.AI.StreamStallGuardChatClient.Swallow(Task task) in /home/runner/work/MeshWeaver/MeshWeaver/plugins-repo/src/MeshWeaver.AI/StreamStallGuardChatClient.cs:line 221
         at MeshWeaver.AI.StreamStallGuardChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /home/runner/work/MeshWeaver/MeshWeaver/plugins-repo/src/MeshWeaver.AI/StreamStallGuardChatClient.cs:line 188
         at MeshWeaver.AI.StreamStallGuardChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
         at Mesh…[truncated]
2026-10-03 01:49:17Z memex-portal-deployment-779cc4cc8b-6qblk fail: MeshWeaver.AI.AgentChatClient[0]
      [ThreadExec] ERROR: 01:49:17.751 threadPath=Hosting/Triage/_Thread/ci-is-red-on-main-of-systemorph-meshweav-7371
      System.MissingMethodException: Method not found: 'Boolean MeshWeaver.AI.ReasoningEffortLevels.IsBuiltIn(System.Collections.Generic.IEnumerable`1<System.String>)'.
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.Rewrite(ChatOptions options)
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken) in /repo/src/MeshWeaver.AI.OpenAI/OpenAIReasoningEffortWire.cs:line 53
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /repo/src/MeshWeaver.AI.OpenAI/OpenAIWireStreamGuard.cs:line 49
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
         at System.Threading.Tasks.ValueTask`1.GetTaskForValueTaskSource(IValueTaskSource`1 t)
      --- End of stack trace from previous location ---
         at MeshWeaver.AI.StreamStallGuardChatClient.Swallow(Task task) in /home/runner/work/MeshWeaver/MeshWeaver/plugins-repo/src/MeshWeaver.AI/StreamStallGuardChatClient.cs:line 221
         at MeshWeaver.AI.StreamStallGuardChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /home/runner/work/MeshWeaver/MeshWeaver/plugins-repo/src/MeshWeaver.AI/StreamStallGuardChatClient.cs:line 188
         at MeshWeaver.AI.StreamStallGuardChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
         …[truncated]

Still occurring: 46 more since the last update (200 total).

Last seen: 2026-10-03 06:19:05Z
Pods: memex-portal-deployment-75c8dd5c4b-fm5pf, memex-portal-deployment-75c8dd5c4b-wgg9d, memex-portal-deployment-75c8967f48-dflpl, memex-portal-deployment-75c8967f48-cvn6w, memex-portal-deployment-779cc4cc8b-qxt7x, memex-portal-deployment-779cc4cc8b-8gdwf, memex-portal-deployment-779cc4cc8b-6qblk, memex-portal-deployment-584469ddcb-hc86f, memex-portal-deployment-584469ddcb-g6rks, memex-portal-deployment-584469ddcb-h4p4h

Recent log lines

2026-10-03 06:18:23Z memex-portal-deployment-584469ddcb-h4p4h fail: MeshWeaver.AI.AgentChatClient[0]
      [ThreadExec] ERROR: 06:18:23.741 threadPath=Hosting/Triage/_Thread/review-pull-request-systemorph-meshweave-616c
      System.MissingMethodException: Method not found: 'Boolean MeshWeaver.AI.ReasoningEffortLevels.IsBuiltIn(System.Collections.Generic.IEnumerable`1<System.String>)'.
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.Rewrite(ChatOptions options)
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken) in /repo/src/MeshWeaver.AI.OpenAI/OpenAIReasoningEffortWire.cs:line 53
         at Microsoft.Extensions.AI.DelegatingChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.<>n__0(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /repo/src/MeshWeaver.AI.OpenAI/OpenAIWireStreamGuard.cs:line 49
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
         at System.Threading.Tasks.ValueTask`1.GetTaskForValueTaskSource(IValueTaskSource`1 t)
      --- End of stack trace from previous location ---
         at MeshWeaver.AI.StreamStallGuardChatClient.Swallow(Task task) in /home/runner/work/MeshWeaver/MeshWeaver/plugins-repo/src/MeshWeaver.AI/StreamStallGuardChatClient.cs:line 221
         at MeshWeaver.AI.StreamStallGuardChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /home/runner/work/MeshWeaver/MeshWeaver/plugins…[truncated]
2026-10-03 06:19:03Z memex-portal-deployment-584469ddcb-h4p4h fail: MeshWeaver.AI.AgentChatClient[0]
      [ThreadExec] ERROR: 06:19:03.448 threadPath=Hosting/Triage/_Thread/review-pull-request-systemorph-meshweave-1ad6
      System.MissingMethodException: Method not found: 'Boolean MeshWeaver.AI.ReasoningEffortLevels.IsBuiltIn(System.Collections.Generic.IEnumerable`1<System.String>)'.
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.Rewrite(ChatOptions options)
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken) in /repo/src/MeshWeaver.AI.OpenAI/OpenAIReasoningEffortWire.cs:line 53
         at Microsoft.Extensions.AI.DelegatingChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.<>n__0(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /repo/src/MeshWeaver.AI.OpenAI/OpenAIWireStreamGuard.cs:line 49
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
         at System.Threading.Tasks.ValueTask`1.GetTaskForValueTaskSource(IValueTaskSource`1 t)
      --- End of stack trace from previous location ---
         at MeshWeaver.AI.StreamStallGuardChatClient.Swallow(Task task) in /home/runner/work/MeshWeaver/MeshWeaver/plugins-repo/src/MeshWeaver.AI/StreamStallGuardChatClient.cs:line 221
         at MeshWeaver.AI.StreamStallGuardChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /home/runner/work/MeshWeaver/MeshWeaver/plugins…[truncated]
2026-10-03 06:19:05Z memex-portal-deployment-584469ddcb-h4p4h fail: MeshWeaver.AI.AgentChatClient[0]
      [ThreadExec] ERROR: 06:19:05.615 threadPath=Hosting/Triage/_Thread/review-pull-request-systemorph-meshweave-9b32
      System.MissingMethodException: Method not found: 'Boolean MeshWeaver.AI.ReasoningEffortLevels.IsBuiltIn(System.Collections.Generic.IEnumerable`1<System.String>)'.
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.Rewrite(ChatOptions options)
         at MeshWeaver.AI.OpenAI.OpenAIReasoningEffortWire.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken) in /repo/src/MeshWeaver.AI.OpenAI/OpenAIReasoningEffortWire.cs:line 53
         at Microsoft.Extensions.AI.DelegatingChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.<>n__0(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /repo/src/MeshWeaver.AI.OpenAI/OpenAIWireStreamGuard.cs:line 49
         at MeshWeaver.AI.OpenAI.OpenAIWireStreamGuard.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
         at System.Threading.Tasks.ValueTask`1.GetTaskForValueTaskSource(IValueTaskSource`1 t)
      --- End of stack trace from previous location ---
         at MeshWeaver.AI.StreamStallGuardChatClient.Swallow(Task task) in /home/runner/work/MeshWeaver/MeshWeaver/plugins-repo/src/MeshWeaver.AI/StreamStallGuardChatClient.cs:line 221
         at MeshWeaver.AI.StreamStallGuardChatClient.GetStreamingResponseAsync(IEnumerable`1 messages, ChatOptions options, CancellationToken cancellationToken)+MoveNext() in /home/runner/work/MeshWeaver/MeshWeaver/plugins…[truncated]

Also on a customer instance, 2026-10-03.

Every chat round on the instance fails with the same MissingMethodException. The instance's only language models are on OpenRouter, plus Auto, so every model goes through OpenAIReasoningEffortWire.
The instance runs image 3.0.0-ci.9606 (core commit 804e8841e, 2026-09-29). ReasoningEffortLevels.IsBuiltIn(IEnumerable<string>) arrived with a MeshWeaver.Plugins pull request merged 2026-10-02 15:43 UTC. The loaded MeshWeaver.AI predates the method; it was not removed.
Package Plugins/OpenAI 1.4.0 was auto-installed on the instance at 2026-10-03 11:31 UTC from HEAD (updatePolicy: Auto). Its minMeshVersion is still 3.0.0-ci.7845 (OpenAI/index.json:22). The version gate therefore admitted a module that needs a newer MeshWeaver.AI than the image ships.
On memex the last occurrence is 2026-10-03 06:19 UTC. This is consistent with a newer image clearing the defect there.

Proposed fix:

Raise minMeshVersion of the OpenAI package to the first image that contains that pull request.
Check the other packages whose modules call new MeshWeaver.AI members.
Roll the instance to a current image.

Root cause, and it is fixed on MeshWeaver.Plugins main. The package floor was typed by hand, so it was wrong.

ReasoningEffortLevels.IsBuiltIn(IEnumerable<string>) came in with Plugins bd2164269, merged 2026-10-01. OpenAIReasoningEffortWire.Rewrite calls it.
The OpenAI package (OpenAI/index.json) kept a typed minMeshVersion of 3.0.0-ci.7845 (later ci.9598). So the install gate let OpenAI 1.4.0 onto images whose bundled MeshWeaver.AI came before that method. The customer instance on 3.0.0-ci.9606 is one of them. That produced the MissingMethodException.
Floors are no longer typed. Since Plugins c3eec0ef6, the verifying main run stamps them (scripts/mesh-floors.py, doc Hosting/PackageFloors.md). A dependent is also raised to at least its dependencies' floors. The first stamp that took effect was e785ee2c9 (2026-10-03 21:31Z). It raised OpenAI from ci.9598 to ci.9887. On main today the floor is 3.0.0-ci.9933, and the witness OpenAI/mesh-floor.lock says verifiedOn: 3.0.0-ci.9917. python3 scripts/mesh-floors.py check is green: 74 floors are at or above the set that verified them.
That same stamp covers the comment's point 2 ("other packages whose modules call new MeshWeaver.AI members"). Every package's floor is now the set its current sources were compiled and tested on.

Not code, and still open: an instance keeps a module it already installed when a newer version's floor is above its image. The customer instance on ci.9606 therefore still runs the incompatible OpenAI 1.4.0. The remedy is the comment's point 3: roll that instance to a current image. On memex the last occurrence was 2026-10-03 06:19Z.

Not established: I did not read the customer instance's own /health or its installed bundle. Its state above comes from the 2026-10-04 comment.

The platform's half is in #6196. Plugins fixed the hand-typed floor (mesh-floors.py). The core gap was that the measured link probe at boot and at the landing checked types only. ReasoningEffortLevels existed, so OpenAI 1.4.0 passed the probe, landed, and threw MissingMethodException on the first call. ModulePlatformLinkGate.md documented that blind spot.

#6196 turns on the probe's existing member half (ModuleLinkOptions.WithMembers) at boot, at the landing and in the live swap. All three link against this process's own files.

A module that calls a member the loaded platform lacks is now refused at the landing, and the previous generation keeps serving.
An already-landed copy, like the customer instance's OpenAI 1.4.0 on ci.9606, is parked at boot, and the previous generation or the image baseline loads instead.

Before enabling it I measured it on real bytes: image 3.0.0-ci.9984 plus 4 deployed bundles, about 3,900 member references, 0 refused. It found one false refusal first (generic platform bases, in the image's own MeshWeaver.Blazor.EntityViews), and that is fixed in the same PR.

Do these issues share a cause? This one and Plugins#2715 are the same class: a dependent admitted against a dependency build that lacks what it calls, decided by a declared version instead of a measurement. This one is the binary shape. Plugins#2715 is the source-import shape; see #6190 for its core defect.

This stays open until the PR is merged and verified on an image that carries it.

Merge pull request #6196 from Systemorph/fix/runtime-link-probe-measu…

2026-10-07 ~14:30Z: no MissingMethodException on memex or memex-cloud since #6196 shipped

Both portals run 3.0.0-ci.10148, core 57a6e5fd, which contains fix(modules): boot, landing and live swap measure the member half of the link probe (#6007) #6196 (f1a24d76).
Incident ledger (Admin/_LogIncident, name:*MissingMethod*): 6 incidents in total.
- The newest is 6f51a2c56fb77c44, last seen 2026-10-06 07:43Z, before fix(modules): boot, landing and live swap measure the member half of the link probe (#6007) #6196 merged at 15:51Z. It is the same class: in-mesh ReviewAdmission.PoolFree called ThreadDispatchPool.Allowance(string), which the loaded AI lacked.
- Nothing has been filed since. The red-log ingest is alive (log_ingest: 84 report(s) accepted, the last at 14:08:35Z on a memex replica), so silence here is a reading, not an absence of instrument.
Compile sweep: 1 Error of 177 on control (SocialMedia/SocialTests), 0 on memex-cloud.

Not established:

that the member-half probe actually refused a module on a deployed portal. No skewed bundle arrived in the window;
the customer instance on ci.9606, which I cannot read. It needs a roll to an image ≥ fix(modules): boot, landing and live swap measure the member half of the link probe (#6007) #6196 before its OpenAI 1.4.0 is parked.

2026-10-07 ~16:20Z: only the customer instance remains, and it needs a roll

Public /api/version readings, taken at 16:20Z:

Instance	Running commit	Contains #6196 (`f1a24d76`)?
memex.systemorph.com	`57a6e5fd`	yes
memex.meshweaver.cloud	`57a6e5fd`	yes
pearl.meshweaver.cloud	`1bafcb28` (merge of #5947, 2026-10-03)	no (checked with `git merge-base --is-ancestor`)

On memex and memex-cloud, nothing has been filed under this site since #6196 shipped (see the 14:30Z reading above).

The customer instance (Deployments/pearl) still runs an image older than the member-half link probe. If its store copy of MeshWeaver.AI.OpenAI is skewed against its loaded AI, nothing parks it at boot or at landing, and the MissingMethodException can still occur there. I cannot read pearl's logs or its Plugins/OpenAI version from here.

What is needed (maintainer; I may not roll): roll Deployments/pearl to an image ≥ 57a6e5fd / 3.0.0-ci.10148. Its record is Continuous, but a self-update parks at AwaitingApproval unless the tag equals the recorded pin, so the roll needs an approval or a governed Roll. After the roll, read pearl's /health and its [ModuleLink]/[ModuleActivation] lines for OpenAI. If they show the probe parked a skewed OpenAI, or loaded a matching one, this issue can close.

Related: #6052. Cross-linked, not merged. One class, different defects. This issue is a member-level link skew (fix #6196, the member-half link probe); it closes on pearl being rolled to an image ≥ 57a6e5fd and its OpenAI module being parked or matched. #6052 is locally compiled bytes on a per-pod store that the shared record points at (fix #6197 plus its open asks 2 and 3). The closed #6044 and MeshWeaver.Plugins#2715 were the same class too.

Fix: #6196, merged 2026-10-06 15:51Z as f1a24d76a9 (the member-half link probe at boot, landing and live swap).

Live reading (2026-10-08 17:39Z): /api/version on memex.systemorph.com and control.systemorph.com = core f60e62c1fb (CD run 10253, image 3.0.0-ci.10253; its portal-ai job baked Plugins 529521f). memex.meshweaver.cloud still serves 57a6e5fd (ci.10148). f1a24d76a9 is in both f60e62c1fb and 57a6e5fd.

Evidence: name:*MissingMethod* under Admin/_LogIncident on memex.systemorph.com returns the same 6 incidents as before. The newest, 6f51a2c56fb77c44, was last touched 2026-10-06 07:46Z, which is before #6196 merged. Nothing new has been filed in the roughly two days since.

Not yet witnessed:

The pearl roll onto an image that contains f1a24d76a9. Pearl still ran 1bafcb28 at the last reading.
The probe actually parking a skewed bundle on a deployed portal.

Closed per maintainer decision 2026-10-08: fixed and live. Reopen (the incident filer does so automatically) if this fingerprint recurs.

Navigation Menu

Repository navigation

OpenAI chat wire throws MissingMethodException — MeshWeaver.AI.OpenAI deployed against an incompatible MeshWeaver.AI build #6007

What is failing

Probable cause

Impact

Where to look

Evidence

2026-10-07 ~14:30Z: no MissingMethodException on memex or memex-cloud since #6196 shipped

2026-10-07 ~16:20Z: only the customer instance remains, and it needs a roll

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

OpenAI chat wire throws MissingMethodException — MeshWeaver.AI.OpenAI deployed against an incompatible MeshWeaver.AI build #6007

Description

What is failing

Probable cause

Impact

Where to look

Evidence

Activity

systemorph-com commented on Oct 2, 2026

systemorph-com commented on Oct 3, 2026

systemorph-com commented on Oct 3, 2026

sierragolflima commented on Oct 4, 2026

rbuergi commented on Oct 4, 2026

rbuergi commented on Oct 6, 2026

rbuergi commented on Oct 7, 2026

2026-10-07 ~14:30Z: no MissingMethodException on memex or memex-cloud since #6196 shipped

rbuergi commented on Oct 7, 2026

2026-10-07 ~16:20Z: only the customer instance remains, and it needs a roll

rbuergi commented on Oct 7, 2026

rbuergi commented on Oct 8, 2026

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions