Skip to content

llm: patter confabulates artist facts and parrots quirk example values β€” tighten the system prompt's embellishment licenseΒ #188

Description

@genwave-radio

πŸ› Observed (demo Booth log, 2026-07-28, The Archivist on shift)

Two distinct quality failures in live patter, both downstream of the system prompt line "You may embellish with genuine knowledge of the track, artist, or era":

1. Confabulated facts, including the artist's name.

  • Lead-in for "Son de maΓ­z" by LaBarcaDeSua β†’ on air: "…by Barcarola…", "a soundscape from rural Cuba" (invented origin).
  • Back-announce for "Breathe" by Bellevue β†’ "from a field day in Brooklyn's indie scene" (invented).

Renaming a real artist on air is the worst case β€” a listener can't tell curated flavor from error. A small local model does not have "genuine knowledge" of netlabel artists; the license produces confident fabrication instead.

2. Quirk example values reused verbatim.
The Archivist's quirk says invented catalog number with example 'item four-seven-one-two' β€” but many breaks speak exactly "item four-seven-one-two" (it also sometimes invents, e.g. "five-one-zero-eight-six", so this is gravitational pull toward the example, not total parroting). Dozens of repeats flatten the bit.

πŸ”§ Fix shape (one prompt region, two lines)

In the patter system prompt (LlmPromptBuilder):

  • Replace the open embellishment license with a guarded one: era/genre color is fine, but never state specific facts about the artist or track you were not given, and never alter the artist's name or the title β€” when unsure, stay with what's in the prompt.
  • Where quirks are injected: examples inside quirks illustrate style β€” invent fresh specifics each break; do not reuse an example's literal values.

Persona quirks themselves are working as designed (the catalog-number bit IS The Archivist) β€” no persona-side change needed. Related: gh-#152 (exposing the system prompt in the Admin UI would have made all of this diagnosable from the Booth log alone), gh-#151 (they/their).

Metadata

Metadata

Assignees

No one assigned

    Labels

    demoFound on GenWave demoenhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions