Skip to content

Unhealthy cluster / possible PEM health check issue.  #184

Description

@htroisi

@jdotjdot installed Pixie and is seeing the following issues:

  • px CLI says the cluster is unhealthy much of the time
  • when running scripts, often gets a “stream read error”

image

@nserrino took a quick look at the logs: "It looks like the PEMs are taking more than 5 seconds to send their results to the Kelvin, which shouldn't be happening. Looks like kelvin is correctly sending health check results back, but query broker is interpreting them as invalid for some reason."

App information (please complete the following information):
self-hosted on AWS using kops. v1.18.8
we use spotinst for control plane / scheduling

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions