Skip to content

Pulsar C++/Python consumer performance issue, if producing message in batch mode, consuming ACK in single mode #3623

Closed

Description

@easyfan

Expected behavior

Pulsar C++/Python client consuming performance should keep at a stable level;

Actual behavior

Pulsar C++/Python client consuming performance downgrade obviously;

Steps to reproduce

  1. Producing messages in batch mode (locally with batch count as 1000);
  2. Consuming messages with ACK in single mode (as appose to the cumulative mode) with C++ or Python clients;
  3. Keep the consuming process running for a while (say, with producing message 5000-8000 per second, run at least 15 minutes) and see the consuming messages per seconds, it downgrades very obviously; At the same time, the Pulsar Java client consuming performance could keep in a stable level.
    See the attached monitor screen below:
    image

System configuration

org.apache.pulsar:pulsar-client-cpp: 2.2.0

Activity

  1. easyfan commented on Feb 19, 2019

    @easyfan
    ContributorAuthor

    This issue is led by a mistake in pulsar-client-cpp/BatchAcknowledgementTracker.cc.

  2. merlimat commented on Feb 19, 2019

    @merlimat
    Contributor

    This is fixed in master #3618

  3. added this to the 2.3.1 milestone on Feb 21, 2019
  4. sijie commented on Feb 21, 2019

    @sijie
    Member

    closed the issue as #3618 fixed it.

    @easyfan #3618 would be released as part of 2.3.1 and 2.4.0. you can check it out when 2.3.1 is release. if it happens again, please reopen the issue or create a new one.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

area/clienttype/bugThe PR fixed a bug or issue reported a bug

Type

No type

Projects

No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions