feat: implement Metrics for ng

[Pablu23]

Description

Implement Metrics for async NG code

Assignee

• The changes adhere to the contribution guidelines
• I have performed a self-review of my code
• My changes generate no new warnings (e.g. flake8/mypy/pytest/...) other than deprecations

Documentation

• README.md is up-to-date
• CHANGELOG.md is up-to-date
• Documentation (doc/source) is up-to-date
• Preview for docs looks fine
• Notebooks are up-to-date and functional
• Examples are up-to-date and functional (including compose & k8s)

Code Quality

• Patch test coverage > 95% and does not decrease
• New code uses correct & specific type hints

How did you verify that the changes work in practice?

Running benchmark script, and while that runs running curl localhost:8081/metrics and parsing the output with my eyes

Reviewer

• The code is readable/maintainable and follows the contribution guidelines
• Documentation is up-to-date
• Tests (unit & acceptance) are meaningful and not over-mocked

---

The rendered docs for this PR can be found here.

[Pablu23]

NG Benchmarks --num-events 500000 --ng 1
=== FINAL BENCHMARK SUMMARY ===
runs: 3
total runtime: 180.001 s
total processed: 601_100

throughput (weighted): 3,339.43 docs/s
throughput (median): 3,357.86 docs/s
throughput (average): 3,268.26 docs/s
throughput (min/max): 3,009.95 / 3,436.98 docs/s
throughput (std dev): 227.18 docs/s

Non NG Benchmark (same parameters)
=== FINAL BENCHMARK SUMMARY ===
runs: 3
total runtime: 180.001 s
total processed: 572_986

throughput (weighted): 3,183.24 docs/s
throughput (median): 3,173.82 docs/s
throughput (average): 3,142.79 docs/s
throughput (min/max): 3,005.92 / 3,248.63 docs/s
throughput (std dev): 124.29 docs/s

[mhoff]

Please make the Callable more specific with its generic type parameter where useful and applicable.

At least:

Suggested change

	def make_patched_asgi_app(functions: Iterable[Callable] | None) -> Callable:
	def make_patched_asgi_app(functions: Iterable[Callable[[], bool]] | None) -> Callable:

[mhoff]

tests/unit/ng/conftest.py

from unittest import mock

import pytest

from logprep.registry import Registry


@pytest.fixture(autouse=True)
def rewrite_registry_get_class_to_ng():
    get_class = Registry.get_class.__func__

    def get_class_wrapped(cls, component_type: str):
        if not component_type.startswith("ng_"):
            component_type = f"ng_{component_type}"
        return get_class(cls, component_type)

    with mock.patch.object(Registry, "get_class", classmethod(get_class_wrapped)):
        yield