Skip to content

Add a process_line callback to KubernetesPodOperator  #31745

Description

@yupbank

Description

Add a process_line callback to KubernetesPodOperator
Like https://github.com/apache/airflow/blob/main/airflow/providers/apache/beam/operators/beam.py#LL304C36-L304C57 the BeamRunPythonPipelineOperator, which allows the user to add stateful plugins based on the logging from docker job

Use case/motivation

I can add a plugin based on the logging and also allow cleanup on_kill based on the job creation log.

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions