From 755f98e4b34b3020ede03c2d5909a3acb5af32c6 Mon Sep 17 00:00:00 2001 From: Kacper Muda Date: Wed, 2 Apr 2025 13:28:00 +0200 Subject: [PATCH] docs: Add recently supported Spark operators to OpenLineage docs --- .../templates/openlineage.rst.jinja2 | 17 +++++++++++++++++ 1 file changed, 17 insertions(+) diff --git a/devel-common/src/sphinx_exts/templates/openlineage.rst.jinja2 b/devel-common/src/sphinx_exts/templates/openlineage.rst.jinja2 index 7be5eb560cf21..cca8e3f0637cc 100644 --- a/devel-common/src/sphinx_exts/templates/openlineage.rst.jinja2 +++ b/devel-common/src/sphinx_exts/templates/openlineage.rst.jinja2 @@ -31,6 +31,23 @@ The OpenLineage integration can automatically inject information into Spark appl The following is a list of supported operators along with the corresponding information that can be injected. See :ref:`automatic injection of parent job information ` for more details. + +apache-airflow-providers-apache-livy +""""""""""""""""""""""""""""""""""""" + +- :class:`~airflow.providers.apache.livy.operators.livy.LivyOperator` + - Parent Job Information + - Transport Information (only HTTP transport is supported for now (with api_key auth, if any)) + + +apache-airflow-providers-apache-spark +""""""""""""""""""""""""""""""""""""" + +- :class:`~airflow.providers.apache.spark.operators.spark_submit.SparkSubmitOperator` + - Parent Job Information + - Transport Information (only HTTP transport is supported for now (with api_key auth, if any)) + + apache-airflow-providers-google """""""""""""""""""""""""""""""