[jakebellacera]

Which Delta project/connector is this regarding?

• Spark
• Standalone
• Flink
• Kernel
• Other (Docs)

Description

This PR introduces a new Github Actions workflow which will automatically build and deploy the docs site and any desired version(s) of API docs. This workflow runs only under one of the following conditions:

1. Whenever a PR is merged into master which includes changes the /docs directory (most common case).
2. If there is a new release (less common — mainly used for API doc updates).
3. Manually (useful for debugging purposes; only users with the collaborators permission to this repo can run it).

Here's an example of a working deployment:

• Github Actions log
• Test deployment

How it works

1. When one of the conditions above is met, the publish_docs workflow is kicked off.
2. Builds one or more version(s) of the Delta Lake API docs.
3. Builds the docs site with the specified Delta Lake API docs.
4. Uploads the site to Netlify.

Specifying API docs versions

This workflow can build multiple versions of Delta Lake APIs. To do so, just specify the version(s) in the publish_docs workflow. Here's what's currently defined:

delta/.github/workflows/publish_docs.yaml

Lines 14 to 29 in 89d77c7

	jobs:
	build_api_docs:
	name: Build API docs (${{ matrix.version.name }})
	runs-on: ubuntu-latest
	strategy:
	matrix:
	version:
	- name: latest
	ref: v4.0.0
	java: 17
	out_dir: docs/apis/_site/api
	- name: 3.3.2
	ref: v3.3.2
	java: 8
	out_dir: docs/apis/_site/api

The workflow will check out the ref of this repo and use it to generate the API docs. The name is used to specify the human-readable folder to the API docs. For example, "latest" is using the ref v4.0.0, while "3.3.2" is using the ref v3.3.2. This allows for more flexibility.

Additional changes required before merging

Add the following variables to this Github repo:

• NETLIFY_SITE_ID - Netlify Site ID we want to deploy to

Add the following secrets to this Github repo:

• NETLIFY_AUTH_TOKEN - Netlify user PAT to authenticate Netlify CLI with

Other changes

• Updated the v3 API docs to v3.3.2
• Upgraded Node.js dependencies
• Updated the scala version for building v4 API docs (note: due to our automation building an older ref of Delta Lake v4, this won't apply until the next v4 release).