Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
dee8040
docs(compliance): re-audit posthog-android capture rows for 4.0
turnipdabeets Nov 5, 2026
02b9ba8
docs(compliance): re-check posthog-android 4.0 rows against #146 at 5…
turnipdabeets Nov 9, 2026
b8c1af7
docs(compliance): score posthog-android 4.0 rows against #146 as merged
turnipdabeets Nov 9, 2026
9f4d8b1
docs(compliance): treat the #146 $lib precedence conflict as resolved…
turnipdabeets Nov 9, 2026
4078fe3
docs(compliance): re-check posthog-android 4.0 rows at aaa23d39 again…
turnipdabeets Nov 10, 2026
52618a7
docs(compliance): re-audit posthog-android consent, identify, setup, …
turnipdabeets Nov 10, 2026
67dbe32
docs(compliance): re-audit posthog-android remote config, flag cache,…
turnipdabeets Nov 10, 2026
4f737d1
docs(compliance): re-audit posthog-android flag-read rows at 4.0
turnipdabeets Nov 10, 2026
45de66a
docs(compliance): re-audit posthog-android session replay rows at 4.0
turnipdabeets Nov 10, 2026
90d458d
docs(compliance): re-audit posthog-android surveys and exception rows…
turnipdabeets Nov 10, 2026
875da7a
docs(compliance): update posthog-android 4.0 totals, scope and README…
turnipdabeets Nov 10, 2026
06bd1ad
docs(compliance): re-score posthog-android Alias at 4.0
turnipdabeets Nov 10, 2026
cfc72e1
docs(compliance): score posthog-android Capture partial for the ident…
turnipdabeets Nov 10, 2026
30a6492
docs(compliance): add the five newer contracts to posthog-android as N/A
turnipdabeets Nov 10, 2026
1b64af2
docs(compliance): keep posthog-android Capture passing while tracking…
turnipdabeets Nov 11, 2026
444ca3d
docs(compliance): make the 69-contract README note SDK-neutral
turnipdabeets Nov 11, 2026
0853a10
Merge remote-tracking branch 'origin/main' into pr186-android4
turnipdabeets Nov 11, 2026
4562b52
docs(compliance): point posthog-android Identify remediation at #967
turnipdabeets Nov 11, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
56 changes: 43 additions & 13 deletions compliance/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,14 @@ capabilities listed in the root `README.md` table, including **MCP Analytics**,
PR [#87](https://github.com/PostHog/sdk-specs/pull/87), and **Bootstrap**, added to the table by PR
[#97](https://github.com/PostHog/sdk-specs/pull/97).

**Update (2026-11-10):** the root `README.md` table now lists **69 contracts**. Five were added after
this run: **AI Datasets**, **AI Scorers** and **Offline Evaluations** (PR
[#137](https://github.com/PostHog/sdk-specs/pull/137)), **Emails** (PR
[#159](https://github.com/PostHog/sdk-specs/pull/159)) and **Experiment Exposure** (PR
[#162](https://github.com/PostHog/sdk-specs/pull/162)). A per-SDK file re-audited since then carries
the five rows and its row below is out of 69; every other SDK stays out of 64 or fewer until its next
audit adds them. Rows out of 69 also give their score on the shared 64-row basis, for comparison.

Five contracts are newer than most per-SDK files. **Capture AI**, **Evaluate Flags**, and **Exception
Event Metadata** merged between 2026-08-10 and 2026-08-13; **Session Replay Debug Properties** on
2026-09-28 (PR [#72](https://github.com/PostHog/sdk-specs/pull/72)); and **MCP Analytics** on 2026-10-05
Expand Down Expand Up @@ -145,7 +153,7 @@ the single most widely-shared non-compliance in the matrix.
|---|---|---|---|---|---|---|---|---|---|
| posthog-js | 26/64 fully compliant (41%) | 26 | 21 | 12 | 5 | 0 | 2026-10-05 · `6538babc` (targeted re-audit; most of the 59 pre-existing rows carried from 2026-08-10, see file header) | 33 | [posthog-js.md](posthog-js.md) |
| posthog-python | 13/64 fully compliant (20%; 30 contracts N/A on a server SDK) | 13 | 16 | 5 | 30 | 0 | 2026-10-12 · `509c8525` | 21 | [posthog-python.md](posthog-python.md) |
| posthog-android | 37/64 fully compliant (58%) | 37 | 16 | 5 | 6 | 0 | 2026-10-19 · `c5e788bd` (targeted re-audit — see file header) | 21 | [posthog-android.md](posthog-android.md) |
| posthog-android | 43/69 fully compliant (62%; 43/64 = 67% on the shared basis) | 43 | 15 | 1 | 10 | 0 | 2026-11-10 · `aaa23d39` (4.0: 31 rows); other rows 2026-10-19 · `c5e788bd` — see file header | 16 | [posthog-android.md](posthog-android.md) |
| posthog-ios | 38/64 fully compliant (59%) | 38 | 16 | 4 | 6 | 0 | 2026-10-08 · `f5cbe87c` + PostHog/posthog-ios#924–#934 (out-of-cycle refresh, see below) | 20 | [posthog-ios.md](posthog-ios.md) |
| posthog-node | 9/64 fully compliant (14%; 29 contracts N/A on a server SDK) | 9 | 21 | 4 | 29 | 1 | 2026-10-12 · `4f590b36` (posthog-js monorepo; Traces row corrected 2026-10-19) | 25 (+1 ❓) | [posthog-node.md](posthog-node.md) |
| posthog-flutter | 21/64 fully compliant (33%) | 21 | 29 | 6 | 8 | 0 | 2026-10-19 · `1032c102` | 35 | [posthog-flutter.md](posthog-flutter.md) |
Expand All @@ -172,6 +180,32 @@ MCP Analytics ➖, Session Replay Debug Properties 🟡. Details in [posthog-ios
The roll-up counts include the fixes from PostHog/posthog-ios#924–#934: Shutdown ❌→✅ and five 🟡→✅
(Group, Group Identify, Stop Session Recording, Feature Flag Called Tracker, HTTP Client); see the "posthog-ios PRs included" table in the per-SDK file.

**2026-11-05 out-of-cycle refresh — posthog-android 4.0 (re-checked 2026-11-10):** re-audited 31
rows at `aaa23d39`, the head of the 4.0 integration PR PostHog/posthog-android#871, against `main` at
`752f899` plus [#146](https://github.com/PostHog/sdk-specs/pull/146) (capture v1 delivery) at `d387ab79`,
which includes [#147](https://github.com/PostHog/sdk-specs/pull/147) (capture v1 AI lane). The 31 are the
five capture v1 rows, the 25 rows that 4.0 code or spec text merged since 2026-10-19 changes, and
Alias, whose code changed in PostHog/posthog-android#819. android moves from 37/16/5/6 to **43/15/1/10**, on 69 rows:
- **Five new rows, all ➖:** Experiment Exposure (android requests `/flags?v=2`), AI Datasets, AI Scorers,
Offline Evaluations and Emails (server-only).
- **Alias ❌→✅:** `$create_alias` carries `distinct_id` in its properties (PostHog/posthog-android#819).
- **Capture AI ➖→✅:** #147 adds android 4.0 to Applicability, and the AI lane conforms.
- **Start Session Recording ❌→✅:** replay isn't installed while opted out, so a start stays inactive.
- **Consent Gating 🟡→✅:** `optOut()` stops replay and integrations.
- **On Feature Flags 🟡→✅:** a runtime `onFeatureFlags()` with unsubscribe and late replay (#161).
- **Session Replay Debug Properties 🟡→✅:** required/optional tiering and the 30 s bundle window.
- **Session Replay Privacy 🟡→✅:** wireframe mode is gone (#197), so `ph-no-capture` is always masked.
- **Get Feature Flags and Get Feature Flags And Payloads ❌→🟡:** the specs now record `getAllFeatureFlags()`
as android's form; it returns `null` after a restart until the disk cache is loaded.
- **Identify ✅→🟡:** while opted out it updates the person-properties dedup hash for a `$set` it dropped.
- **Capture stays ✅ (tracking 4.0):** the identity-call `process_person_profile: true` migration-guide example
#146 requires from `15501ca` lands in 4.0 with PostHog/posthog-android#966, which targets the release branch.

The other rows keep their scores. HTTP Client and Retry Queue conform to capture v1, and Event
Batcher stays 🟡 on its `Timer` finding. Stop Session Recording carries forward from 2026-10-19 and is
stale: its opt-out point predates 4.0.
Details in [posthog-android.md](posthog-android.md#posthog-android-40-re-audit-2026-11-05).

**2026-11-10 out-of-cycle refresh — posthog-react-native for react-native-plugin 3.0:** re-audited the
nine rows the plugin's move to posthog-ios 4.0 and posthog-android 4.0 affects, at `210bf35d8`, the head
of [PostHog/posthog-js#5194](https://github.com/PostHog/posthog-js/pull/5194), with the native behavior read
Expand Down Expand Up @@ -221,7 +255,7 @@ and posthog-dotnet is computed against the contracts actually applicable to a se
(posthog-python: 13 Pass / 34 applicable = 38%; posthog-node: 9 Pass / 35 applicable = 26%;
posthog-php: 11 Pass / 30 applicable = 37%; posthog-ruby: 9 Pass / 30 applicable = 30%;
posthog-go: 8 Pass / 31 applicable = 26%; posthog-java: 12 Pass / 31 applicable = 39%;
posthog-dotnet: 5 Pass / 34 applicable = 15%); shown above as raw Pass/(59, 63 or 64) for
posthog-dotnet: 5 Pass / 34 applicable = 15%); shown above as raw Pass/(59, 63, 64 or 69) for
comparability with client SDKs, which see N/A far less often. posthog-js's 26/64 is likewise 26 Pass
/ 59 applicable = 44%, since Capture AI and Evaluate Flags are ➖ on a browser SDK. **posthog-node
note:** the standalone `PostHog/posthog-node` repo has been archived/redirected — its code now lives
Expand Down Expand Up @@ -261,10 +295,6 @@ stalest pointer and its only 59-row file.
| posthog-js | Traces | Backward-compatible | No OTLP span/traces implementation anywhere — [posthog-js.md#n34](posthog-js.md) |
| posthog-python | Logs | Backward-compatible | No `/i/v1/logs` OTLP pipeline — [posthog-python.md#n1](posthog-python.md) |
| posthog-python | Set/Reset Person/Group Properties For Flags (×4) | Backward-compatible | No persistent property-override cache, despite `@both`-tagged acceptance scenarios — [posthog-python.md#n10](posthog-python.md) |
| posthog-android | Alias | Backward-compatible | No `distinct_id` alongside `alias` in the `$create_alias` payload; re-confirmed 2026-10-19 at `PostHogStateless.kt:373-385` — [posthog-android.md#n1](posthog-android.md#n1) |
| posthog-android | Get Feature Flags | Backward-compatible | No public flat bulk getter; internal cache-only version exists but isn't exposed — [posthog-android.md#n9](posthog-android.md#n9) |
| posthog-android | Get Feature Flags And Payloads | Backward-compatible | No combined getter; returns `null` (not empty maps) on cold cache — [posthog-android.md#n10](posthog-android.md#n10) |
| posthog-android | Start Session Recording | Backward-compatible | `startSessionReplay()` still has no `isOptedOut()` guard — it checks `isEnabled()` and the replay flag only, and `group()` nine screens away documents why those are not the same check — [posthog-android.md#n20](posthog-android.md#n20) |
| posthog-android | Traces | Backward-compatible | No OTLP traces/spans implementation — [posthog-android.md#n23](posthog-android.md#n23) |
| posthog-ios | Get Feature Flags | Backward-compatible | No public flat key→value bulk flag getter — [posthog-ios.md#n9](posthog-ios.md) |
| posthog-ios | Get Feature Flags And Payloads | Backward-compatible | No combined flags+payloads getter under any name — [posthog-ios.md#n10](posthog-ios.md) |
Expand Down Expand Up @@ -334,11 +364,10 @@ stalest pointer and its only 59-row file.
| posthog-node | MCP Analytics | Backward-compatible | **New this run** — `@posthog/mcp` emits neither optional event and misreports an unknown tool as a failed `$mcp_tool_call`; see the ownership question above about whether this row belongs to node or js — [posthog-node.md#n26](posthog-node.md) |
| posthog-node | Local Feature Flag Evaluator | Backward-compatible | Holdouts **are** implemented in `@posthog/core`, and the acceptance-asset sync gap is unchanged; new this run, a non-scalar group key buckets on `"true"` / `"[object Object]"` instead of going inconclusive — [posthog-node.md#n24](posthog-node.md) |
| posthog-ios | Exception Event Metadata | Backward-compatible | Chain linkage, 50-entry cap, `$exception_source`, empty `value` and UUID-less image filtering land in PostHog/posthog-ios#931; caller properties can still override `$exception_level`/`$exception_source` on purpose (no typed level parameter yet, and Android/JS behave the same) — [posthog-ios.md#n19](posthog-ios.md) |
| posthog-android | Consent Gating | Backward-compatible | `optOut()` never stops an active replay session, and session-replay start/stop never check `isOptedOut()`, despite session replay being named in this spec's own scope — [posthog-android.md#n5](posthog-android.md#n5) |
| posthog-android | Session Replay Debug Properties | Backward-compatible | **New this run** — the most complete implementation outside the browser, but no required/optional tiering and no 30s throttle (the whole bundle rides every event) — [posthog-android.md#n17](posthog-android.md#n17) |
| posthog-android | Exception Event Metadata | Needs deprecation path | **New this run** — linkage, 50-cap and cycle detection are all correct, but `synthetic` is a hardcoded `false` (the spec's explicit "MUST NOT represent unknown with false"), causes inherit `handled`, no `mechanism.source`/`$exception_source`, and `$exception_level` is a *documented* caller override — [posthog-android.md#n7](posthog-android.md#n7) |
| posthog-android | Session Replay Privacy | Needs deprecation path | `ph-no-capture` ignored outside screenshot mode; default capture mode can leak tagged views — [posthog-android.md#n19](posthog-android.md#n19) |
| posthog-android | Surveys | Needs deprecation path | Web-only `url`/`selector`-targeted surveys aren't excluded on Android as the spec requires — [posthog-android.md#n22](posthog-android.md#n22) |
| posthog-android | Exception Event Metadata | Needs deprecation path | Nested entries copy the outermost `handled`, suppressed entries have no `mechanism.source`, a single-entry list has no `exception_id: 0`, no `$exception_source`, and `$exception_level` is a documented caller override (re-audited at 4.0 `aaa23d39`) — [posthog-android.md#n7](posthog-android.md#n7) |
| posthog-android | Identify | Backward-compatible | While opted out, `identify` updates the person-properties dedup hash for a `$set` it dropped, so the same properties are skipped after opt-in (4.0 `aaa23d39`) — [posthog-android.md#n28](posthog-android.md#n28) |
| posthog-android | Get Feature Flags / Get Feature Flags And Payloads | Backward-compatible | `getAllFeatureFlags()` is the spec's android 4.0 form but returns `null` after a restart until the disk cache is loaded (4.0 `aaa23d39`) — [posthog-android.md#n9](posthog-android.md#n9) |
| posthog-android | Surveys | Backward-compatible | Submit and dismiss move the last-seen survey date (#102), and a survey with an unknown question type blocks later surveys until reset (4.0 `aaa23d39`) — [posthog-android.md#n22](posthog-android.md#n22) |
| posthog-ios | Capture | Backward-compatible | **Downgraded from ✅ on new spec text** — `NSNull`-valued properties are serialized as JSON `null` instead of dropped; empty event names are not dropped — [posthog-ios.md#n4](posthog-ios.md) |
| posthog-ios | Session Replay Debug Properties | Backward-compatible | **New row** — tiers, 30 s window and crash-context snapshot conform; gaps on caller-supplied `$session_id`, backdated events, and `active` status after a background session timeout — [posthog-ios.md#n26](posthog-ios.md) |
| posthog-node | Flush / Retry Queue (v1 pipeline) | Needs deprecation path | `V1CaptureSender` never throws on exhausted retry, so failed batches are evicted from the queue as if delivered — [posthog-node.md#n8](posthog-node.md) |
Expand Down Expand Up @@ -387,7 +416,7 @@ stalest pointer and its only 59-row file.
| posthog-js | Exception Event Metadata | Backward-compatible | **New this run** — the most complete producer envelope audited (full `exception_id`/`parent_id` linkage, canonical sources, correct nested-`handled` omission, spec-exact caps), missing only `$exception_source` and a capture category on the two global handlers, which fall back to `generic` — [posthog-js.md#n35](posthog-js.md) |
| posthog-js | Session Replay Debug Properties | Backward-compatible | **New this run** — re-scored against `d078270` after #96; tiering, the `$`-prefix gate, and the 30 s throttle conform, but after `stopSessionRecording()` on a loaded recorder events keep `active`/`buffering` instead of `$recording_status: disabled` — [posthog-js.md#n36](posthog-js.md) |

Full contract-by-contract detail (33 posthog-js, 21 posthog-python, 23 posthog-android, 20
Full contract-by-contract detail (33 posthog-js, 21 posthog-python, 16 posthog-android, 20
posthog-ios, 26 posthog-node, 34 posthog-flutter, 30 posthog-react-native, 19 posthog-php, 21
posthog-ruby, 23 posthog-go, 19 posthog-java, and 29 posthog-dotnet non-Pass/non-N/A cells) is in
the respective per-SDK files.
Expand Down Expand Up @@ -570,7 +599,8 @@ and a `disabled` fallback, deviating only on tiering/throttling;
only on the one platform where replay does not run; and **posthog-react-native has nothing at all**
despite owning a real replay integration and already computing most of the state. Since both
flutter and react-native embed native SDKs for replay, the cheapest path for both is to surface what
android already computes across the bridge rather than reimplement it.
android already computes across the bridge rather than reimplement it. posthog-android 4.0 (`aaa23d39`) adds the
tiering and the 30 s window, so its row is ✅ there ([posthog-android.md#n17](posthog-android.md#n17)).

## Unknown (❓) cells needing human review

Expand Down
Loading
Loading