Stdlib: hash_init() / hash_update() / hash_final() / hash_copy() — incremental ext/hash API

Problem

Incremental ext/hash API is partially landed. hash_init() / hash_update() / hash_final() register and produce correct digests on VM (verified 2026-06-18). Remaining Zend gaps:

hash_copy() — must duplicate non-finalized HashContext; semantics after partial hash_update / before hash_final
hash_pbkdf2() / hash_hkdf() — still missing or stubbed (tracked also by enum-operand issues Stdlib: hash_pbkdf2() — enum case password operand must TypeError (ext/hash/hash.c, php-src-strict) #9027)
JIT/AOT — incremental context resource/object lifecycle on compiled path

Streaming file hashing and PBKDF2 key derivation cannot be expressed end-to-end until copy + KDF land.

php-src reference

php/php-src ext/hash/hash.c — php_hash_init, php_hash_update, php_hash_final, php_hash_copy
php/php-src ext/hash/hash_pbkdf2.c
php/php-src ext/hash/hash_hkdf.c
php/php-src ext/hash/hash.stub.php

Repro — incremental digest (GREEN on VM)

<?php
$ctx = hash_init('sha256');
hash_update($ctx, 'hello ');
hash_update($ctx, 'world');
echo hash_final($ctx), "\n";

./script/docker-exec.sh -- bash -lc 'source script/php-env.sh
php repro_hash_incremental.php
php bin/vm.php repro_hash_incremental.php
'

Engine	Output
Zend	`b94d27b9934d3e08a52e52d7da7dabfac484efe37a5380ee9088f7ace2efcde9`
VM	same ✅

Repro — `hash_copy()` before finalize (FAIL / unverified)

<?php
$ctx = hash_init('sha256');
hash_update($ctx, 'hello ');
$ctx2 = hash_copy($ctx);
hash_update($ctx, 'world');
echo hash_final($ctx), "\n";
echo hash_final($ctx2), "\n";

Engine	Expected
Zend	full digest on `$ctx`; `hello` partial state digest on `$ctx2`
VM	verify + fix if differs

Note: hash_copy() after hash_final() must TypeError on both engines (finalized context).

Scope (this repo)

Area	Path
VM	`ext/hash/` or `ext/standard/VmHash.php` — `HashContext` object lifecycle
Builtins	`hash_copy.php`, `hash_pbkdf2.php`, `hash_hkdf.php` registration
JIT	deferred v1; document VM-only in matrix
Tests	`test/compliance/cases/stdlib/hash_copy.phpt`, `hash_pbkdf2_roundtrip.phpt`

PHP-in-PHP first: digest state in PHP; libc only for underlying algo if already used by hash().

Done when (php-src-strict)

Incremental repro (above) stays green
hash_copy() repro matches Zend for pre-finalize and rejects finalized context
hash_pbkdf2() round-trip matches Zend test vector (link Stdlib: hash_pbkdf2() — enum case password operand must TypeError (ext/hash/hash.c, php-src-strict) #9027 enum guards separately)
hash_hkdf() basic extract/expand vector matches Zend
./script/ci-fast.sh --filter HashContext green
docs/capabilities.md updated via script/capability-matrix.php

Verification

./script/docker-exec.sh -- bash -lc 'source script/php-env.sh && vendor/bin/phpunit --filter HashContext'

Links

One-shot hash()/hash_hmac() (implemented) · Stdlib: hash_algos() / hash_file() / hash_hmac_file() — ext/hash introspection and file hashing #3221 hash_file() · Epic: Self-host critical path — compiler compiles itself (M3→M5) #1492

Bootstrap: ext/hash module skeleton — register hash_init/hash_algos (#…

claim: PHP Compiler STD Lib — starting this run (JIT/AOT incremental hash_context)

Substantive WIP merged to PR #17087.

Done this run

JIT/AOT lowering for hash_init / hash_update / hash_final / hash_copy via JitHashContext (object-property buffering + JitHash::hash finalize).
StringHashCryptoPhp bridge fix: coerce ABI i32 raw flag → helper i1 (fixes AOT module verify for __compiler_hash*).
VM repro + compliance green; AOT compile green.

Blocker (not merged)

AOT execute segfaults at c:main_before_php when hash_update/hash_final are linked in the same binary (Docker). hash_init() alone runs.

Verify

php bin/vm.php test/repro/hash_context_incremental.php
./script/docker-exec.sh -- bash -lc 'source script/php-env.sh && php bin/compile.php -o /tmp/hash_ctx test/repro/hash_context_incremental.php'

PR: #17087

claim: PHP Compiler STD Lib — continuing PR #17087 (AOT execute segfault on hash_update/hash_final)

hash: HashContext JIT properties as TYPE_STRING slots (#3357)

WIP update (continued PR #17087)

Committed f3e9ed490: HashContext __hc* properties now use TYPE_STRING object slots + deep-copy in hash_copy(); StringHashCrypto::ensureLinked moved to hash_final() only.

Still red — AOT execute

VM + JIT: test/repro/hash_context_incremental.php green
AOT: vendor/bin/phpunit test/aot/AotTest.php --filter hash_context_incremental → empty stdout (compile OK)
Bisect: emitting hash_init() JIT in the same binary appears to poison subsequent hash() echo output (even bare allocate() without property stores). Master cannot AOT-compile hash() at all (LLVM verify i32→i1 bridge); this branch fixes compile via StringHashCryptoPhp::callHelperBridge but runtime digest echo is still broken when HashContext builtins are linked.

Next step

PHP-in-PHP HashContextJitHelper + thin ABI (object-keyed incremental state), or gdb on c:main_before_php with PHP_COMPILER_LLVM_ASSERT=1
Reference: php-src ext/hash/hash.c php_hash_* context copy/finalize

Stdlib: advertise locale BCP-47 parsers on default 8.4.0-dev profile (#…

claim: PHP Compiler STD Lib Advanced — continuing hash JIT/AOT PR #17087 (AOT execute segfault)

hash: HashContext AOT slot layout + direct property access (#3357)

Progress update (advanced stdlib): continued PR #17087 branch.

VM: test/repro/hash_context_incremental.php green.

AOT bisect:

hash_init() only → runs OK
hash_update() / hash_copy() / hash_final() → segfault at c:main_before_php (master + branch)

Commits pushed: pre-register HashContext __hc* string slots in registerExternalClass; direct slot load/store in JitHashContext (avoid double __string__separate). VM unchanged; AOT read path still crashes.

Next: bisect whether loadStringPtrProperty returns null/corrupt vs HashContextRuntime/StringHashCrypto init when hash_final is linked; gdb/LLVM IR dump on minimal hash_copy binary.

Run handoff (2026-07-13) — partial progress on user-script hash AOT defer path; merge blocked by master-wide AOT regression.

Claim

claim: PHP Compiler Ext — I/O & Crypto — starting this run (hash AOT standalone digest bridges, PR #17897 / #3357).

Work pushed

Branch agent/issue-3357-hash-aot-standalone:

StringHashAlgos: user-script defer → inline HashAlgosRegistry LLVM (avoid nested HashAlgosJitHelper / broken __hashtable__ bridge)
StringHashCryptoJit: user-script defer → skip nested HashEqualsJitHelper; stub __compiler_hash_equals; keep StringHashCryptoLlvm EVP path

Verification

# VM — green
./script/phpunit.sh --filter 'HashModuleTest|hash_context_incremental'

# AOT — red on master (not hash-specific)
./script/docker-exec.sh -- bash -lc 'source script/php-env.sh && php bin/compile.php -o /tmp/h -r "echo \"hi\n\";"'
# Module verification failed: __value__writeHashtable signature mismatch (__value__* vs __hashtable__*)
# Persists even with StringHashCrypto::ensureStandaloneBodies commented out of ensureMinimalUserStandaloneBodies
./script/phpunit.sh --filter 'AotTest.*hash_context_incremental'  # compile exit 255

Blocker

Master user-script AOT is broken for all -r/examples compiles (echo-only repro fails LLVM module verify). Root cause is not isolated to hash crypto init — disabling StringHashCrypto in Context::ensureMinimalUserStandaloneBodies does not unblock. Likely recent standalone-init / helper-runtime / hashtable bridge regression (suspect commits around 8486e08e7 utf8, 36952166d mb_numericentity, 56c59024f helper ctors — needs bisect).

Next step

Bisect master AOT verify failure (writeHashtable / alloca %__hashtable__* pattern)
Re-run hash AOT fixtures + merge defer path once standalone init is green

claim: PHP Compiler Ext — I/O & Crypto — starting this run (hash_pbkdf2 AOT via StringHashCryptoLlvm PKCS5_PBKDF2_HMAC)

Hash AOT: OpenSSL PKCS5_PBKDF2_HMAC bridge for hash_pbkdf2 (#3357) (#…

Merged (hash_pbkdf2 AOT): #18750

Standalone user-script AOT hash_pbkdf2() now uses OpenSSL PKCS5_PBKDF2_HMAC in StringHashCryptoLlvm instead of the null __compiler_hash_pbkdf2 stub (exit 139 → correct digest).

Verification:

source script/php-env.sh
./script/phpunit.sh --filter 'AotTest.*hash_pbkdf2|AotTest.*hash_raw_output|AotTest.*hash_context|AotTest.*hash_hmac'
# OK (4 tests, 20 assertions)

Still open on #3357: hash_hkdf AOT stub, hash_hmac_algos AOT segfault (pre-existing on master).

php-in-php: hash standalone defer — skip nested hash_algos/hash_equal…

claim: PHP Compiler Ext — I/O & Crypto — starting this run (hash_hkdf/hash_pbkdf2 AOT segfault on standalone user-script)

Merged via #18986.

Root cause: user-script standalone AOT defers nested PHP helpers (documented in UserScriptAotDeferNestedJit). bin2hex() still routed through nested Bin2hexJitHelper → segfault after strlen() on raw hash/HKDF/PBKDF2 output. Raw digests also used __string__init from stack alloca buffers → zero/incorrect payload bytes.

Fix: inline LLVM hex loop for bin2hex defer (mirrors StringHashCryptoLlvm hex path) + __string__alloc + memcpy for raw EVP/HKDF/PBKDF2 digests.

Verification (Docker):

./vendor/bin/phpunit --filter 'AotTest.*hash_raw|AotTest.*hash_hkdf|AotTest.*hash_pbkdf2|Bin2hexRuntimeShrinkTest'
# OK (6 tests, 34 assertions)

Hash AOT: LLVM bin2hex defer + memcpy raw digest strings (#3357) (#18986

php-in-php: delete StringHashCryptoLlvm — user-script AOT via JitVmHe…

claim: PHP Compiler Ext — I/O & Crypto — starting this run (hash_final AOT standalone returns raw digest not hex — hash_context_incremental AOT red)

Hash: fix hash_final() standalone AOT hex output (#3357) (#19181)

Merged via #19181.

Fix: standalone AOT hash_final() now hex-encodes via __compiler_bin2hex when $binary=false (was emitting raw 32-byte SHA-256).

Verification:

php vendor/bin/phpunit --filter 'hash_context_incremental|hash_raw_output'
# OK (9 tests, 17 assertions)

php-in-php: move hash_algos/hmac_algos inline registry LLVM to JitHas…

php-in-php: move StringHashCryptoLlvm to JitHashCryptoKernel (#19362) (…

Navigation Menu

Repository navigation

Stdlib: hash_init() / hash_update() / hash_final() / hash_copy() — incremental ext/hash API #3357

Category

Problem

php-src reference

Repro — incremental digest (GREEN on VM)

Repro — `hash_copy()` before finalize (FAIL / unverified)

Scope (this repo)

Done when (php-src-strict)

Verification

Links

48 remaining items

Claim

Work pushed

Verification

Blocker

Next step

Metadata

Assignees

Labels

Projects

Milestone

Relationships

Development

Stdlib: hash_init() / hash_update() / hash_final() / hash_copy() — incremental ext/hash API #3357

Description

Category

Problem

php-src reference

Repro — incremental digest (GREEN on VM)

Repro — hash_copy() before finalize (FAIL / unverified)

Scope (this repo)

Done when (php-src-strict)

Verification

Links

Activity

PurHur commented on Jul 7, 2026

PurHur commented on Jul 7, 2026

PurHur commented on Jul 7, 2026

PurHur commented on Jul 7, 2026

PurHur commented on Jul 7, 2026

PurHur commented on Jul 7, 2026

48 remaining items

PurHur commented on Jul 13, 2026

Claim

Work pushed

Verification

Blocker

Next step

PurHur commented on Jul 13, 2026

PurHur commented on Jul 13, 2026

PurHur commented on Jul 14, 2026

PurHur commented on Jul 14, 2026

PurHur commented on Jul 15, 2026

PurHur commented on Jul 15, 2026

Metadata

Metadata

Assignees

Labels

Projects

Milestone

Relationships

Development

Issue actions

Repro — `hash_copy()` before finalize (FAIL / unverified)