PCollection data sampling for Java SDK harness #25064 - #25354

Merged

lukecwik merged 43 commits into

apache:masterfrom

rohdesamuel:data-sampling-java

Feb 22, 2023

Commits on Feb 13, 2023

Data Sampling Java Impl

Sam Rohde
authored and
rohdesamuel
committed
cd630e4
comments

Sam Rohde
authored and
rohdesamuel
committed
e530d14
add PBD id to context
rohdesamuel
committed
a09f5d6
merge

Sam Rohde
authored and
rohdesamuel
committed
1cb08f9
Add more tests and spotless

Sam Rohde
authored and
rohdesamuel
committed
566c7b8
Finish Java data sampling impl with tests, adding comments

Sam Rohde
authored and
rohdesamuel
committed
7395a2e
more comments, remove Payload

Sam Rohde
authored and
rohdesamuel
committed
4c1253f
more comments

Sam Rohde
authored and
rohdesamuel
committed
3d88254
spotless

Sam Rohde
authored and
rohdesamuel
committed
5bbef91
Encode in the nested context
rohdesamuel
committed
6993b83
Update sdks/java/harness/src/main/java/org/apache/beam/fn/harness/control/ProcessBundleHandler.java

rohdesamuel
and
lukecwik
committed
769902f
Apply suggestions from code review

rohdesamuel
and
lukecwik
committed
5c06d4e
address pr comments

Sam Rohde
authored and
rohdesamuel
committed
99087e8
give default pbd id to test context
rohdesamuel
committed
5609e4a
address spotlesscheck
rohdesamuel
committed
694c929
spotless apply
rohdesamuel
committed
519aece
style guide spotless apply
rohdesamuel
committed
8efbb15
add serviceloader
rohdesamuel
committed
cd3732d
change datasampling to modify the consumers and not graph for sampling
rohdesamuel
committed
415e3f0
remove redundant SamplerState obj
rohdesamuel
committed
553fc5e
spotless
rohdesamuel
committed
e260eb4
replace mutex with atomics in output sampler to reduce contention
rohdesamuel
committed
4f29308
spotless and fix OutputSamplerTest
rohdesamuel
committed
8cbc6c8
Update sdks/java/harness/src/main/java/org/apache/beam/fn/harness/data/PCollectionConsumerRegistry.java

rohdesamuel
and
lukecwik
committed
f67234f
Update sdks/java/harness/src/main/java/org/apache/beam/fn/harness/data/PCollectionConsumerRegistry.java

rohdesamuel
and
lukecwik
committed
6815330
Update sdks/java/harness/src/main/java/org/apache/beam/fn/harness/debug/OutputSampler.java

rohdesamuel
and
lukecwik
committed
4848725
always init outputsampler
rohdesamuel
committed
6c16576
add final to DataSampler in FnHarness
rohdesamuel
committed
822587d
spotless apply
rohdesamuel
committed
fe9ab2a
update from proto names
rohdesamuel
committed
07d37ea

Commits on Feb 14, 2023

spotless bugs
Sam Rohde
committed
5e9c4b0
Apply suggestions from code review

rohdesamuel
and
lukecwik
authored
f5f97fb
address pr comments
Sam Rohde
committed
c3db7c0

Commits on Feb 15, 2023

spotlessapply and add byte[] test
Sam Rohde
committed
fce6d69
validate datasampler args
Sam Rohde
committed
69d8bb4
add concurrency tests
Sam Rohde
committed
be2ebe4

Commits on Feb 21, 2023

Commits on Feb 22, 2023

improve contention tests
Sam Rohde
committed
862439b
spotless
Sam Rohde
committed
490be4a