Package org.apache.beam.sdk.extensions.sketching

Class TDigestQuantiles.PerKeyDigest<K>

  • All Implemented Interfaces:
    java.io.Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData
    Enclosing class:
    TDigestQuantiles
    public abstract static class TDigestQuantiles.PerKeyDigest<K>
extends org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<K,​java.lang.Double>>,​org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<K,​com.tdunning.math.stats.MergingDigest>>>
    Implementation of TDigestQuantiles.perKey().
    See Also:
    Serialized Form

    • Field Summary

      • Fields inherited from class org.apache.beam.sdk.transforms.PTransform

        annotations, displayData, name, resourceHints

    • Constructor Summary

      Constructors 
      Constructor Description
      PerKeyDigest()  

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<K,​com.tdunning.math.stats.MergingDigest>> expand​(org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<K,​java.lang.Double>> input)  
      TDigestQuantiles.PerKeyDigest<K> withCompression​(double cf)
      Sets the compression factor cf.

      • Methods inherited from class org.apache.beam.sdk.transforms.PTransform

        addAnnotation, compose, compose, getAdditionalInputs, getAnnotations, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, populateDisplayData, setDisplayData, setResourceHints, toString, validate, validate

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

    • Constructor Detail

      • PerKeyDigest

        public PerKeyDigest()

    • Method Detail

      • withCompression

        public TDigestQuantiles.PerKeyDigest<K> withCompression​(double cf)
        Sets the compression factor cf.

        Keep in mind that a compression factor cf of c guarantees a relative error less than 3/c at mid quantiles.
        The accuracy will always be significantly less than 1% at extreme quantiles.

        Parameters:
        cf - the bound value for centroid and digest sizes.

      • expand

        public org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<K,​com.tdunning.math.stats.MergingDigest>> expand​(org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<K,​java.lang.Double>> input)
        Specified by:
        expand in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<K,​java.lang.Double>>,​org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<K,​com.tdunning.math.stats.MergingDigest>>>