Package org.apache.beam.runners.spark.structuredstreaming.translation.helpers

Class EncoderHelpers.Utils

java.lang.Object
org.apache.beam.runners.spark.structuredstreaming.translation.helpers.EncoderHelpers.Utils
Enclosing class:
EncoderHelpers
public static class EncoderHelpers.Utils extends Object
Encoder / expression utils that are called from generated code.

  • Constructor Summary

    Constructors
    Constructor
    Description
    Utils()
     

  • Method Summary

    Modifier and Type
    Method
    Description
    static List<Object>
    copyToList(org.apache.spark.sql.catalyst.util.ArrayData arrayData, org.apache.spark.sql.types.DataType type)
     
    static org.joda.time.Instant
    maxTimestamp(Iterable<? extends org.apache.beam.sdk.transforms.windowing.BoundedWindow> windows)
    The maximum maxTimestamp across all associated windows.
    static org.apache.beam.sdk.transforms.windowing.PaneInfo
    paneInfoFromBytes(byte[] bytes)
     
    static byte[]
    paneInfoToBytes(org.apache.beam.sdk.transforms.windowing.PaneInfo paneInfo)
     
    static HashMap<Object,Object>
    toMap(org.apache.spark.sql.catalyst.util.ArrayData keys, org.apache.spark.sql.catalyst.util.ArrayData values, org.apache.spark.sql.types.DataType keyType, org.apache.spark.sql.types.DataType valueType)
     
    static scala.collection.Seq<Object>
    toSeq(Collection<Object> col)
     
    static scala.collection.Seq<Object>
    toSeq(org.apache.spark.sql.catalyst.util.ArrayData arrayData)
     
    static TreeMap<Object,Object>
    toTreeMap(org.apache.spark.sql.catalyst.util.ArrayData keys, org.apache.spark.sql.catalyst.util.ArrayData values, org.apache.spark.sql.types.DataType keyType, org.apache.spark.sql.types.DataType valueType)
     

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Constructor Details

    • Utils

      public Utils()

  • Method Details

    • paneInfoFromBytes

      public static org.apache.beam.sdk.transforms.windowing.PaneInfo paneInfoFromBytes(byte[] bytes)

    • paneInfoToBytes

      public static byte[] paneInfoToBytes(org.apache.beam.sdk.transforms.windowing.PaneInfo paneInfo)

    • maxTimestamp

      public static org.joda.time.Instant maxTimestamp(Iterable<? extends org.apache.beam.sdk.transforms.windowing.BoundedWindow> windows)
      The maximum maxTimestamp across all associated windows.

    • copyToList

      public static List<Object> copyToList(org.apache.spark.sql.catalyst.util.ArrayData arrayData, org.apache.spark.sql.types.DataType type)

    • toSeq

      public static scala.collection.Seq<Object> toSeq(org.apache.spark.sql.catalyst.util.ArrayData arrayData)

    • toSeq

      public static scala.collection.Seq<Object> toSeq(Collection<Object> col)

    • toTreeMap

      public static TreeMap<Object,Object> toTreeMap(org.apache.spark.sql.catalyst.util.ArrayData keys, org.apache.spark.sql.catalyst.util.ArrayData values, org.apache.spark.sql.types.DataType keyType, org.apache.spark.sql.types.DataType valueType)

    • toMap

      public static HashMap<Object,Object> toMap(org.apache.spark.sql.catalyst.util.ArrayData keys, org.apache.spark.sql.catalyst.util.ArrayData values, org.apache.spark.sql.types.DataType keyType, org.apache.spark.sql.types.DataType valueType)