Class DatasourceDefn


  • public class DatasourceDefn
    extends TableDefn
    • Field Detail

      • SEGMENT_GRANULARITY_PROPERTY

        public static final String SEGMENT_GRANULARITY_PROPERTY
        Segment grain at ingestion and initial compaction. Aging rules may override the value as segments age. If not provided here, then it must be provided at ingestion time.
        See Also:
        Constant Field Values
      • ALL_GRANULARITY

        public static final String ALL_GRANULARITY
        Catalog property value for the "all time" granularity.
        See Also:
        Constant Field Values
      • TARGET_SEGMENT_ROWS_PROPERTY

        public static final String TARGET_SEGMENT_ROWS_PROPERTY
        The target segment size at ingestion and initial compaction. If unset, then the system setting is used.
        See Also:
        Constant Field Values
      • CLUSTER_KEYS_PROPERTY

        public static final String CLUSTER_KEYS_PROPERTY
        The clustering column names and sort order for each new segment.
        See Also:
        Constant Field Values
      • HIDDEN_COLUMNS_PROPERTY

        public static final String HIDDEN_COLUMNS_PROPERTY
        The set of existing columns to "delete" (actually, just hide) from the SQL layer. Used to "remove" unwanted columns to avoid the need to rewrite existing segments to accomplish the task.
        See Also:
        Constant Field Values
      • SEALED_PROPERTY

        public static final String SEALED_PROPERTY
        By default: columns are optional hints. If a datasource has columns defined, well validate them, but MSQ and other tools are free to create additional columns. That is, we assume "auto-discovered" columns by default. However, in some use cases, the schema may be carefully designed. This is especially true for ETL use cases in which multiple input schemas are mapped into a single datasource schema designed for ease of end user use. In this second use case, we may want to reject an attempt to ingest columns other than those in the schema. To do that, set sealed = true. In other words, "sealed" mode works like a traditional RDBMS.
        See Also:
        Constant Field Values
    • Constructor Detail

      • DatasourceDefn

        public DatasourceDefn()
    • Method Detail

      • validateColumn

        protected void validateColumn​(ColumnSpec spec)
        Description copied from class: TableDefn
        Table-specific validation of a column spec. Override for table definitions that need table-specific validation rules.
        Overrides:
        validateColumn in class TableDefn
      • isDatasource

        public static boolean isDatasource​(String tableType)
      • isDatasource

        public static boolean isDatasource​(ResolvedTable table)