Package org.apache.druid.segment

Class StringDimensionMergerV9

java.lang.Object

org.apache.druid.segment.DictionaryEncodedColumnMerger<String>

org.apache.druid.segment.StringDimensionMergerV9

All Implemented Interfaces:

DimensionMerger, DimensionMergerV9

public class StringDimensionMergerV9
extends DictionaryEncodedColumnMerger<String>

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
class	StringDimensionMergerV9.SpatialIndexesMerger	Write spatial indexes for string columns that have them

Nested classes/interfaces inherited from class org.apache.druid.segment.DictionaryEncodedColumnMerger

DictionaryEncodedColumnMerger.ConvertingBitmapValues, DictionaryEncodedColumnMerger.ExtendedIndexesMerger, DictionaryEncodedColumnMerger.IdConversionSerializer, DictionaryEncodedColumnMerger.IndexSeeker, DictionaryEncodedColumnMerger.IndexSeekerWithConversion, DictionaryEncodedColumnMerger.IndexSeekerWithoutConversion, DictionaryEncodedColumnMerger.PersistedIdConversion, DictionaryEncodedColumnMerger.PersistedIdConversions

Field Summary

Fields

Modifier and Type	Field	Description
static final Comparator<Pair<Integer,com.google.common.collect.PeekingIterator<String>>>	DICTIONARY_MERGING_COMPARATOR

Fields inherited from class org.apache.druid.segment.DictionaryEncodedColumnMerger

adapters, bitmapWriter, capabilities, cardinality, closer, dictionaryMergeIterator, dictionarySize, dictionaryWriter, dimConversions, dimensionName, encodedValueSerializer, firstDictionaryValue, hasNull, indexSpec, nullRowsBitmap, outputName, persistedIdConversions, progress, rowCount, segmentBaseDir, segmentWriteOutMedium, writeDictionary

Constructor Summary

Constructors

Constructor	Description
StringDimensionMergerV9(String dimensionName, String outputName, IndexSpec indexSpec, SegmentWriteOutMedium segmentWriteOutMedium, ColumnCapabilities capabilities, ProgressIndicator progress, File segmentBaseDir, Closer closer)

Method Summary

Modifier and Type	Method	Description
void	attachParent(DimensionMergerV9 parent, List<IndexableAdapter> projectionAdapters)	Attaches the DimensionMergerV9 of a "projection" parent column so that stuff like value dictionaries can be shared between parent and child.
protected String	coerceValue(String value)
protected Comparator<Pair<Integer,com.google.common.collect.PeekingIterator<String>>>	getDictionaryMergingComparator()
protected DictionaryEncodedColumnMerger.ExtendedIndexesMerger	getExtendedIndexesMerger()
protected Indexed<String>	getNullDimValue()
protected ObjectStrategy<String>	getObjectStrategy()
ColumnDescriptor	makeColumnDescriptor()	Return a ColumnDescriptor containing ColumnPartSerde objects appropriate for this DimensionMerger's value metadata, sequence of row values, and index structures.
protected DictionaryWriter<String>	makeDictionaryWriter(String fileName)

Methods inherited from class org.apache.druid.segment.DictionaryEncodedColumnMerger

convertSortedSegmentRowValuesToMergedRowValues, hasOnlyNulls, markAsParent, mergeBitmaps, processMergedRow, setupEncodedValueWriter, toIndexSeekers, writeDictionary, writeIndexes, writeMergedValueDictionary

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

DICTIONARY_MERGING_COMPARATOR

public static final Comparator<Pair<Integer,com.google.common.collect.PeekingIterator<String>>> DICTIONARY_MERGING_COMPARATOR

Constructor Details

StringDimensionMergerV9

public StringDimensionMergerV9(String dimensionName,
 String outputName,
 IndexSpec indexSpec,
 SegmentWriteOutMedium segmentWriteOutMedium,
 ColumnCapabilities capabilities,
 ProgressIndicator progress,
 File segmentBaseDir,
 Closer closer)

Parameters:

dimensionName - column name

outputName - output smoosh file name. if this is a base table column, it will be the equivalent to name, however if this merger is for a projection, this will be prefixed with the projection name so that multiple projections can store the same column name at different smoosh file "paths"

indexSpec - segment level storage options such as compression format and bitmap type

segmentWriteOutMedium - temporary storage location to stage segment outputs before finalizing into the segment

capabilities - options for writing the column such as if we should write bitmap or spatial indexes

progress - hook to update status of what this merger is doing during segment persist and merging

closer - resource closer if this merger needs to attach any closables that should be cleaned up when the segment is finished writing

Method Details

getDictionaryMergingComparator

protected Comparator<Pair<Integer,com.google.common.collect.PeekingIterator<String>>> getDictionaryMergingComparator()

Specified by:

getDictionaryMergingComparator in class DictionaryEncodedColumnMerger<String>

getNullDimValue

protected Indexed<String> getNullDimValue()

Specified by:

getNullDimValue in class DictionaryEncodedColumnMerger<String>

getObjectStrategy

protected ObjectStrategy<String> getObjectStrategy()

Specified by:

getObjectStrategy in class DictionaryEncodedColumnMerger<String>

coerceValue

protected String coerceValue(String value)

Specified by:

coerceValue in class DictionaryEncodedColumnMerger<String>

makeDictionaryWriter

protected DictionaryWriter<String> makeDictionaryWriter(String fileName)

Overrides:

makeDictionaryWriter in class DictionaryEncodedColumnMerger<String>

getExtendedIndexesMerger

@Nullable
protected DictionaryEncodedColumnMerger.ExtendedIndexesMerger getExtendedIndexesMerger()

Overrides:

getExtendedIndexesMerger in class DictionaryEncodedColumnMerger<String>

makeColumnDescriptor

public ColumnDescriptor makeColumnDescriptor()

Description copied from interface: DimensionMergerV9

Return a ColumnDescriptor containing ColumnPartSerde objects appropriate for this DimensionMerger's value metadata, sequence of row values, and index structures.

Returns:

ColumnDescriptor that IndexMergerV9 will use to build a column.

attachParent

public void attachParent(DimensionMergerV9 parent,
 List<IndexableAdapter> projectionAdapters)
                  throws IOException

Description copied from interface: DimensionMergerV9

Attaches the DimensionMergerV9 of a "projection" parent column so that stuff like value dictionaries can be shared between parent and child. This method is called during merging instead of DimensionMerger.writeMergedValueDictionary(List) if the parent column exists.

Throws:

IOException

See Also:

• IndexMergerV9.makeProjections(org.apache.druid.java.util.common.io.smoosh.FileSmoosher, java.util.List<org.apache.druid.segment.AggregateProjectionMetadata>, java.util.List<org.apache.druid.segment.IndexableAdapter>, org.apache.druid.segment.IndexSpec, org.apache.druid.segment.writeout.SegmentWriteOutMedium, org.apache.druid.segment.ProgressIndicator, java.io.File, org.apache.druid.java.util.common.io.Closer, java.util.Map<java.lang.String, org.apache.druid.segment.DimensionMergerV9>, org.apache.druid.segment.Metadata)