Package org.apache.druid.server

Class ServerManager

java.lang.Object

org.apache.druid.server.ServerManager

All Implemented Interfaces:

QuerySegmentWalker

public class ServerManager
extends Object
implements QuerySegmentWalker

Query handler for Historical processes (see CliHistorical).

In tests, this class's behavior is partially mimicked by TestClusterQuerySegmentWalker.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	ServerManager.LoadSegmentsResult
class	ServerManager.ResourceManagingQueryRunner<T>	QueryRunner that on run builds a set of QueryRunner for a set of SegmentDescriptor and merges them using the QueryToolChest.

Field Summary

Fields

Modifier and Type	Field	Description
protected final SegmentManager	segmentManager

Constructor Summary

Constructors

Constructor	Description
ServerManager(QueryRunnerFactoryConglomerate conglomerate, ServiceEmitter emitter, QueryProcessingPool queryProcessingPool, CachePopulator cachePopulator, com.fasterxml.jackson.databind.ObjectMapper objectMapper, Cache cache, CacheConfig cacheConfig, SegmentManager segmentManager, ServerConfig serverConfig, PolicyEnforcer policyEnforcer)

Method Summary

Modifier and Type	Method	Description
protected <T> QueryRunner<T>	buildQueryRunnerForSegment(SegmentDescriptor segmentDescriptor, Segment segment, QueryRunnerFactory<T,Query<T>> factory, QueryToolChest<T,Query<T>> toolChest, AtomicLong cpuTimeAccumulator, Optional<byte[]> cacheKeyPrefix)
protected ArrayList<SegmentReference>	getOrLoadBundleSegments(QueryPlus<?> queryPlus, LeafSegmentsBundle segmentsBundle, SegmentMapFunction segmentMapFunction)	Combines LeafSegmentsBundle.cachedSegments with LeafSegmentsBundle.loadableSegments, loading the latter set into the cache
protected ServerManager.LoadSegmentsResult	getOrLoadSegmentReferences(List<DataSegmentAndDescriptor> segmentsToMap, SegmentMapFunction segmentMapFunction, long timeout)	Given a list of DataSegmentAndDescriptor, uses SegmentManager.acquireSegment(DataSegment) for each to obtain a 'reference' to segments in the cache (or load from deep storage if necessary/supported by the storage layer).
protected <T> QueryRunnerFactory<T,Query<T>>	getQueryRunnerFactory(Query<T> query)
<T> QueryRunner<T>	getQueryRunnerForIntervals(Query<T> query, Iterable<org.joda.time.Interval> intervals)
<T> QueryRunner<T>	getQueryRunnerForSegments(Query<T> query, Iterable<SegmentDescriptor> specs)
protected <T> FunctionalIterable<QueryRunner<T>>	getQueryRunnersForSegments(Query<T> query, QueryRunnerFactory<T,Query<T>> factory, QueryToolChest<T,Query<T>> toolChest, List<SegmentReference> segmentReferences, AtomicLong cpuTimeAccumulator, Optional<byte[]> cacheKeyPrefix)
protected static <T> QueryToolChest<T,Query<T>>	getQueryToolChest(Query<T> query, QueryRunnerFactory<T,Query<T>> factory)
protected LeafSegmentsBundle	getSegmentsBundle(VersionedIntervalTimeline<String,DataSegment> timeline, Iterable<SegmentDescriptor> segments, SegmentMapFunction segmentMapFunction)	For each SegmentDescriptor, we try to obtain a DataSegment from the supplied VersionedIntervalTimeline to create a LeafSegmentsBundle which contains the partitioned segments into 3 groups: those which are already present in the cache, those which can be loaded on demand, and those which were missing from the VersionedIntervalTimeline.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

segmentManager

protected final SegmentManager segmentManager

Constructor Details

ServerManager

@Inject
public ServerManager(QueryRunnerFactoryConglomerate conglomerate,
 ServiceEmitter emitter,
 QueryProcessingPool queryProcessingPool,
 CachePopulator cachePopulator,
 com.fasterxml.jackson.databind.ObjectMapper objectMapper,
 Cache cache,
 CacheConfig cacheConfig,
 SegmentManager segmentManager,
 ServerConfig serverConfig,
 PolicyEnforcer policyEnforcer)

Method Details

getQueryRunnerForIntervals

public <T> QueryRunner<T> getQueryRunnerForIntervals(Query<T> query,
 Iterable<org.joda.time.Interval> intervals)

Specified by:

getQueryRunnerForIntervals in interface QuerySegmentWalker

getQueryRunnerForSegments

public <T> QueryRunner<T> getQueryRunnerForSegments(Query<T> query,
 Iterable<SegmentDescriptor> specs)

Specified by:

getQueryRunnerForSegments in interface QuerySegmentWalker

getSegmentsBundle

protected LeafSegmentsBundle getSegmentsBundle(VersionedIntervalTimeline<String,DataSegment> timeline,
 Iterable<SegmentDescriptor> segments,
 SegmentMapFunction segmentMapFunction)

For each SegmentDescriptor, we try to obtain a DataSegment from the supplied VersionedIntervalTimeline to create a LeafSegmentsBundle which contains the partitioned segments into 3 groups: those which are already present in the cache, those which can be loaded on demand, and those which were missing from the VersionedIntervalTimeline.

getOrLoadBundleSegments

protected ArrayList<SegmentReference> getOrLoadBundleSegments(QueryPlus<?> queryPlus,
 LeafSegmentsBundle segmentsBundle,
 SegmentMapFunction segmentMapFunction)

Combines LeafSegmentsBundle.cachedSegments with LeafSegmentsBundle.loadableSegments, loading the latter set into the cache

getOrLoadSegmentReferences

protected ServerManager.LoadSegmentsResult getOrLoadSegmentReferences(List<DataSegmentAndDescriptor> segmentsToMap,
 SegmentMapFunction segmentMapFunction,
 long timeout)

Given a list of DataSegmentAndDescriptor, uses SegmentManager.acquireSegment(DataSegment) for each to obtain a 'reference' to segments in the cache (or load from deep storage if necessary/supported by the storage layer).

For each of these segments, we then apply a SegmentMapFunction to prepare for processing. The returned SegmentReference MUST BE CLOSED to release the reference.

getQueryRunnersForSegments

protected <T> FunctionalIterable<QueryRunner<T>> getQueryRunnersForSegments(Query<T> query,
 QueryRunnerFactory<T,Query<T>> factory,
 QueryToolChest<T,Query<T>> toolChest,
 List<SegmentReference> segmentReferences,
 AtomicLong cpuTimeAccumulator,
 Optional<byte[]> cacheKeyPrefix)

buildQueryRunnerForSegment

protected <T> QueryRunner<T> buildQueryRunnerForSegment(SegmentDescriptor segmentDescriptor,
 Segment segment,
 QueryRunnerFactory<T,Query<T>> factory,
 QueryToolChest<T,Query<T>> toolChest,
 AtomicLong cpuTimeAccumulator,
 Optional<byte[]> cacheKeyPrefix)

getQueryRunnerFactory

protected <T> QueryRunnerFactory<T,Query<T>> getQueryRunnerFactory(Query<T> query)

getQueryToolChest

protected static <T> QueryToolChest<T,Query<T>> getQueryToolChest(Query<T> query,
 QueryRunnerFactory<T,Query<T>> factory)