Package org.apache.druid.tasklogs

Class SwitchingTaskLogs

java.lang.Object

org.apache.druid.tasklogs.SwitchingTaskLogs

All Implemented Interfaces:

TaskLogKiller, TaskLogPusher, TaskLogs, TaskLogStreamer, TaskPayloadManager

public class SwitchingTaskLogs
extends Object
implements TaskLogs

Implements TaskLogs by delegating to different task log providers based on the functionality required. This allows for different handling of reports, streaming logs, and pushing logs with a default fallback.

Field Summary

Fields

Modifier and Type	Field	Description
static final String	NAME_DEFAULT_TYPE
static final String	NAME_LOG_PUSH_TYPE
static final String	NAME_LOG_STREAM_TYPE
static final String	NAME_REPORTS_TYPE
static final String	PROPERTY_DEFAULT_TYPE
static final String	PROPERTY_LOG_PUSH_TYPE
static final String	PROPERTY_LOG_STREAM_TYPE
static final String	PROPERTY_PREFIX
static final String	PROPERTY_REPORTS_TYPE

Constructor Summary

Constructors

Constructor	Description
SwitchingTaskLogs(TaskLogs defaultDelegate, TaskLogs reportsDelegate, TaskLogs logStreamer, TaskLogs logPusher)

Method Summary

Modifier and Type	Method	Description
void	killAll()
void	killOlderThan(long timestamp)	Removes logs older than the provided timestamp
void	pushTaskLog(String taskid, File logFile)
void	pushTaskPayload(String taskid, File taskPayloadFile)	Save payload so it can be retrieved later.
void	pushTaskReports(String taskid, File reportFile)
void	pushTaskStatus(String taskid, File reportFile)
com.google.common.base.Optional<InputStream>	streamTaskLog(String taskid, long offset)	Stream log for a task.
com.google.common.base.Optional<InputStream>	streamTaskPayload(String taskid)	Stream payload for a task.
com.google.common.base.Optional<InputStream>	streamTaskReports(String taskid)
com.google.common.base.Optional<InputStream>	streamTaskStatus(String taskid)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

PROPERTY_PREFIX

public static final String PROPERTY_PREFIX

See Also:

• Constant Field Values

PROPERTY_DEFAULT_TYPE

public static final String PROPERTY_DEFAULT_TYPE

See Also:

• Constant Field Values

PROPERTY_LOG_PUSH_TYPE

public static final String PROPERTY_LOG_PUSH_TYPE

See Also:

• Constant Field Values

PROPERTY_LOG_STREAM_TYPE

public static final String PROPERTY_LOG_STREAM_TYPE

See Also:

• Constant Field Values

PROPERTY_REPORTS_TYPE

public static final String PROPERTY_REPORTS_TYPE

See Also:

• Constant Field Values

NAME_REPORTS_TYPE

public static final String NAME_REPORTS_TYPE

See Also:

• Constant Field Values

NAME_LOG_STREAM_TYPE

public static final String NAME_LOG_STREAM_TYPE

See Also:

• Constant Field Values

NAME_LOG_PUSH_TYPE

public static final String NAME_LOG_PUSH_TYPE

See Also:

• Constant Field Values

NAME_DEFAULT_TYPE

public static final String NAME_DEFAULT_TYPE

See Also:

• Constant Field Values

Constructor Details

SwitchingTaskLogs

@Inject
public SwitchingTaskLogs(@Nullable
 TaskLogs defaultDelegate,
 @Nullable
 TaskLogs reportsDelegate,
 @Nullable
 TaskLogs logStreamer,
 @Nullable
 TaskLogs logPusher)

Method Details

streamTaskLog

public com.google.common.base.Optional<InputStream> streamTaskLog(String taskid,
 long offset)
                                                           throws IOException

Description copied from interface: TaskLogStreamer

Stream log for a task.

Specified by:

streamTaskLog in interface TaskLogStreamer

Parameters:

offset - If zero, stream the entire log. If positive, attempt to read from this position onwards. If negative, attempt to read this many bytes from the end of the file (like tail -n).

Returns:

inputStream for this log, if available

Throws:

IOException

streamTaskReports

public com.google.common.base.Optional<InputStream> streamTaskReports(String taskid)
                                                               throws IOException

Specified by:

streamTaskReports in interface TaskLogStreamer

Throws:

IOException

streamTaskStatus

public com.google.common.base.Optional<InputStream> streamTaskStatus(String taskid)
                                                              throws IOException

Specified by:

streamTaskStatus in interface TaskLogStreamer

Throws:

IOException

pushTaskLog

public void pushTaskLog(String taskid,
 File logFile)
                 throws IOException

Specified by:

pushTaskLog in interface TaskLogPusher

Throws:

IOException

pushTaskPayload

public void pushTaskPayload(String taskid,
 File taskPayloadFile)
                     throws IOException

Description copied from interface: TaskPayloadManager

Save payload so it can be retrieved later.

Specified by:

pushTaskPayload in interface TaskPayloadManager

Throws:

IOException

killAll

public void killAll()
             throws IOException

Specified by:

killAll in interface TaskLogKiller

Throws:

IOException

killOlderThan

public void killOlderThan(long timestamp)
                   throws IOException

Description copied from interface: TaskLogKiller

Removes logs older than the provided timestamp

Specified by:

killOlderThan in interface TaskLogKiller

Parameters:

timestamp - Timestamp in milliseconds

Throws:

IOException

pushTaskReports

public void pushTaskReports(String taskid,
 File reportFile)
                     throws IOException

Specified by:

pushTaskReports in interface TaskLogPusher

Throws:

IOException

pushTaskStatus

public void pushTaskStatus(String taskid,
 File reportFile)
                    throws IOException

Specified by:

pushTaskStatus in interface TaskLogPusher

Throws:

IOException

streamTaskPayload

public com.google.common.base.Optional<InputStream> streamTaskPayload(String taskid)
                                                               throws IOException

Description copied from interface: TaskPayloadManager

Stream payload for a task.

Specified by:

streamTaskPayload in interface TaskPayloadManager

Returns:

inputStream for this taskPayload, if available

Throws:

IOException