Package org.apache.druid.segment.incremental

Interface RowIngestionMeters

All Superinterfaces:
InputStats
All Known Implementing Classes:
NoopRowIngestionMeters, SimpleRowIngestionMeters
public interface RowIngestionMeters extends InputStats
A collection of meters for row ingestion stats, with support for moving average calculations. This can eventually replace SegmentGenerationMetrics, but moving averages for other stats collected by SegmentGenerationMetrics are not currently supported, so we continue to use SegmentGenerationMetrics alongside RowIngestionMeters to avoid unnecessary overhead from maintaining these moving averages.

  • Field Details

    • BUILD_SEGMENTS

      static final String BUILD_SEGMENTS
      See Also:

    • DETERMINE_PARTITIONS

      static final String DETERMINE_PARTITIONS
      See Also:

    • PROCESSED

      static final String PROCESSED
      See Also:

    • PROCESSED_WITH_ERROR

      static final String PROCESSED_WITH_ERROR
      See Also:

    • UNPARSEABLE

      static final String UNPARSEABLE
      See Also:

    • THROWN_AWAY

      static final String THROWN_AWAY
      See Also:

    • THROWN_AWAY_BY_REASON

      static final String THROWN_AWAY_BY_REASON
      See Also:

    • PROCESSED_BYTES

      static final String PROCESSED_BYTES
      Number of bytes read by an ingestion task. Note: processedBytes is a misleading name; this generally measures size when data is initially read or fetched, not when it is processed by the ingest task. It's measuring a stage somewhat earlier in the pipeline. In other words, "processed" and "processedBytes" do not use the same definition of "process". A better name might be "bytesRead" or "inputBytes", although if we change it, we must consider compatibility with existing readers.
      See Also:

  • Method Details

    • getProcessed

      long getProcessed()

    • incrementProcessed

      void incrementProcessed()

    • incrementProcessedBytes

      default void incrementProcessedBytes(long incrementByValue)
      Specified by:
      incrementProcessedBytes in interface InputStats

    • getProcessedBytes

      default long getProcessedBytes()
      Specified by:
      getProcessedBytes in interface InputStats

    • getProcessedWithError

      long getProcessedWithError()

    • incrementProcessedWithError

      void incrementProcessedWithError()

    • getUnparseable

      long getUnparseable()

    • incrementUnparseable

      void incrementUnparseable()

    • getThrownAway

      long getThrownAway()

    • incrementThrownAway

      void incrementThrownAway(InputRowFilterResult reason)
      Increments the thrown away counter for the specified InputRowFilterResult reason.

    • getThrownAwayByReason

      Map<String,Long> getThrownAwayByReason()
      Returns the count of thrown away events for each reason. Keyed by InputRowFilterResult.getReason().

    • getTotals

      RowIngestionMetersTotals getTotals()

    • getMovingAverages

      Map<String,Object> getMovingAverages()