Crate pipeline

Source

Modules§

dispatcher 🔒
error
etl 🔒
manager 🔒
metrics 🔒
pipeline_operator
table
tablesuffix 🔒
util

Macros§

yaml_map_get_str
Macro to extract a string value from a YAML map

Structs§

Array
DispatchedTo
Where the pipeline executed is dispatched to, with context information
GreptimePipelineParams
Parameters that can be used to configure the greptime pipelines.
GreptimeTransformer
fields not in the columns will be discarded to prevent automatic column creation in GreptimeDB
Map
Pipeline
PipelineContext
SchemaInfo
This is used to record the current state schema information and a sequential cache of field names. As you traverse the user input JSON, this will change. It will record a superset of all user input schemas.
SelectInfo
SelectInfo is used to store the selected keys from OpenTelemetry record attrs The key is used to uplift value from the attributes and serve as column name in the table

Enums§

Content
IdentityTimeIndex
PipelineDefinition
Enum for holding information of a pipeline, which is either pipeline itself, or information that be used to retrieve a pipeline from PipelineHandler
PipelineExecOutput
The result of pipeline execution
PipelineWay
Value
Value can be used as type acts as value: the enclosed value is the actual value acts as type: the enclosed value is the default value

Constants§

GREPTIME_INTERNAL_IDENTITY_PIPELINE_NAME
GREPTIME_INTERNAL_TRACE_PIPELINE_V1_NAME

Traits§

Processor
Processor trait defines the interface for all processors.

Functions§

identity_pipeline
Identity pipeline for Greptime This pipeline will convert the input JSON array to Greptime Rows params table is used to set the semantic type of the row key column to Tag
json_array_to_map
json_to_map
parse
simd_json_array_to_map
simd_json_to_map

Type Aliases§

PipelineInfo
Pipeline info. A tuple of timestamp and pipeline reference.
PipelineMap
PipelineRef
PipelineTableRef
PipelineVersion
Pipeline version. An optional timestamp with nanosecond precision.