Struct PipelineTable

pub struct PipelineTable {
    inserter: InserterRef,
    statement_executor: StatementExecutorRef,
    table: TableRef,
    query_engine: QueryEngineRef,
    pipelines: Cache<String, Arc<Pipeline<GreptimeTransformer>>>,
}

PipelineTable is a table that stores the pipeline schema and content. Every catalog has its own pipeline table.

Fields

inserter: InserterRef

statement_executor: StatementExecutorRef

table: TableRef

query_engine: QueryEngineRef

pipelines: Cache<String, Arc<Pipeline<GreptimeTransformer>>>

Implementations

impl PipelineTable

pub fn new( inserter: InserterRef, statement_executor: StatementExecutorRef, table: TableRef, query_engine: QueryEngineRef, ) -> Self

Create a new PipelineTable.

pub fn build_pipeline_schema() -> (String, Vec<String>, Vec<ColumnDef>)

Build the schema for the pipeline table. Returns the (time index, primary keys, column) definitions.

fn build_insert_column_schemas() -> Vec<PbColumnSchema>

Build the column schemas for inserting a row into the pipeline table.

fn query_ctx(table_info: &TableInfo) -> QueryContextRef

pub fn compile_pipeline(pipeline: &str) -> Result<Pipeline<GreptimeTransformer>>

Compile a pipeline from a string.

async fn insert_pipeline_to_pipeline_table( &self, schema: &str, name: &str, content_type: &str, pipeline: &str, ) -> Result<Timestamp>

Insert a pipeline into the pipeline table.

pub async fn get_pipeline( &self, schema: &str, name: &str, version: PipelineVersion, ) -> Result<Arc<Pipeline<GreptimeTransformer>>>

Get a pipeline by name. If the pipeline is not in the cache, it will be get from table and compiled and inserted into the cache.

pub async fn insert_and_compile( &self, schema: &str, name: &str, content_type: &str, pipeline: &str, ) -> Result<PipelineInfo>

Insert a pipeline into the pipeline table and compile it. The compiled pipeline will be inserted into the cache.

pub async fn delete_pipeline( &self, schema: &str, name: &str, version: PipelineVersion, ) -> Result<Option<()>>

async fn find_pipeline( &self, schema: &str, name: &str, version: PipelineVersion, ) -> Result<Option<(String, TimestampNanosecond)>>