Module adapter

Source
Expand description

for getting data from source and sending results to sink and communicating with other parts of the database

Modulesยง

flownode_impl ๐Ÿ”’
impl FlowNode trait for FlowNodeManager so standalone can call them
node_context ๐Ÿ”’
Node context, prone to change with every incoming requests
parse_expr ๐Ÿ”’
parse expr like โ€œts <= now() - interval โ€˜5 mโ€™โ€
refill ๐Ÿ”’
This module contains the refill flow task, which is used to refill flow with given table id and a time range.
stat ๐Ÿ”’
table_source ๐Ÿ”’
How to query table information from database
util ๐Ÿ”’
Util functions for adapter
worker ๐Ÿ”’
For single-thread flow worker

Structsยง

FlowConfig
Flow config that exists both in standalone&distributed mode
FlowTickManager
FlowTickManager is a manager for flow tick, which trakc flow execution progress
FlownodeOptions
Options for flow node
StreamingEngine
FlowNodeManager manages the state of all tasks in the flow node, which should be run on the same thread

Enumsยง

DiffRequest

Constantsยง

AUTO_CREATED_PLACEHOLDER_TS_COL
AUTO_CREATED_UPDATE_AT_TS_COL

Functionsยง

batches_to_rows_req

Type Aliasesยง

FlowStreamingEngineRef
Arc-ed FlowNodeManager, cheaper to clone