Skip to main content

Module create_flow

Module create_flow 

Source

Modulesยง

metadata ๐Ÿ”’

Structsยง

CreateFlowData
The serializable data.
CreateFlowProcedure
The procedure of flow creation.

Enumsยง

CreateFlowState
The state of CreateFlowProcedure.
FlowType
The type of flow.

Constantsยง

DEFER_ON_MISSING_SOURCE_KEY
The flow option key for creating pending flow metadata when source tables do not exist.
FLOW_EXPERIMENTAL_ENABLE_INCREMENTAL_READ_KEY
FLOW_SCHEDULED_TIME_MILLIS_EXTENSION_KEY ๐Ÿ”’
INTERNAL_EVAL_OFFSET_KEY
Internal transient key used to pass the typed EVAL OFFSET (whole seconds) from the operator to meta through CreateFlowExpr.flow_options. Inserted by the operator only after user option validation; parsed and stripped by CreateFlowTask::try_from. Must never be accepted as a user-provided option and must never be persisted into FlowInfoValue.options or be visible in user runtime options / SHOW CREATE.
INTERNAL_EVAL_SCHEDULE_KEY
Internal transient key used to pass the serialized FlowScheduleConfig from meta to flownode through CreateRequest.flow_options. This key must never be accepted as a user-provided option and must never be persisted into FlowInfoValue.options. TODO(discord9): Replace this transient flow_options transport with a typed field in the flow create request.

Functionsยง

ceil_to_boundary ๐Ÿ”’
Computes the ceiling of time to the next schedule boundary aligned with anchor + k * interval. All values are Unix timestamps in seconds.
ceil_to_whole_sec ๐Ÿ”’
Rounds a Utc instant up to the next whole second (Unix seconds), with nanosecond precision.
ceil_whole_sec_from_parts ๐Ÿ”’
Pure ceiling computation factored out of ceil_to_whole_sec so the overflow path is testable: chrono::DateTime<Utc> cannot represent instants near i64::MAX seconds, but the arithmetic below guards it anyway.
defer_on_missing_source
effective_eval_schedule_from_flow_info
Returns the effective typed schedule config for flow metadata.
get_flow_type_from_options
resolve_schedule_defaults_into_task ๐Ÿ”’
Resolve FlowScheduleConfig into task.eval_schedule.
user_runtime_flow_options ๐Ÿ”’
validate_flow_options
without_scheduled_time_extension ๐Ÿ”’