Structsยง
- JSON_
CONTENT_ TYPE - LogIngester
Query Params - LogIngesterQueryParams is used for query params of log ingester API.
- LogState
- axum state struct to hold log handler and validator
- NDJSON_
CONTENT_ TYPE - PB_
CONTENT_ TYPE - Pipeline
Content - Pipeline
Dryrun Params - Dryrun pipeline with given data pipeline_name and pipeline_version to specify pipeline stored in db pipeline to specify pipeline raw content data to specify data data maght be list of string or list of object
- Pipeline
Ingest ๐Request - LogIngestRequest is the internal request for log ingestion. The raw log input can be transformed into multiple LogIngestRequests. Multiple LogIngestRequests will be ingested into the same database with the same pipeline.
- TEXT_
CONTENT_ TYPE - TEXT_
UTF8_ CONTENT_ TYPE
Constantsยง
Traitsยง
Functionsยง
- add_
pipeline - add_
step_ ๐info_ for_ pipeline_ dryrun_ error - check_
data_ ๐valid - Check if the data length less than 10
- check_
pipeline_ ๐dryrun_ params_ valid - Check if the payload is valid json Check if the payload contains pipeline or pipeline_name and data Return Some if valid, None if invalid
- check_
pipeline_ ๐name_ exists - Check if the pipeline_name exists
- delete_
pipeline - dryrun_
pipeline_ ๐inner - Dryrun pipeline with given data
- extract_
pipeline_ ๐value_ by_ content_ type - ingest_
logs_ ๐inner - log_
ingester - pipeline_
dryrun - query_
pipeline - transform_
ndjson_ ๐array_ factory - Transform NDJSON array into a single array always return an array