Module batching_mode

Run flow as batching mode which is time-window-aware normal query triggered when new data arrives

Modules

• engine 🔒
  Batching mode engine
• frontend_client 🔒
  Frontend client to run flow as batching task which is time-window-aware normal query triggered every tick set by user
• state 🔒
  Batching mode task state, which changes frequently
• task 🔒
• time_window 🔒
  Time window expr and helper functions
• utils 🔒
  some utils for helping with batching mode

Constants

• DEFAULT_BATCHING_ENGINE_QUERY_TIMEOUT
  TODO(discord9): make those constants configurable The default batching engine query timeout is 10 minutes
• MIN_REFRESH_DURATION 🔒
  The minimum duration between two queries execution by batching mode task
• SLOW_QUERY_THRESHOLD
  will output a warn log for any query that runs for more that 1 minutes, and also every 1 minutes when that query is still running