OverviewΒΆ

Consecution is:
  • An easy-to-use pipeline abstraction inspired by Apache Storm Topologies.
  • Designed to simplify building ETL pipelines that are robust and easy to test
  • A system for wiring together simple processing nodes to form a DAG, which is fed with a python iterable
  • Built using synchronous, single-threaded execution strategies designed to run efficiently on a single core
  • Implemented in pure-python with optional requirements that are needed only for graph visualization
  • Written with 100% test coverage

See the Github project page. for examples of how to use consecution.