I've a Python script that implements a pretty long and complicated workflow (has multiple stages, each stage spawns multiple child processes in parallel, etc). I am looking for a tool that allows monitoring execution of this workflow:
- Can show me the tree of currently active processes (sort of like htop tree view).
- Can show me the tree of exited processes and their exit status.
- Can capture stdout/stderr of each (grand-)*child separately (unless piped, of course), and display when asked.
- Searching/filtering across multiple logs.
Ideally, all this should not require any changes in the monitored workflow scripts.