I search a parallel execution library for Python.
There are two in the standard library:
I discovered, that simple tasks like handling timeouts are not easy with the standard library tools. Handle multiprocessing.TimeoutError in multiprocessing
Some years ago I used celery, but this is too big for my current use case.
- Serverless on local machine
- Should run on linux. Windows/Mac support not needed.
- Sane handling of ctrl-c
- Later, extending to compute on other machines should require only few source code changes.
- Optional: GUI for browsing job results.