At work, I’m being overtaken by the Storm. But I’ll be damned if I get sucked back into Java programming without some kicking and screaming. I’ll definitely be giving Petrel a whirl
Tools for writing, submitting, debugging, and monitoring Storm topologies in pure Python.
…
Petrel offers some important improvements over the storm.py module provided with Storm:
- Topologies are implemented in 100% Python
- Petrel’s packaging support automatically sets up a Python virtual environment for your topology and makes it easy to install additional Python packages.
- “petrel.mock” allows testing of single components or single chains of related components.
- Petrel automatically sets up logging for every spout or bolt and logs a stack trace on unhandled errors.
And just in case you’re looking for an alternative to Storm, don’t forget Yahoo!’s, now Apache’s, S4. While not as fashionable, S4 is definitely comparable.