1. Currently, Helix ensures even distribution of partitions within a
resource, not across resources. Is it possible for you to add tasks as part
of the same resource?
2. &3 Yes, you can start the controller as part of your process. But
since you said you launch this on Kubernetes every 5 minutes, I suggest
keeping controller and zookeeper running all the time. Controllers are
light weight and you can get away with a very an entry level container
spec. It's ok to launch Helix Participants every 5 minutes.
You should consider using Helix Task Framework
provides all the functionalities you need.
On Mon, Jun 19, 2017 at 7:24 AM, Shekhar Bansal <[EMAIL PROTECTED]>