Announcement Announcement Module
Collapse
No announcement yet.
Modifying spring Batch to use Zookeeper Page Title Module
Move Remove Collapse
X
Conversation Detail Module
Collapse
  • Filter
  • Time
  • Show
Clear All
new posts

  • Modifying spring Batch to use Zookeeper

    Hi all,
    I'm new to Spring Batch, but I've used Quartz quite a bit in the past. We have a distributed environment that uses ZooKeeper to perform leader election, as well as keep grid jobs synchronized across our cluster. I've had a quick read of the documentation, has anyone implemented a grid partitioner that will work with Zookeeper? If not, where can I start?

    Thanks,
    Todd

  • #2
    I never saw anyone using ZooKeeper for partitioning, but I'd be interested to see if it works. You would probably only need to implement the PartitionHandler interface. There is one implementation in the framework, one in Spring Batch Integration (https://src.springframework.org/svn/...ion/partition/ trunk is broken right now during an upgrade to Spring Integration 2.0, but the 1.0 release works), and a couple at http://github.com/dsyer, if you want to browse and see how they work. It is normally pretty simple (I've done about 6 or 7 implementations and none was more than a few lines).

    Comment


    • #3
      Wrote a blog post about leader election with Zookeeper and Spring which also includes quartz support.

      Comment

      Working...
      X