Announcement Announcement Module
Collapse
No announcement yet.
Spring Batch Remote Chunking and Parallel Processing example Page Title Module
Move Remove Collapse
X
Conversation Detail Module
Collapse
  • Filter
  • Time
  • Show
Clear All
new posts

  • Spring Batch Remote Chunking and Parallel Processing example

    Are there any Spring Batch code samples available on the web that show how to perform remote chunking or parallel processing using JMS or RMI? I am working on a POC and looking for an easy way to implement remote chunking since our data can be split into chunks easily. I can see huge benefits to being able to push work out to remote nodes within our Weblogic environment.

  • #2
    Yup,

    Have a look to the "spring-batch-integration" module in the "spring-batch-admin" project. It defines various use cases like remote chunking using Spring integration.

    I have posted a spring integration config sample for a JMS-based message gateway. You could use that in your Weblogic env with a clustered queuing system.

    See http://forum.springsource.org/showthread.php?t=82102 (last post) and http://forum.springsource.org/showthread.php?t=82015

    HTH,
    S.

    Comment


    • #3
      Thanks. We will try this and respond if we get it working.

      Comment


      • #4
        Originally posted by thowell View Post
        Thanks. We will try this and respond if we get it working.
        I'm actually implementing remote chunking using GridGain, I gonna share my code on git when done... I used spring-batch-integration as basis, but I'm surprised to see it inside the spring-batch-admin project...

        Alois Cochard
        http://aloiscochard.blogspot.com
        http://www.twitter.com/aloiscochard

        Comment


        • #5
          Originally posted by alois.cochard View Post
          I used spring-batch-integration as basis, but I'm surprised to see it inside the spring-batch-admin project...
          ditto. I believe the rationale behind it is to clearly separate the integration project from Spring Batch itself since it relies on another portfolio module (spring integration).

          Comment

          Working...
          X