Announcement Announcement Module
No announcement yet.
Multithreaded and Non database oriented Page Title Module
Move Remove Collapse
Conversation Detail Module
  • Filter
  • Time
  • Show
Clear All
new posts

  • Multithreaded and Non database oriented

    I have been working on Spring batch from last 2 years.

    In my current project I have different requirement to use multithreaded approach of Spring batch.
    Process need to read records from a 200GB file and proces records and write records to different files based on the criteria in which they fall under.

    One more thing is we do not need to access database. So can I use InMemoryRepository and AsynchronousTaskExecutor?

    Can someone suggest me the best approach for dealing with this requirement.

  • #2
    It depends.. Do you want to store the state of your job, if your job fails do oyou want to know why and where it stopped. If that is the case you also need a database, if you use the InMemoryRepository that information is all lost...


    • #3
      The MapJobRepositoryFactoryBean is allegedly thread safe from Batch 2.1, but in production I would use an in-memory relational database (H2 is probably the most robust).