Announcement Announcement Module
Collapse
No announcement yet.
Spring Batch Performance Issue. Page Title Module
Move Remove Collapse
X
Conversation Detail Module
Collapse
  • Filter
  • Time
  • Show
Clear All
new posts

  • Spring Batch Performance Issue.

    Hi,

    I am reading from a file and writing to a database. As database writes are expensive we have set the commit-interval=1000. However due to this the records are gettign shuffled (For our processing the order of records is important).

    <tasklet transaction-manager="transactionManager" allow-start-if-complete="true">
    <chunk reader="icompFeedFileReader" processor="icompFeedItemProcessor" writer="feedCompositeItemWriter"
    commit-interval="1000" />

    </tasklet>

    This ordering issue gets fixed when we change the commit-interval=1. However this is proving to be a serious performance bottle neck.

    Could you please provide suggestions on, how to do bulk writes while maintaing the order.

    Thanks,
    Yuvika

  • #2
    what kind of writer are you using? Did you look at the Spring Jdbc Batch ?
    also as you are loosing order i assume you are using a multithreaded model..correct?

    Comment

    Working...
    X