Announcement Announcement Module
Collapse
No announcement yet.
JDBCCursorItemReader - Multithreading Page Title Module
Move Remove Collapse
X
Conversation Detail Module
Collapse
  • Filter
  • Time
  • Show
Clear All
new posts

  • JDBCCursorItemReader - Multithreading

    Hi,

    We have table of 100,000 records or so and Id column is primary key.
    And we decided to use multithreading using taskExecutor. The question
    that the team has is:

    Assuming we read the primary keys first and put them in an iterator.

    1. Can we use JDBCCursorItemReader for this requirement and is
    Multithreading possible in this case.

    2. Or can we stick with the sample 'ParallelJob' approach - Just use
    ItemReader class & leverage taskExecutor.

    3. Suggest the one that could give us best performance.

    --venkat

  • #2
    JDBCCursorItemReader - Multithreading

    We had a similar issue where we were supposed to read around 2.5 million records from a table. The process we have developed did not require multi threading and was able to handle 2.5 million records easily on a system with 2 GB RAM.100K records can be handled easily by JVM for processing. The hardware configuration matters as well.It should be fine with you as long as you have a 2GB machine.

    Comment

    Working...
    X