Announcement Announcement Module
Collapse
No announcement yet.
using spring-batch inside mapper Page Title Module
Move Remove Collapse
X
Conversation Detail Module
Collapse
  • Filter
  • Time
  • Show
Clear All
new posts

  • using spring-batch inside mapper

    Hi,
    i discovered new use case which should be covered by hadoop spring extension. Use Spring-Batch framework from Hadoop mapper.

    As i see, currently only scenario supported is to use entire mapreduce job as tasklet.

    My intended use is to use spring-batch for writing multi-threaded mappers using multi-threaded steps.

  • #2
    Currently we haven't added anything extra in SHDP for this (not there needs to be). Is there anything in particular that you're looking for or that is not working?

    Cheers,

    Comment


    • #3
      I would like to have following support:

      ready made mapper, reducer which accepts name of batch job to execute.

      ItemReader, ItemWriter for reading/writing writables from/to context.

      I am currently in process implementing spring batch on top of spring hadoop, so i am not sure if something else is needed.

      Comment

      Working...
      X