Announcement Announcement Module
Collapse
No announcement yet.
Initialize properties of Hadoop job from Spring Batch JobParameters Page Title Module
Move Remove Collapse
X
Conversation Detail Module
Collapse
  • Filter
  • Time
  • Show
Clear All
new posts

  • Initialize properties of Hadoop job from Spring Batch JobParameters

    Does any one know how to initialize properties of hadoop job from spring batch jobParameters , Please let me know how to do this.

    Following is the scenarion I am trying to pass additional properties to hadoop job as follows.

    <hdp:job id="wordcount-job" validate-paths="false" scope="step"
    input-path="#{jobParameters['inputFile']}" output-path="#{jobParameters['outputFile']}"
    mapper="org.apache.hadoop.examples.WordCount.Token izerMapper"
    reducer="org.apache.hadoop.examples.WordCount.IntS umReducer" properties-ref="jobProperties" >
    </hdp:job>

  • #2
    As I replied in the other thread, this is a Spring Batch specific issue that is best addressed by looking at the their sample. You can use either a file for initialization (similar to the property placeholder), system properties or even device your own mechanism.

    Comment

    Working...
    X