Announcement Announcement Module
Collapse
No announcement yet.
Is it possible to inject properties/beans into mapper/reducer instances ? Page Title Module
Move Remove Collapse
X
Conversation Detail Module
Collapse
  • Filter
  • Time
  • Show
Clear All
new posts

  • Is it possible to inject properties/beans into mapper/reducer instances ?

    Hi,
    I need to use some beans within a mapper context.
    What I have used so far is serilaise the
    Is spring IOC invoked with each hadoop child process?
    If it is, how can I declare it, The xsd permitts only class FQN

    Thanks,

  • #2
    We have (on a branch) support for mapper/reduce instance configuration if you'd like to experiment with that. Currently we don't support that in the main trunk but we do plan to merge it at some point.
    The main downside of instance configuration is that each node needs to recreate the wiring which usually adds some overhead for provisioning (each note for example needs to have the support classes present). We have some ideas on how to mitigate that but we haven't gotten around it yet.

    Cheers,

    Comment


    • #3
      Has this been added to the master branch?

      Comment


      • #4
        Originally posted by Costin Leau View Post
        We have (on a branch) support for mapper/reduce instance configuration if you'd like to experiment with that. Currently we don't support that in the main trunk but we do plan to merge it at some point.
        ...
        See above.

        Comment


        • #5
          code is here
          https://github.com/SpringSource/spri...hadoop/context

          Comment

          Working...
          X