Announcement Announcement Module
Collapse
No announcement yet.
Spring XD cannot connect to ResourceManager Page Title Module
Move Remove Collapse
X
Conversation Detail Module
Collapse
  • Filter
  • Time
  • Show
Clear All
new posts

  • Spring XD cannot connect to ResourceManager

    I am running Spring XD 1.0.0.M5 on Mac OS X with HortonWorks 2.0 running as a VirtualBox VM as xd-singlenode --hadoopDistro hadoop22.
    I am trying to run the batch-* samples from Github, and they all produce the same error when I launch the job:
    14:10:18,435 INFO http-nio-9393-exec-4 core.SimpleModule:183 - initialized module: SimpleModule [name=hashtagcount, type=job, group=hashtagCountJob, index=0 @58f5def1]
    14:10:18,442 INFO http-nio-9393-exec-4 module.ModuleDeployer:256 - deployed SimpleModule [name=hashtagcount, type=job, group=hashtagCountJob, index=0 @58f5def1]
    14:10:28,335 INFO http-nio-9393-exec-6 client.RMProxy:56 - Connecting to ResourceManager at /0.0.0.0:8032
    14:10:28,389 INFO http-nio-9393-exec-6 client.RMProxy:56 - Connecting to ResourceManager at /0.0.0.0:8032
    14:10:29,477 INFO http-nio-9393-exec-6 ipc.Client:783 - Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
    14:10:30,480 INFO http-nio-9393-exec-6 ipc.Client:783 - Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)

    My HortwonWorks VM has IP address 192.168.56.102. before I built the jobs, I changed the hd:fs values to point to Horton VM.

    Can anyone help me?

    Thanks Paul

  • #2
    How do posts get approved?

    Comment


    • #3
      You should update the Hadoop configuration for your jobs - try to add the following:

      Code:
      <configuration>
        fs.defaultFS=hdfs://sandbox:8020
        yarn.resourcemanager.address=sandbox:8050
        mapreduce.framework.name=yarn
      </configuration>
      You might want to double-check the port for the resourcemanager, I'm pretty sure they aren't using the default 8032 port, and use 8050 instead.

      You would also need to make sure you can resolve the hostname for the sandbox VM - see this wiki page for some hints: https://github.com/spring-projects/s...nworks-sandbox

      Comment

      Working...
      X