Summer Sale! All accounts are 50% off this week.

srinu's avatar
Level 1

Connect From Rstudio to Hadoop mapr cluster using sparklyr package

We are trying to establish the connection from rstudio to hadoop mapr cluster to read the data from hive data base. While connecting we faced below issue.

config <- list(spark.env.SPARK_LOCAL_IP = "10.21.1.162",

  •            spark.env.SPARK_PUBLIC_DNS = "10.21.1.162", 
    
  •            spark.env.SPARK_LOCAL_HOSTNAME= "10.21.1.162")
    

sc <- spark_connect("yarn-client", config = config, version = "2.0.1") Error in force(code) : Failed while connecting to sparklyr to port (8880) for sessionid (68257): Gateway in port (8880) did not respond. Path: C:\opt\mapr\spark\spark-2.0.1\bin\spark-submit2.cmd Parameters: --class, sparklyr.Shell, "C:\Users\bmotolentino\Documents\R\win-library\3.4\sparklyr\java\sparklyr-2.0-2.11.jar", 8880, 68257 Log: C:\Users\BMOTOL~1\AppData\Local\Temp\RtmpUlZH4E\file3e5c6bd854d9_spark.log

---- Output Log ---- 'C:\opt\mapr\spark\SPARK-~1.1\bin\SPBE91~1.CMD' is not recognized as an internal or external command, operable program or batch file.

---- Error Log ----

0 likes
1 reply

Please or to participate in this conversation.