Be part of JetBrains PHPverse 2026 on June 9 – a free online event bringing PHP devs worldwide together.

srinu's avatar
Level 1

Connect From Rstudio to Hadoop mapr cluster using sparklyr package

We are trying to establish the connection from rstudio to hadoop mapr cluster to read the data from hive data base. While connecting we faced below issue.

config <- list(spark.env.SPARK_LOCAL_IP = "10.21.1.162",

  •            spark.env.SPARK_PUBLIC_DNS = "10.21.1.162", 
    
  •            spark.env.SPARK_LOCAL_HOSTNAME= "10.21.1.162")
    

sc <- spark_connect("yarn-client", config = config, version = "2.0.1") Error in force(code) : Failed while connecting to sparklyr to port (8880) for sessionid (68257): Gateway in port (8880) did not respond. Path: C:\opt\mapr\spark\spark-2.0.1\bin\spark-submit2.cmd Parameters: --class, sparklyr.Shell, "C:\Users\bmotolentino\Documents\R\win-library\3.4\sparklyr\java\sparklyr-2.0-2.11.jar", 8880, 68257 Log: C:\Users\BMOTOL~1\AppData\Local\Temp\RtmpUlZH4E\file3e5c6bd854d9_spark.log

---- Output Log ---- 'C:\opt\mapr\spark\SPARK-~1.1\bin\SPBE91~1.CMD' is not recognized as an internal or external command, operable program or batch file.

---- Error Log ----

0 likes
1 reply

Please or to participate in this conversation.