Error installing Apache SparkR package

Question

When installing the apache sparkr , the following error appears:

 install_github("amplab-extras/SparkR-pkg", subdir="pkg") Downloading github repo amplab-extras/ SparkR-pkg@master Installing SparkR Error in isNamespaceLoaded(pkg) : attempt to use zero-length variable name 

Answer 1

I was able to load the SparkR library into R / RStudio by doing the following:

Download and configure SparkR
1. Download spark-1.4.0 and unzip / unzip it
2. Install the spark, then go to the / spark 01.4.0 / R directory
3. In the terminal, run. / install -dev.sh. This will create a folder called "lib" in your directory.

Add SparkR to R.libPaths ()
4. In the terminal:

  cat >> $HOME/.Rprofile <<EOT lib_path <- .libPaths() lib_path <- c(lib_path,"/MyDirectory/spark-1.4.0/R/lib") .libPaths(lib_path) rm(lib_path) EOT 

5. Download R, then use the library (SparkR).

Answer 2

I had the same problem with the pander package, and I worked with a long job. I installed the pander from Github to an earlier version of R (3.1.2 worked for me). Then I copied the package from \library\pander to a new installation of R v3.2.0. So far this is working fine.

I needed to do this for the sparkr package, but unfortunately it needs a newer build of R. You may find that R v3.1.3 will work, but I cannot check it on my machine.