Run yaml file for selenium parallel test from R or python

Question

I have a simple yaml file:

seleniumhub: image: selenium/hub ports: - 4444:4444 firefoxnode: image: selenium/node-firefox-debug ports: - 4577 links: - seleniumhub:hub chromenode: image: selenium/node-chrome-debug ports: - 4578 links: - seleniumhub:hub 

which I performed in docker:

 docker-compose up -d 

I have one hub and two nodes.

Now I would like to run two very simple selenium commands in parallel (written in RSelenium):

 remDr$open() remDr$navigate("http://www.r-project.org") remDr$screenshot(display = TRUE) 

I would like to know how you can run selenium commands in Python or R in parallel. I tried several ways, but nobody works. For example, in R:

 library(RSelenium) remDr <- remoteDriver(remoteServerAddr = "192.168.99.100", port = 4444L) remDr$open() remDr$navigate("http://www.r-project.org") remDr$screenshot(display = TRUE) 

doing nothing. I also tried to start two remoteDrivers, but this does not help the ether:

 remDr <- remoteDriver(remoteServerAddr = "192.168.99.100", port = 4577L) remDr$open() remDr$navigate("http://www.r-project.org") remDr$screenshot(display = TRUE) 

Answer 1

This is a duplicate

Parallel launch of RSelenium

You can use the code in the answer above to do parallel execution

 library(RSelenium) library(rvest) library(magrittr) library(foreach) library(doParallel) URLsPar <- c("http://www.bbc.com/", "http://www.cnn.com", "http://www.google.com", "http://www.yahoo.com", "http://www.twitter.com") appHTML <- c() (cl <- (detectCores() - 1) %>% makeCluster) %>% registerDoParallel # open a remoteDriver for each node on the cluster clusterEvalQ(cl, { library(RSelenium) remDr <- remoteDriver$new(remoteServerAddr = ip, port = port) remDr$open() }) myTitles <- c() ws <- foreach(x = 1:length(URLsPar), .packages = c("rvest", "magrittr", "RSelenium")) %dopar% { remDr$navigate(URLsPar[x]) remDr$getTitle()[[1]] } # close browser on each node clusterEvalQ(cl, { remDr$close() }) stopImplicitCluster()