All geek questions in one place

How to log using Spark in local mode?

Is it possible to log on a specific path — which will be provided as an input argument — in Apache Spark when working in local mode?

val conf = new SparkConf(). setAppName("SparkProgrammingGuide"). setMaster(master). set("spark.eventLog.enabled", "true"). set("spark.eventLog.dir", "file:///home/USER") val sc = new SparkContext(conf)
+5
source share

No one has answered this question yet.

See related questions:

Source: https://habr.com/ru/post/1232635/

More articles:


All Articles