All geek questions in one place

Spark with Play !: how to remove the warning "Cannot initialize the counter due to context, is not an instance of TaskInputOutputContext"?

In my game! 2.5, using Spark 2.0.0, I get a lot of warnings saying:

[WARN ] o.a.p.h.ParquetRecordReader: Can not initialize counter due to context is not a instance of TaskInputOutputContext, but is org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl

I do not understand, and this does not seem problematic. Can I ignore them? If so, how can I turn off the logs?

+4
source share

No one has answered this question yet.

See related questions:

Source: https://habr.com/ru/post/1676822/

More articles:


All Articles