Apache pool apache worker thread startup failed: Failed to install packages: Failed to install SDK: exit status 2

Before you see:

RuntimeError: IOError: [Errno 2] No such file or directory:
'/beam-temp-andrew_mini_vocab-..../......andrew_mini_vocab' [while running .....]

in my apache bundle python data stream i see this error being logged:

A setup error was detected in __. Please refer to the worker-startup
log for detailed information. `

I found startup logs for workers and payload error:

Failed to install packages: failed to install SDK: exit status 2

Error for me is not enough for debugging. Any insight that the SDK is not loading? My import to work is extremely simple:

from __future__ import absolute_import
from __future__ import division
import argparse
import logging
import re
import apache_beam as beam
from apache_beam.io import WriteToText
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.options.pipeline_options import SetupOptions
from apache_beam.pvalue import AsDict
+4
source share

Source: https://habr.com/ru/post/1690630/


All Articles