All geek questions in one place

Azure SQL Data Warehouse and PolyBase cannot read CSV files created using U-SQL and ADLA

I have a U-SQL script that generates a CSV file in Azure storage and an external table in Azure SQL Data Warehouse (SDW) using PolyBase to read this CSV file.

When the CSV file is generated using the U-SQL script, the SDW cannot read the data and throws an exception:

Msg 110802, Level 16, State 1, Line 152 110802; DMS internal error An error occurred that caused this operation. Details: Exception: Microsoft.SqlServer.DataWarehouse.DataMovement.Common.ExternalAccess.HdfsAccessException, Message: Java exception caused by calling HdfsBridge_RecordReaderFillBuffer: error [Cannot get Java exception.] While accessing external file [/ csv / 2015-02-13-13 /all.csv.BIZ[0].

However, if I download this CSV file to a local disk and load it in the same way as without changing it to the same place with the same file name, SDW can run queries against it without problems.

Any ideas?

+5
source share
1 answer

This is unexpected, and the SQL Data Warehouse team would like to examine this problem. Can you create a support ticket by following the instructions in the link below?

https://azure.microsoft.com/en-us/documentation/articles/sql-data-warehouse-get-started-create-support-ticket/

If you do not have a support plan (required to create a technical support case), send the SQL Data Warehouse command directly to sqldwfeedback@microsoft.com and indicate your server name, database name, error message, and an approximate timestamp for this error.

+5
source

Source: https://habr.com/ru/post/1241084/

More articles:


All Articles