Native JSON support for BigQuery?

Question

Is there any plan for Google BigQuery to implement JSON support?

I am considering moving bush data (~ 20T) to Google BigQuery, but table definitions in Hive contain a map type that is not supported in BigQuery.

e.g. HiveQL below:

select gid, payload['src'] from data_repository; 

although it can be used with regex.

Answer 1

As of October 1, 2012, BigQuery supports row split JLON for import and export.

Blog post: http://googledevelopers.blogspot.com/2012/10/got-big-json-bigquery-expands-data.html

Data Format Documentation: https://developers.google.com/bigquery/docs/import#dataformats

Answer 2

It is best to impose all your types in csv before importing, and if you have complex fields, decompose them using a regular expression in the query (as you suggested).

However, we are actively studying support for new input formats and are interested in feedback on which formats will be most useful. The base query processor has support ( Dremel ) for types that are similar to the hive map type, but BigQuery, however, does not currently disclose a mechanism for swallowing nested records.