Parquet – Snowflake Guide

Nano second precision lost after Parquet file Unload

Posted on 24 May 202124 May 2021 by Eric Lin

When unloading Timestamp data into Parquet file, the nano and micro seconds precision will be lost, and only milliseconds are stored in the file. To reproduce the issue, please see below script: We can see that the nano seconds part .12434453 was truncated to .124. This is due to limitations on Parquet V1 that is currently being used […]

Query Against Parquet File failed with error “Not yet implemented: Unsupported encoding”

Posted on 20 January 202124 May 2021 by Eric Lin

Recently I was dealing with an issue that a Snowflake query against Parquet file in internal Staging failed with error as below: After researching online, I figured out that it was nothing to do with Snowflake, it was because user used AWS Cost and Usage Report (CUR) tool to generate the Parquet file, which contains a version of […]