How do I write a partitioned parquet file from a big query table?

Question

I have created a parquet file from a big query table like this:

 EXPORT DATA
    OPTIONS(
             uri='gs://path_for_parquet_file/*.parquet',
             format='PARQUET',
             overwrite=false
            )
  AS SELECT * FROM `my_project.my_dataset.my_table`;

I want to know if there is a way to partition the parquet file. My big query table is partitioned by a date column.

Thanks,

score 0 · Answer 1 · answered Jul 29 '22 at 11:21

0

could not found answer to this question from official docs. my solution to this is write for loop to filter partiotion and export them

answered Jul 29 '22 at 11:21

no7dw

505
5
13

score 0 · Answer 2 · answered Nov 13 '22 at 03:42

0

I don't think it is supported unfortunately

answered Nov 13 '22 at 03:42

Mim

999
10
32

How do I write a partitioned parquet file from a big query table?

2 Answers2