question

Zaid Azmi avatar image
Zaid Azmi asked

Export data to newline delimited JSON format

We currently use event export to export data to an S3 bucket and then we clone the bucket to Google cloud to analyse it with BigQuery. The problem is BQ needs data to. be in delimited JSON format. How can we export data in this format?

Player DataTitle Datadata
10 |1200

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

1 Answer

·
Seth Du avatar image
Seth Du answered

PlayFab doesn't support change the export format. I am not expert on AWS nor BigQuery, but you may consider using AWS Lambda to convert data. I am not sure if changing the compression type may help the processing, please refer to https://stackoverflow.com/questions/36447723/how-to-automatically-export-data-from-s3-bucket-to-external-service and https://cloud.google.com/bigquery-transfer/docs/s3-transfer.

10 |1200

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Write an Answer

Hint: Notify or tag a user in this post by typing @username.

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.