I've set up a S3 bucket for the PlayStream Event Archive. All the JSON events have a BOM prepended.
Is there a way to have these events be generated without the BOM? My JSON reader doesn't handle UTF-8 files that include a BOM.
I've set up a S3 bucket for the PlayStream Event Archive. All the JSON events have a BOM prepended.
Is there a way to have these events be generated without the BOM? My JSON reader doesn't handle UTF-8 files that include a BOM.
For now, Playfab does not support modifying the encoding of PlayStream events. It might be a good idea to use a different JSON reader.
I tried using the Redshift COPY command to extract the JSON objects. Redshift can handle UTF16 with BOM but not UTF8.
Whats strange is that some playstream events like 'playfab.entity_logged_in' don't have the BOM while others like 'client_focus_change' do include the BOM.
Is the Redshift ETL not supported?
The stl_load_errors table shows an error code of 1216(Invalid value) for those files.
I think you've got two options. You can do some sort of processing on the data to remove the BOM before ingesting into redshift. There are many ways of doing that depending on the environment in which you're running the ingestion command. The other thing you could look at is using the acceptinvchars data conversion parameter. It might not lead to the precise desired outcome, though, so it wouldn't be my first choice.
3 People are following this question.
