Since the data lived in aws s3 is in a special structure, which is very different from usual database I am familiar with. Each record is a seperate gz file and organized into folder by date. I am so not familiar with this! I could't convert all the data into a single csv file or import them to a database for further analyze with my familiar function.
Is there a hint for how to analyze these data on such structure? Or is there a name for this file structure?
Thanks