Glue crawler could not classify JSON data of size > 20 mb

Question

I am a newbie to AWS Glue. I am having a raw data in s3 in JSON format with size > 20 MB. After creating a crawler over this JSON data, classification and compression type are showing as 'UNKNOWN' when look into the table details.

I have tried creating a custom classifier with jsonPath $[*]. Still I am not able get the classification correctly.

Could anyone please help me with this?

Answer 1

Create a custom classifier and add jsonPath with the array name in the json object and add the classifier in the corresponding crawler

Eg : $arrayname[*]