How do I aggregate JSON data using Jolt by two keys?

Question

If I have an input of a list of JSON objects. How do I go about nesting the data in Java by the date, and then the category in and also sorting it by date in descending order?

Input:

    { "data":[{
      "date": "2015-02-26",
      "buyer": "Ryan",
      "category": "clothes",
      "quantity":"10.0"
    },
    {
      "date": "2015-02-18",
      "buyer": "Lisa",
      "category": "food",
      "quantity": "2.0"
    },    
    {
      "date": "2015-02-18",
      "buyer": "Brian",
      "category": "food",
      "quantity": "11.0",
    },
    {
      "date": "2015-02-26",
      "buyer": "Jim",
      "category": "clothes",
      "quantity": "20.0",
    },
    {
      "date": "2015-02-26",
      "buyer": "Tom",
      "category": "food",
      "quantity": "40.0",
    },
    {
      "date": "2015-02-18",
      "buyer": "Alyssa",
      "category": "clothes",
      "quantity": "13.0",
    }]
}

You can see in my below output, that I am trying to group the data by the date first, and then within the date I want to group the objects by the category.

Desired Output:

{
    "2015-02-26”:{
                    “clothes”:[{
                                "date": "2015-02-26",
                                "buyer": "Ryan",
                                "category": "clothes",
                                "quantity":"10.0"
                                },
                                {
                                    "date": "2015-02-26",
                                    "buyer": "Jim",
                                    "category": "clothes",
                                    "quantity": "20.0",
                                }],
                    "food":[{
                                  "date": "2015-02-26",
                                  "buyer": "Tom",
                                  "category": "food",
                                  "quantity": "40.0",
                            }]
                }
     "2015-02-18":{
                    “clothes”:[{
                                  "date": "2015-02-18",
                                  "buyer": "Alyssa",
                                  "category": "clothes",
                                  "quantity": "13.0",
                                }],
                    "food":[{
                          "date": "2015-02-18",
                          "buyer": "Lisa",
                          "category": "food",
                          "quantity": "2.0"
                        },
                        {
                          "date": "2015-02-18",
                          "buyer": "Brian",
                          "category": "food",
                          "quantity": "11.0",
                        }]
                } 
}

Duplicate of https://stackoverflow.com/questions/13068267/json-to-json-transformer — Ashraff Ali Wahab, Aug 21 '18 at 19:41
You can look at JSON Serializing/De-Serializing libraries like `Jackson` to transform it the way you like. — user2004685, Aug 21 '18 at 19:44
@dahightime look at the 3rd answer to the question which mentions about jolt library which has shift operation. — Ashraff Ali Wahab, Aug 22 '18 at 03:03
How would I do this using jolt? I see the demo and it only shows for aggregating for one key — dahightime, Aug 22 '18 at 14:06

score 0 · Accepted Answer · answered Aug 25 '18 at 21:55

Surprising easy.

Spec

[
  {
    "operation": "shift",
    "spec": {
      "data": {
        // Ex. send the first data item to 
        //    2015-02-26.clothes[] 
        //    where we want clothes to always be an array 
        //    even if it only got one value assigned to it.
        "*": "@(0,date).@(0,category)[]"
      }
    }
  }
]

How do I aggregate JSON data using Jolt by two keys?

1 Answers1