当前位置：网站首页>Spark SQL gets the element at an index of the array

Spark SQL gets the element at an index of the array

2022-04-22 08:33:00 【Amnesia】

index from 1 Start

        val df = Seq(
            ("a", "b")
            , ("a", "c")
            , ("a", "d")
        ).toDF("c1", "c2")

        val df1 = df.groupBy('c1).agg(collect_list(struct($"c1", $"c2")).as("c3"))
        df1.show(false)
        df1.select(element_at($"c3",1)).show()
        spark.stop()