-
Notifications
You must be signed in to change notification settings - Fork 55
Open
Description
Hi @fraugster @akrennmair @panamafrancis,
I would like to know how to read the following schema with parquet-go?
message spark_schema {
optional group foo (LIST) {
repeated group list {
optional double element;
}
}
required group bar (LIST) {
repeated group list {
required double element;
}
}
}
the following seems not to work:
type Record struct {
Foo FooList `parquet:"foo.list"`
Bar BarList `parquet:"bar.list"`
}
type FooList struct {
List []FooListList `parquet:"list"`
}
type FooListList struct {
List []float64 `parquet:"element"`
}
type BarList struct {
List BidValuesListList `parquet:"list"`
}
type BarListList struct {
List []float64 `parquet:"element"`
}
while this works fine with github.com/segmentio/parquet-go lib:
type Record struct {
Foo BarList `parquet:"foo"`
Bar BarList `parquet:"bar"`
}
type FooList struct {
List []FooListList `parquet:"list"`
}
type FooListList struct {
List []float64 `parquet:"element"`
}
type BarList struct {
List BarListList `parquet:"list"`
}
type BarListList struct {
List []float64 `parquet:"element"`
}
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels