You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In order to use this, the developer has to covert the number of rows to int before passing them in and then they get converted back to int64 again inside ReadColumnByPathReadColumnByPath.
To use:
num := int(pr.GetNumRows())
values, _, _, err := pr.ReadColumnByPath("some.path", num)
Converted back to int64 inside ReadColumnByPathReadColumnByPath:
In order to use this safely, I now need to also add some logic to check the size of int on the system it's running on.
ifstrconv.IntSize!=64 {
log.Printf("Warning: you are running this on a 32-bit system. Possible overflow if number of rows exceeds: %d. Number of rows: %d", math.MaxInt32, pr.GetNumRows())
}
The text was updated successfully, but these errors were encountered:
…skipped (xitongsys#195)
* fix lazy reading of dictionary pages when first column chunk page is skipped
* factorize more code, use less abstractions
* fix comment
is there any reason why
ReadColumnByPathReadColumnByPath
takes an int for the number of columns to read?parquet-go/reader/columnreader.go
Line 63 in 6d4d798
In order to use this, the developer has to covert the number of rows to
int
before passing them in and then they get converted back to int64 again insideReadColumnByPathReadColumnByPath
.To use:
Converted back to int64 inside
ReadColumnByPathReadColumnByPath
:parquet-go/reader/columnreader.go
Line 83 in 6d4d798
In order to use this safely, I now need to also add some logic to check the size of
int
on the system it's running on.The text was updated successfully, but these errors were encountered: