Skip to content

Commit

Permalink
Wave Metrics (facebookincubator#10679)
Browse files Browse the repository at this point in the history
Summary:
- Make multithreaded memcpy for staging transfers for GPU table scan.
- Make variants of bit unpacking in GpuDecoder-inl.cuh. Make selective decoding templatized as opposed to runtime switching.
- Add pieces to GpuDecoderTest, like comparing calling via launchDecode or (multi-function blocks) or decodeGlobal (single function thread blocks).
- Add a metric for driver thread waiting for first continuable stream.
- Check approx correctness of Wave runtimeStats.
- Refactor QueryBenchmarkBase.* from TpchBenchmark. Logic to do sweeps across parameter combinations.
- Add persistent file format to Wave mock format.
- Add benchmark for scan, filter, filter expr, projection. aggregation combinations with Wave and Dwrf.

Pull Request resolved: facebookincubator#10679

Reviewed By: Yuhta

Differential Revision: D60880466

Pulled By: oerling

fbshipit-source-id: 69e02986cffda5060e586610cd585fff68ff8b9a
  • Loading branch information
Orri Erling authored and facebook-github-bot committed Aug 19, 2024
1 parent 676b170 commit be52988
Show file tree
Hide file tree
Showing 46 changed files with 2,317 additions and 651 deletions.
24 changes: 24 additions & 0 deletions velox/benchmarks/CMakeLists.txt
Original file line number Diff line number Diff line change
Expand Up @@ -39,3 +39,27 @@ if(${VELOX_ENABLE_BENCHMARKS})
add_subdirectory(tpch)
add_subdirectory(filesystem)
endif()

add_library(velox_query_benchmark QueryBenchmarkBase.cpp)
target_link_libraries(
velox_query_benchmark
velox_aggregates
velox_exec
velox_exec_test_lib
velox_dwio_common
velox_dwio_common_exception
velox_dwio_parquet_reader
velox_dwio_common_test_utils
velox_hive_connector
velox_exception
velox_memory
velox_process
velox_serialization
velox_encode
velox_type
velox_type_fbhive
velox_caching
velox_vector_test_lib
${FOLLY_BENCHMARK}
Folly::folly
fmt::fmt)
Loading

0 comments on commit be52988

Please sign in to comment.