Skip to content

open-source Pregel implementation with optimizations to reduce communication cost and eliminate skewness in communication.

Notifications You must be signed in to change notification settings

yaobaiwei/PregelPlus

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

PregelPlus: A Distributed Graph Computing Framework with Effective Message Reduction

Pregel+ is not just another open-source Pregel implementation, but a substantially improved distributed graph computing system with effective message reduction. Compared with existing Pregel-like systems, Pregel+ provides simpler programming interface and yet achieves higher computational efficiency. We give ample examples and detailed tutorials to demonstrate how to program in Pregel+ and deploy Pregel+ in a distributed environment. Pregel+ is also a better choice for researchers who want to change the system to support new functionalities, as the design of Pregel+ is much simpler and more flexible than most other Pregel-like systems.

Pregel+ supports two effective message reduction techniques: (1)vertex mirroring and (2)a new request-respond paradigm. These techniques not only reduce the total number of messages exchanged through the network, but also bound the number of messages sent/received by any vertex, especially for processing power-law graphs and (relatively) dense graphs.

Project Website

http://www.cse.cuhk.edu.hk/pregelplus/

License

Copyright 2018 Husky Data Lab, CUHK

About

open-source Pregel implementation with optimizations to reduce communication cost and eliminate skewness in communication.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages