Lock-free distributed queue in remote memory access model | Vestnik Tomskogo gosudarstvennogo universiteta. Upravlenie, vychislitelnaja tehnika i informatika – Tomsk State University Journal of Control and Computer Science. 2023. № 62. DOI: 10.17223/19988605/62/2

Lock-free distributed queue in remote memory access model

In parallel programming for distributed-memory systems in MPI standard, remote memory access model (one-sided communications, MPI RMA, RMA) is used along with the message-passing. This model in many cases leverages the performance and simplifies parallel programming. Here arises the problem of synchronization of multiple parallel processes and threads accessing shared (concurrent, distributed) data structures. In shared-memory machines, non-blocking synchronization (lock-free, wait-free, obstruction-free) is widely used to solve the similar problem. In non-blocking synchronization, delays in execution of one process (thread) do not suspend execution of other threads. We suppose that this approach could also be effective in designing distributed data structures (in the RMA model particularly). In this article, we discuss the idea of building non-blocking distributed data structures in RMA model on the example of a queue, describe the designed algorithms of operations, investigate the efficiency, and provide an experimental comparison with lock-based counterparts. Contribution of the authors: the authors contributed equally to this article. The authors declare no conflicts of interests.

Download file
Counter downloads: 12

Keywords

distributed queue, non-blocking concurrent data structures, remote memory access, MPI, MPI RMA, one-sided communications

Authors

NameOrganizationE-mail
Burachenko Alexander V.Saint Petersburg Electrotechnical University «LETI»ss47305@gmail.com
Paznikov Alexei A.Saint Petersburg Electrotechnical University «LETI»apaznikov@gmail.com
Derzhavin Denis P.Saint Petersburg Electrotechnical University «LETI»derzhavinden002@gmail.com
Всего: 3

References

Liu J., Wu J., Panda D.K. High performance RDMA-based MPI implementation over InfiniBand // International Journal of Parallel Programming. 2004. V. 32. P. 167-198.
Hoefler T., Dinan J., Thakur R., Barrett B., Balaji P., Gropp W., Underwood K. Remote memory access programming in MPI-3 // ACM Transactions on Parallel Computing. 2015. V. 2 (2). Art. 9. 26 р.
Gerstenberger R., Besta M., Hoefler T. Enabling Highly-Scalable Remote Memory Access Programming with MPI-3 One Sided // Scientific Programming. 2014. V. 2, is. 2. P. 75-91.
Herlihy M., Shavit N. The art of multiprocessor programming. Amsterdam et al.: Morgan Kaufmann, 2012. 537 p.
Schuchart J., Niethammer C., Gracia J., Bosilca G. Quo Vadis MPI RMA? Towards a More Efficient Use of MPI One-Sided Communication // arXiv: 2111.08142. 2021.
Mark M., Shavit N. Concurrent Data Structures. Chapman and Hall/CRC Press, 2004. 32 p.
Shavit N. Data structures in the multicore age // Communications of the ACM. 2011. V. 54. P. 76-84.
Пазников А.А. Оптимизация делегирования выполнения критических секций на выделенных процессорных ядрах // Вестник Томского государственного университета. Управление, вычислительная техника и информатика. 2017. № 38. С. 52-58.
Аненков А.Д., Пазников А.А. Алгоритмы оптимизации масштабируемого потокобезопасного пула на основе распределя ющих деревьев для многоядерных вычислительных систем // Вестник Томского государственного университета. Управление, вычислительная техника и информатика. 2017. № 39. С. 73-84.
Calciu I., Gottschlich J., Herlihy M. Using elimination and delegation to implement a scalable NUMA-friendly stack // 5th {USENIX} Workshop on Hot Topics in Parallelism (HotPar 13). 2013. P. 1-7.
Brock B., Buluc A. BCL: A cross-platform distributed data structures library // ICPP. 2019. P. 1-10.
Schuchart J., Bouteiller A., Bosilca G. Using MPI-3 RMA for active messages // ExaMPI. 2019. P. 47-56.
Diep T.D., Furlinger K. Nonblocking data structures for distributed-memory machines: stacks as an example // 2021 29th Euromicro Int. Conf on Parallel, Distributed and Network-Based Processing (PDP). IEEE, 2021. С. 9-17.
 Lock-free distributed queue in remote memory access model | Vestnik Tomskogo gosudarstvennogo universiteta. Upravlenie, vychislitelnaja tehnika i informatika – Tomsk State University Journal of Control and Computer Science. 2023. № 62. DOI: 10.17223/19988605/62/2

Lock-free distributed queue in remote memory access model | Vestnik Tomskogo gosudarstvennogo universiteta. Upravlenie, vychislitelnaja tehnika i informatika – Tomsk State University Journal of Control and Computer Science. 2023. № 62. DOI: 10.17223/19988605/62/2

Download full-text version
Counter downloads: 443