Talk · International Scientific-Technical Conference on Actual Problems of Electronic Instrument Engineering · November 14, 2025
High-Performance Matrix Multiplication Using Block Parallelization on CPU and GPU
Mekhriddin Rakhimov, Mannon Ochilov, Shakhzod Javliev
Abstract
This paper examines the performance issues associated with computing devices performing arithmetic operations on large matrices. One of the optimal methods for matrix multiplication is to calculate a large matrix by dividing it into blocks using the block-based method. This is achieved by multiplying matrices of different sizes using the parallel block-based method on a computer’s graphics processing unit using Compute Unified Device Architecture technology, as well as on a central processor using the Open Multi-Processing parallel library for devices without a graphics processing unit. The study examines the time-consuming task of multiplying matrices of sizes 64x64, 128x128, 512x512, 1024x1024, and 2048x2048 using a simple sequential naive method and a parallel block-based method using these parallel processing technologies. The performance of the block parallel method implemented on a graphics processing unit using Compute Unified Device Architecture technology and on a central processing unit using Open Multi-Processing technology is also compared with the existing CUDA basic linear algebra subprograms libraries for NVIDIA graphics processing units and Intel Math Kernel Library for Intel processors. The proposed approach allows the user to fully control the programming model, customize the algorithm, change the block size, and perform computations as quickly as existing libraries.
More by Mannon Ochilov
- PadSink-Track: A Calibrated Framework for Padding-Sink-Preserving, Alignment-Tracked Selective Cross-Attention Key–Value Cache Access in CPU-Based Whisper Speech RecognitionTechnologies · 2026
- A Cache-Aware Compression Framework: Deriving the Compression Target and Stopping Rule for Transformers on CPU-Class HardwareAI · 2026
- The Achievement of Speech Technologies in Enhancing the Rehabilitation of Hearing-Impaired PatientLecture notes in networks and systems · 2026
- Performance Evaluation of Parallel Programming Models for K-means Clustering on Parallel Computing SystemsInternational Siberian workshops and tutorials on electron devices and materials · 2026
