Abstract: Load balancing is a fundamental problem for cloud computing, multi-processing load balancing session persistence in multi-core environment have drawn more attention and have become a focus. For the issue, based on the idea of Hash Linux kernel network data packets passing, a lock-free multi-processing load balancing architecture is proposed, which avoids the use of locks, and can quickly change the existing single-processing load balancing procedure for multi-processing architecture without structural changes. The theory analysis and experimental results show that the proposed architecture is able to improve the overall performance of load balancing system in multi-core environment. Compared with the traditional shared memory architecture, the proposed is able to get better performance and has stronger applicability.