Distributed k-Winners-Take-All Network: An Optimization Perspective

IEEE Trans Cybern. 2023 Aug;53(8):5069-5081. doi: 10.1109/TCYB.2022.3170236. Epub 2023 Jul 18.

Abstract

In this article, we proposed an equivalent formulation of the k-winners-take-all (k-WTA) problem as a constrained optimization problem by including the Laplacian matrix of the undirected connected communication graph to adapt to the distributed computing scenario, where an additional auxiliary variable is introduced. To solve the optimization problem in a distributed fashion, we design projection neural networks by using the convex optimization theory, leading to the emergence of a distributed k-WTA network. Our theoretical analysis shows that the proposed distributed k-WTA network has a globally asymptotically stable equilibrium that is identical to the optimal solution to the optimization problem, that is, the correct k-WTA solution. The effectiveness and advantages, including the extendability to constrained k-WTA problems, of the proposed k-WTA network are demonstrated via simulations.