Applied Science and Innovative Research ISSN 2474-4972 (Print) ISSN 2474-4980 (Online) Vol. 8, No. 1, 2024 www.scholink.org/ojs/index.php/asir 63 Original Paper Learning Guarantee of SDP Relaxation on Directed Stochastic Block Models Yanlang Chen1 1 Shenzhen College of International Education, Shenzhen, Guangdong, 518040, China Received: December 18, 2023 Accepted: January 27, 2024 Online Published: February 2, 2024 doi:10.22158/asir.v8n1p63 URL: http://doi.org/10.22158/asir.v8n1p63 Abstract Community detection in networks has been a focal point in various scientific domains, but the study of directed networks remains relatively under-explored despite their prevalence and importance in capturing real-world systems. This work addresses this research gap by focusing on Directed Stochastic Block Models (DSBMs), a natural extension of traditional Stochastic Block Models (SBMs) to directed graphs. The inherent complexity of directionality in DSBMs makes them challenging to analyze, requiring new mathematical frameworks and computational approaches. We introduce an augmented matrix to encapsulate the directional relationships within these networks, providing a nuanced perspective for further analysis. In this work, we prove the information-theoretical threshold for exact recovery in the DSBMs and propose an SDP relaxation that can achieve this threshold, thereby contributing to the theoretical understanding of community detection in the realm of directed graphs. Keywords Directed Stochastic Block Models, Semi-Definite Programming (SDP) Relaxation, clustering, random graph, unsupervised learning, community detection, directed graphs 1. Introduction Community detection and clustering are pivotal challenges in an array of disciplines, ranging from machine learning and data science to the study of complex networks (Girvan & Newman, 2002; Newman, 2003). One of the most striking features of any network is its unique structure, which becomes evident through the patterns of interaction among its vertices. For instance, certain subsets of vertices in a vast network are tightly interlinked, while their connections to vertices outside this cluster are notably sparse. While substantial research has focused on undirected networks - such as geographical maps, friendship circles, and familial connections - there is a compelling yet www.scholink.org/ojs/index.php/asir Applied Science and Innovative Research Vol. 8, No. 1, 2024 64 Published by SCHOLINK INC. underexplored frontier in the realm of directed networks. Directed networks, evident in phenomena like social media interactions, web page hyperlinks, and aviation routes, more closely mimic the intricacies of real-world systems. Their inherent directionality not only makes them more relevant for practical applications but also significantly more challenging to analyze. This very novelty and complexity of directed networks serve as the driving force behind this thesis. Stochastic Block Models (SBMs) (Emmanuel, Afonso, & Georgina, 2014) have traditionally been employed to examine random block structures, originally formulated to scrutinize social networks. This model serves as a powerful benchmark for assessing the performance of clustering algorithms. However, its main limitation lies in its oversimplification of real-world networks, particularly due to its strong homogeneity and lack of community structure. Moreover, the burgeoning research in this area has disproportionately focused on undirected SBMs (Andrea, Santo, & Filippo, 2008; Santo, 2010), thus leaving a crucial gap in our understanding of Directed Stochastic Block Models (DSBMs). The challenge in DSBMs is not merely a replication of its undirected counterparts; it is profoundly exacerbated by the added complexity of directionality. In light of this, we leverage an augmented matrix to encapsulate these directional relationships, providing a nuanced mathematical framework to navigate this intricate landscape. DSBMs also possess desirable consistency properties similar to undirected SBMs, but obtaining exact parameter estimates in both is generally an NP-hard problem. Inspired by semi-definite programming (SDP) relaxation techniques (Afonso, 2015), our work aims to bypass this computational bottleneck. We offer a pioneering semi-definite relaxation approach to discern clustering thresholds in DSBMs, thereby overcoming the inherent NP-hardness. In this work, we prove the information-theoretical threshold for exact recovery in the Directed Stochastic Block Models and propose an SDP relaxation that can achieve the threshold, which fills the gap of the theoretical understanding of community detection in the context of directed graphs. 1.1 Notations Let ๐‘จ โˆˆ โ„‚๐‘›ร—๐‘š be a complex matrix and denote its (๐‘–, ๐‘—)-entry by ๐ด๐‘–๐‘—. We denote its transpose and conjugate transpose as ๐‘จโŠค and ๐‘จ๐ป respectively. The โ„“2 -norm of a vector ๐’— is denoted by โˆฅ ๐’— โˆฅ= โˆš๐’—๐ป๐’— = โˆšโˆ‘๐‘—=1 ๐‘› โ€Š|๐‘ฃ๐‘—| 2 and its โ„“โˆž norm is denoted by โˆฅ ๐’— โˆฅโˆž= max1โ‰ค๐‘˜โ‰ค๐‘› โ€Š|๐‘ฃ๐‘˜|, where ๐‘ฃ๐‘˜ is ๐’—'s ๐‘˜-th entry. The inner product between two complex vectors ๐’– and ๐’— is defined as โŸจ๐’–, ๐’—โŸฉ = ๐’–๐ป๐’—. For two vectors ๐’– and ๐’—, we denote ๐’– โˆ ๐’— if they are parallel. We denote the operator 2-norm of ๐‘จ as โˆฅ ๐‘จ โˆฅ which is the largest singular value of ๐‘จ. We denote the all-one vector in โ„๐‘› as ๐Ÿ๐‘› and the all-one matrix in โ„๐‘›ร—๐‘› as ๐‘ฑ๐‘›. For ๐‘จ โˆˆ โ„๐‘›ร—๐‘›, if ๐‘จ is symmetric and all its eigenvalues are non-negative, we say ๐‘จ is positive semidefinite, denoted by ๐‘จ โ‰ฝ 0. www.scholink.org/ojs/index.php/asir Applied Science and Innovative Research Vol. 8, No. 1, 2024 65 Published by SCHOLINK INC. 2. Preliminaries In this section, we will introduce the problem settings and the core definitions for the paper. 2.1 Directed Stochastic Block Models The Directed Stochastic Block Models (or DSBM in short) is a generative model for modeling the community structures in directed networks, which is a benchmark for comparing different community detection methods. First, we define the DSBM as follows. Given an even integer ๐‘› โ‰ฅ 2, and 1 โ‰ฅ ๐‘ > ๐‘ž โ‰ฅ 0, we say that a directed random graph ๐บ is drawn from the Directed Stochastic Block Model with two communities (denoted as DSBMโก(๐‘›, ๐‘, ๐‘ž)) with ground-truth ๐’ˆ, if ๐บ has ๐‘› nodes, divided into two clusters of ๐‘›/2 nodes each, and for each pair of vertices (๐‘–, ๐‘—), (๐‘–, ๐‘—) is an edge of ๐บ with probability ๐‘ if ๐‘– and ๐‘— are in the same cluster and with probability ๐‘ž otherwise. The ๐‘–-th entry of ๐’ˆ is ยฑ1 indicating the cluster to which the ๐‘–-th node belongs. In particular, let ๐‘จ be the adjacency matrix of ๐บ. Each entry of ๐‘จ is given by โ„™(๐‘จ๐‘–๐‘— = 1) = { ๐‘ if ๐‘– and ๐‘— are in the same community ๐‘ž otherwise โก1 โ‰ค ๐‘– โ‰ค ๐‘›, 1 โ‰ค ๐‘— โ‰ค ๐‘›. Then the expected adjacency matrix ๐‘จโˆ— = ๐”ผ๐‘จ is given by ๐‘จโˆ— = ๐”ผ๐‘จ = [ ๐‘๐‘ฑ๐‘›/2ร—๐‘›/2 ๐‘ž๐‘ฑ๐‘›/2ร—๐‘›/2 ๐‘ž๐‘ฑ๐‘›/2ร—๐‘›/2 ๐‘๐‘ฑ๐‘›/2ร—๐‘›/2 ] This model can be seen as the concatenation of two directed Erdล‘s-Rรฉnyi random graphs with parameter ๐‘ (as two clusters) and the connection probability between these two graphs is ๐‘ž. To theoretically understand community detection in directed networks, we are interested in the information-theoretical threshold for exact recovery in DSBM, that is, we want to find a threshold as a function of (๐‘›, ๐‘, ๐‘ž), above which exactly recovering the membership of each node is possible with probability 1 โˆ’ ๐‘œ(1), while impossible otherwise. The definition of exact recovery is stated as follows. Let Algo (โ‹…) be some community detection algorithm, and ๐‘จ be the adjacency matrix of ๐บ โˆผ DSBMโก(๐‘›, ๐‘, ๐‘ž) with ground-truth membership ๐’ˆ. Then we say Algoโก(โ‹…) exactly recovers the membership if Algoโก(๐‘จ) = ๐’™ = ๐’ˆ where ๐’™ is the membership estimated by Algoโก(โ‹…). Since it can be verified that connectedness is a sufficient condition for exact recovery in DSBM, we will choose the regime ๐‘ = ๐‘Žlogโก(๐‘›)/๐‘›, ๐‘ž = ๐‘logโก(๐‘›)/๐‘› in the whole paper. In this work, we will propose the threshold of exact recovery for DSBMโก(๐‘›, ๐‘Ž, ๐‘) and a clustering algorithm that can exactly recover the membership, and then prove the tightness of the threshold. 2.2 Co-clustering: Community Detection in Directed Networks Co-clustering was a concept first proposed in 1972, where it clusters entries of a matrix โˆˆ โ„๐‘›ร—๐‘‘. In the past, co-clustering has been applied to matrices where the rows and columns represent different meanings, and it clusters rows of matrix ๐‘€ into ๐‘˜๐‘Ÿ communities, and columns into ๐‘˜๐‘ communities. For example, in a matrix used for text processing, the rows represent documents, and the columns represent words. Therefore, each entry in (๐‘–, ๐‘—) indicates how many time word ๐‘— appears in document ๐‘–. www.scholink.org/ojs/index.php/asir Applied Science and Innovative Research Vol. 8, No. 1, 2024 66 Published by SCHOLINK INC. However, in this thesis, we apply co-clustering to a matrix where the rows and columns index the same set of vertex. Specifically, the ๐‘–th row of the matrix represents the connection of the ๐‘–th vertex, where it shows the outgoing edges for vertex ๐‘–. The ๐‘–th column of the matrix represents the incoming edges of ๐‘–th vertex. Therefore, each vertex ๐‘– is included in two communities, one for the row and one for the column. It is worth mentioning that due to the directedness of the DSBM, the connectedness of the row community and the column community of ๐‘–th vertex is not necessarily the same. Specifically, we would like to find the Maximum Likelihood Estimation (MLE) to the communities in the DSBM. We assume ๐‘ข and ๐‘ฃ to be n by 1 matrix, where the first ๐‘› 2 entries are 1, and others are -1. We have ๐‘จ as our adjacency matrix, which reflects the realistic connection behavior. Then we have the following equation: โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกmaxโกโกโกโก๐’–โŠค๐‘จ๐’— s.t โกโกโกโก๐‘ข๐‘– = ยฑ1,1 โ‰ค ๐‘– โ‰ค ๐‘›,โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก๏ผˆ2.1๏ผ‰ โกโกโกโก๐‘ฃ๐‘– = ยฑ1,1 โ‰ค ๐‘– โ‰ค ๐‘›. in this multiplication, vertices within the same community would give a positive value, and we try to maximize the value for all vertices. However, this still remains a very challenging problem to tackle as the conditions remain discrete. Therefore, we need to use semi-definite programming (SDP) algorithm to loosen the conditions and find the solution under that condition, and lastly check whether the solution would work under the initial condition. The detailed process will be further explained in the following section. 2.3 SDP Relaxation for Co-clustering The programming (2.1) is indeed finding the maximum likelihood estimation to the membership of the nodes, but it is challenging due to NP-hardness. We can simplify the algorithm (2.1) into: โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกmax Trโก(๐’–โŠค๐‘จ๐’—) s.t ๐‘ข๐‘– = ยฑ1,1 โ‰ค ๐‘– โ‰ค ๐‘›, ๐‘ฃ๐‘– = ยฑ1,1 โ‰ค ๐‘– โ‰ค ๐‘›. ๏ผˆ2.2๏ผ‰ However, finding the row membership vector ๐’– and column membership vector ๐’— from this programming is NP-hard due to the following reasons: (1) ๐‘จ is asymmetric, so there are limited linear algebra algorithms that can be used; (2) the problem is nonconvex; (3) there are limited prior knowledge about this model and there are no constraints in the model in (2.2). In order to tackle the third reason, we know that as defined, ๐’– and ๐’— are perpendicular to ๐Ÿ matrix, so their dot product would equal 0. Therefore, we can penalize algorithm (2.2) with ๐‘ข๐‘‡๐Ÿ๐‘› and ๐‘ฃ๐‘‡๐Ÿ๐‘› to the following function: โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกmax Trโก(๐’–โŠค๐‘จ๐’—) โˆ’ ๐œ†(โŸจ๐’–, ๐Ÿ๐‘›/โˆš๐‘›โŸฉ + โŸจ๐’—, ๐Ÿ๐‘›/โˆš๐‘›โŸฉ) s.t ๐‘ข๐‘– = ยฑ1,1 โ‰ค ๐‘– โ‰ค ๐‘›, ๐‘ฃ๐‘– = ยฑ1,1 โ‰ค ๐‘– โ‰ค ๐‘›. โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก๏ผˆ2.3๏ผ‰ Another key characteristic of DSBM is its directness, and in order to deal with the directness of ๐บ, we need to consider the symmetric augmented matrix defined below to represent the direction: www.scholink.org/ojs/index.php/asir Applied Science and Innovative Research Vol. 8, No. 1, 2024 67 Published by SCHOLINK INC. ๏ฟฝฬƒ๏ฟฝ = [ ๐ŸŽ๐‘›ร—๐‘› ๐‘จโŠค ๐‘จ ๐ŸŽ๐‘›ร—๐‘› ]. Given the singular value decomposition (SVD) of ๐‘จ being ๐‘จ = ๐‘ผ๐šบ๐‘ฝโŠค, then the eigen-decomposition of ๏ฟฝฬƒ๏ฟฝ can be formulated as ๏ฟฝฬƒ๏ฟฝ = 1 โˆš2 [ ๐‘ฝ ๐‘ฝ ๐‘ผ โˆ’๐‘ผ ] [ ๐šบ ๐ŸŽ๐‘›ร—๐‘› ๐ŸŽ๐‘›ร—๐‘› โˆ’๐šบ ] 1 โˆš2 [๐‘ฝ โŠค ๐‘ผโŠค ๐‘ฝโŠค โˆ’๐‘ผโŠค]. It is worth noting that conditions for algorithm (2.3) is discrete, where the algorithm is unsolvable in polynomial time. Hence, we need to loosen the constraints using SDP, converting them into semi-definite constraints that would be solvable in polynomial time. Using the wellknown Goemans-Williams relaxation, we can formulate semi-definite programming to solve the NP-hardness: โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกmaxโกโกโกโกโŸจ๏ฟฝฬƒ๏ฟฝ, ๐‘ฟโŸฉ โˆ’ ๐œ†โŸจ๐‘ฑ2๐‘›, ๐‘ฟโŸฉ s.t. โก๐‘‹๐‘–๐‘– = 1,1 โ‰ค ๐‘– โ‰ค 2๐‘›โกโกโกโกโกโก โกโกโก๐‘ฟ โ‰ฝ 0 โก๐œ† > 0 โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก๏ผˆ2.4๏ผ‰ (2.4) is a convex relaxation of (2.3). In order to recover the communities in the graph, we intend to maximize the difference between the in-community degree and the cross-community degree in rows and columns respectively. However, we don't want ๐’– and ๐’— to be too close to all-one vector or all-negative one vector. So we will take ๐œ† = 1 2 , and (2.4) becomes: โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกmax Trโก((2๏ฟฝฬƒ๏ฟฝ โˆ’ ๐‘ฑ2๐‘›)๐‘ฟ) s.t. ๐‘‹๐‘–๐‘– = 1 ๐‘ฟ โ‰ฝ 0 โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก๏ผˆ2.5๏ผ‰ Note that โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก2๏ฟฝฬƒ๏ฟฝ โˆ’ ๐‘ฑ2๐‘› = [ โˆ’๐‘ฑ๐‘› ๐‘ฉ๐‘‡ ๐‘ฉ โˆ’๐‘ฑ๐‘› ] โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก๐ต๐‘–๐‘— = { 1โก if ๐ด๐‘–๐‘— = 1 โˆ’1โก if ๐ด๐‘–๐‘— = 0 โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก๏ผˆ2.6๏ผ‰ 3. Main Results Given the the DSBMโก(๐‘›, ๐‘, ๐‘ž) defined in Section 2.1, in the regime ๐‘ = ๐‘Žlogโก(๐‘›)/๐‘›, ๐‘ž = ๐‘logโก(๐‘›)/๐‘›, we will present the main argument that โˆš๐‘Ž โˆ’ โˆš๐‘ = โˆš2 is the information-theoretical threshold for exact recovery in the DSBM. To be more specific, the argument will be presented from two perspectives, namely the impossibility part and the achievability part. In the impossibility part, we will show that when โˆš๐‘Ž โˆ’ โˆš๐‘ < โˆš2, even the MLE fails to recover the correct membership of each node. In the achievability part, we will show that when โˆš๐‘Ž โˆ’ โˆš๐‘ > โˆš2 the SDP relaxation can correctly recover the membership of each node with high probability. We only provide a proof sketch in this section and the detailed proofs are deferred to Section A and B. 3.1 Impossibility Our goal in this section is to provide a proof sketch of the condition for which the MLE algorithm fails www.scholink.org/ojs/index.php/asir Applied Science and Innovative Research Vol. 8, No. 1, 2024 68 Published by SCHOLINK INC. to recover the communities in DSBM, we first introduce the concept of bad vertices which is defined with respect to the connectedness of each node. Then using this concept of bad vertices, we will find under what condition this bad vertex definitely exists. Therefore, when this condition is met, the MLE will fail. Theorem 3.1. Let ๐บ be a graph drawn from DSBMโก(๐‘›, ๐‘, ๐‘ž), let ๐‘ = ๐‘Žlogโก(๐‘›) ๐‘› and ๐‘ž = ๐‘logโก(๐‘›) ๐‘› , then exact recover is impossible if โˆš๐‘Ž โˆ’ โˆš๐‘ < โˆš2 (3.1) The following steps are the proof sketch to the above main theorem. Definition 3.1. We define the likelihood function of the DSBM as: ๐ฟ(๐‘ฅ, ๐‘ฆ) = โˆ โ€Š๐‘–,๐‘—โˆˆ[๐‘›]2 ๐‘ƒ๐‘–,๐‘— ๐ด๐‘–,๐‘—(1 โˆ’ ๐‘ƒ๐‘–๐‘—) 1โˆ’๐ด๐‘–,๐‘— (3.2) where ๐‘จ is the adjacency matrix and โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก๐‘ท = [ ๐‘๐‘ฑ๐‘›/2 ๐‘ž๐‘ฑ๐‘›/2 ๐‘ž๐‘ฑ๐‘›/2 ๐‘๐‘ฑ๐‘›/2 ]. Definition 3.2. We define the degree matrices for DSBM as the following: (๐‘ซ๐‘… +)๐‘–๐‘–: = { โˆ‘ โ€Š ๐‘›/2 ๐‘—=1 โ€Š๐ด๐‘–๐‘— โก๐‘– โˆˆ [1, ๐‘› 2 ] โˆ‘ โ€Š๐‘› ๐‘—=๐‘›/2+1 โ€Š๐ด๐‘–๐‘— โก๐‘– โˆˆ [ ๐‘› 2 + 1, ๐‘›] (๐‘ซ๐‘… โˆ’)๐‘–๐‘–: = { โˆ‘ โ€Š๐‘› ๐‘—=๐‘›/2+1 โ€Š๐ด๐‘–๐‘— โก๐‘– โˆˆ [1, ๐‘› 2 ] โˆ‘ โ€Š ๐‘› 2 ๐‘—=1 โ€Š๐ด๐‘–๐‘— โก๐‘– โˆˆ [ ๐‘› 2 + 1, ๐‘›] (๐‘ซ๐ถ +)๐‘–๐‘–: = { โˆ‘ โ€Š ๐‘›/2 ๐‘–=1 โ€Š๐ด๐‘–๐‘— โก๐‘– โˆˆ [1, ๐‘› 2 ] โˆ‘ โ€Š๐‘› ๐‘–= ๐‘› 2 +1 โ€Š๐ด๐‘–๐‘— โก๐‘– โˆˆ [๐‘›/2 + 1, ๐‘›] (๐‘ซ๐ถ โˆ’)๐‘–๐‘–: = { โˆ‘ โ€Š๐‘› ๐‘–= ๐‘› 2 +1 โ€Š๐ด๐‘–๐‘— โก๐‘– โˆˆ [1, ๐‘› 2 ] โˆ‘ โ€Š ๐‘› 2 ๐‘–=1 โ€Š๐ด๐‘–๐‘— โก๐‘– โˆˆ [ ๐‘› 2 + 1, ๐‘›] (3.3) where each entry represents the number of connections that satisfies the condition described above. Therefore, for each vertex's connectedness, Then the in-degree matrix and the out-degree matrix for DSBM respectively as: ๐‘ซ+: = [ ๐‘ซ๐ถ + 0 0 ๐‘ซ๐‘… +] โก๐‘ซ โˆ’: = [ ๐‘ซ๐ถ โˆ’ 0 0 ๐‘ซ๐‘… โˆ’] For each vertex's connectedness, we can use ๐‘‘(๐‘–) to represent the ith vertex's degree. Then we have ๐‘‘โˆ’(๐‘–) to represent the degree with cross-community vertex, ๐‘‘+(๐‘–) to represent the degree with the same community. ๐‘‘๐‘…(๐‘–) to represent the degree with the row, and ๐‘‘๐ถ(๐‘–) to represent the degree with the column. The concept of bad vertex and bad edges is essential in the proof of the impossibility part. It can be verified that the presence of bad edges and bad vertices implies the impossibility of exact recovery and the condition โˆš๐‘Ž โˆ’ โˆš๐‘ < โˆš2 is the sufficient condition for the existence of bad vertices. Definition 3.3. Bad vertices is a type of vertices pair, where the two vertices' community in the pair are www.scholink.org/ojs/index.php/asir Applied Science and Innovative Research Vol. 8, No. 1, 2024 69 Published by SCHOLINK INC. swapped, and the MLE of the swapped pair is larger than the MLE of the initial pair. Meaning that after the swap, vertices are connected better with their original community. Mathematically, we define a pair of bad vertices in rows, in columns, or in rows and columns respectively by: โก๐ต๐‘…(๐บ):= {(๐‘ข, ๐‘ฃ): ๐‘ข โˆˆ ๐ถ1 ๐‘… , ๐‘ฃ โˆˆ ๐ถ2 ๐‘… , ๐ฟ(๏ฟฝฬƒ๏ฟฝ, ๐‘ฆ) > ๐ฟ(๐‘ฅ, ๐‘ฆ)} โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก๐ต๐ถ(๐บ): = {(๐‘ข, ๐‘ฃ): ๐‘ข โˆˆ ๐ถ1 ๐ถ , ๐‘ฃ โˆˆ ๐ถ2 ๐ถ , ๐ฟ(๐‘ฅ, ๏ฟฝฬƒ๏ฟฝ) > ๐ฟ(๐‘ฅ, ๐‘ฆ)} ๐ต๐‘…,๐ถ(๐บ): = {(๐‘ข, ๐‘ฃ): ๐‘ข โˆˆ ๐ถ1, ๐‘ฃ โˆˆ ๐ถ2, ๐ฟ(๏ฟฝฬƒ๏ฟฝ, ๏ฟฝฬƒ๏ฟฝ) > ๐ฟ(๐‘ฅ, ๐‘ฆ)} (3.4) Then we are trying to prove that for โˆš๐‘Ž โˆ’ โˆš๐‘ < โˆš2, there exists at least one bad vertex in rows or columns, which would result in max{๐ฟ(๏ฟฝฬƒ๏ฟฝ, ๐‘ฆ), ๐ฟ(๐‘ฅ, ๏ฟฝฬƒ๏ฟฝ), ๐ฟ(๏ฟฝฬƒ๏ฟฝ, ๏ฟฝฬƒ๏ฟฝ) โ‰ฅ ๐ฟ(๐‘ฅ, ๐‘ฆ)}. We define a pair of bad vertex (๐‘ข, ๐‘ฃ), the relationship between degrees can be inferred from the following relationship between MLE: ๐ฟ(๏ฟฝฬƒ๏ฟฝ, ๐‘ฆ) > ๐ฟ(๐‘ฅ, ๐‘ฆ) โ†’ ๐‘‘โˆ’ ๐‘…(๐‘ข) + ๐‘‘โˆ’ ๐‘…(๐‘ฃ) > ๐‘‘+ ๐‘…(๐‘ข) + ๐‘‘+ ๐‘…(๐‘ฃ) ๐ฟ(๐‘ฅ, ๏ฟฝฬƒ๏ฟฝ) > ๐ฟ(๐‘ฅ, ๐‘ฆ) โ†’ ๐‘‘โˆ’ ๐ถ(๐‘ข) + ๐‘‘โˆ’ ๐ถ(๐‘ฃ) > ๐‘‘+ ๐ถ(๐‘ข) + ๐‘‘+ ๐ถ(๐‘ฃ)โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก(3.5) ๐ฟ(๏ฟฝฬƒ๏ฟฝ, ๏ฟฝฬƒ๏ฟฝ) > ๐ฟ(๐‘ฅ, ๐‘ฆ) โ†’ ๐‘‘โˆ’ ๐‘…(๐‘ข) + ๐‘‘โˆ’ ๐‘…(๐‘ฃ) + ๐‘‘โˆ’ ๐ถ(๐‘ข) + ๐‘‘โˆ’ ๐ถ(๐‘ฃ) > ๐‘‘+ ๐‘…(๐‘ข) + ๐‘‘+ ๐‘…(๐‘ฃ) + ๐‘‘+ ๐ถ(๐‘ข) + ๐‘‘+ ๐ถ(๐‘ฃ) Since if ๐ฟ(๏ฟฝฬƒ๏ฟฝ, ๐‘ฆ) > ๐ฟ(๐‘ฅ, ๐‘ฆ), then ๐ฟ(๐‘ฅ, ๏ฟฝฬƒ๏ฟฝ) > ๐ฟ(๐‘ฅ, ๐‘ฆ)orโก๐ฟ(๏ฟฝฬƒ๏ฟฝ, ๏ฟฝฬƒ๏ฟฝ) > ๐ฟ(๐‘ฅ, ๐‘ฆ). Hence, it is enough to only study the bad vertices in rows or in columns. Definition 3.4. Using the concept of degree, we can define a set of bad vertices in rows: โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก๐ต๐‘– ๐‘…(๐บ) = {โˆƒ๐‘ข: ๐‘ข โˆˆ ๐ถ๐‘– ๐‘… , ๐‘‘+ ๐‘…(๐‘ข) โ‰ค ๐‘‘โˆ’ ๐‘…(๐‘ข) โˆ’ 1}, ๐‘– = 1,2 (3.6) where ๐‘– represents the community. Lemma 3.2. If ๐ต1 ๐‘…(๐บ) is non-empty and with high probability, then ๐ต๐‘…(๐บ) is non-empty and with non-vanishing probability. 3.2 Acheivability Recall that our goal is to show that โˆš๐‘Ž โˆ’ โˆš๐‘ = โˆš2 is the tight threshold for exact recovery. After showing that when โˆš๐‘Ž โˆ’ โˆš๐‘ < โˆš2 MLE fails to recover the communities, we will show that the SDP relaxation (2.5) can recover the communities otherwise. Theorem 3.3. Let ๐บ be a graph drawn from DSBMโก(๐‘›, ๐‘, ๐‘ž), let ๐‘ = ๐‘Žlogโก(๐‘›) ๐‘› and ๐‘ž = ๐‘logโก(๐‘›) ๐‘› , if โˆš๐‘Ž โˆ’ โˆš๐‘ > โˆš2, (3.7) then the SDP relaxation in (2.5) can recover the communities with high probability. Without loss of generality, we suppose that the ground-truth community indicator, denoted by ๐’ˆ is (๐Ÿ๐‘›/2 โŠค , โˆ’๐Ÿ๐‘›/2 โŠค , ๐Ÿ๐‘›/2 โŠค , โˆ’๐Ÿ๐‘›/2 โŠค ) โŠค . Since we use the notion of co-clustering introduced Section 2.2, ๐’ˆ is the stack of the column communities and the row communities. Then we claim that when โˆš๐‘Ž โˆ’ โˆš๐‘ > โˆš2, (2.5) has a unique solution equal to ๐’ˆ๐’ˆโŠค. The following lemma uses a surrogate ๐šฒ to quantify the condition under which ๐’ˆ๐’ˆโŠค is the unique solution. Definition 3.5. Given a graph ๐บ drawn from DSBM with two clusters, we can have: ฮ“DSBM = ๐‘ซ+ โˆ’๐‘ซโˆ’ โˆ’ ๐‘จโˆ— (3.8) Lemma 3.4. Let ๐šฒ = 2ฮ“DSBM + ๐‘ฐ2๐‘› + [ 2๐‘ฑ๐‘› ๐‘ฑ๐‘› โˆ’ ๐‘ฐ๐‘› ๐‘ฑ๐‘› โˆ’ ๐‘ฐ๐‘› 2๐‘ฑ๐‘› ], if www.scholink.org/ojs/index.php/asir Applied Science and Innovative Research Vol. 8, No. 1, 2024 70 Published by SCHOLINK INC. ๐šฒ โ‰ฝ 0, โก๐œ†2(๐šฒ) > 0. then ๐’ˆ๐’ˆโŠค is the unique solution to the SDP relaxation (2.5). Since ๐šฒ is random, the second smallest eigenvalue of it is hard to calculate. However, thanks to Weyl's inequality, we can estimate it using its population counterpart, i.e., the second smallest eigenvalue of ๐”ผ๐šฒ. The following lemma specifies the distance between the two quantities. Lemma 3.5. Let ๐‘› > 4 be even and ๐œ†max(โˆ’ฮ“๐‘†๐ต๐‘€ + ๐”ผ[ฮ“๐‘†๐ต๐‘€]) < ๐‘›(๐‘ โˆ’ ๐‘ž), (3.9) then the SDP relaxation for DSBM can achieve exact recovery, meaning that ggโŠค is the only solution. The following theorem finalizes the proof in this part by connecting the degree and community detection in DSBM. Theorem 3.6. Let ๐‘› โ‰ฅ 4 be even and ๐‘ฎ be a graph of directed stochastic block model drawn from ๐’ข(๐‘›, ๐‘, ๐‘ž), where ๐‘ > ๐‘ž. Only when logโก(๐‘›) ๐‘› < ๐‘ž < ๐‘ < 1 2 , and for some constant ๐‘ > 1, then ๐šซ > 0 such that, with high probability, the following equation holds: If min ๐‘–โˆˆ[2๐‘›] โ€Š(๐’Ÿ๐‘–๐‘– + โˆ’๐’Ÿ๐‘–๐‘– โˆ’) โ‰ฅ ๐šซ logโก(๐‘›) ๐”ผ[deg๐ถ +โก(๐‘–) โˆ’ deg๐ถ โˆ’โก(๐‘–)] (3.10) then the semidefinite program achieve exact recovery. Now we have the equation represented by degree, which is easier and more straightforward to solve than the previous lemma. Lemma 3.7. Let ๐บ be a random graph with ๐‘› node drawn accordingly to the directed stochastic block model on two communities with in-community edge probability ๐‘ and cross-community edge probability ๐‘ž. Let ๐‘ = alogโก(๐‘›)/๐‘› and ๐‘ž = ๐‘logโก(๐‘›)/๐‘›, where ๐‘Ž > ๐‘ are constant. Then for any constant > 0 : If โˆš๐‘Ž โˆ’ โˆš๐‘ > โˆš2 (3.11) then with high probability min ๐‘–โˆˆ[2๐‘›] โ€Š(๐’Ÿ๐‘–๐‘– + โˆ’ ๐’Ÿ๐‘–๐‘– โˆ’) โ‰ฅ ๐šซ logโก(๐‘›) ๐”ผ[deg๐ถ +โก(๐‘–) โˆ’ deg๐ถ โˆ’โก(๐‘–)] (3.12) 4. Experiments The goal of the numerical experiments is to confirm our theoretical results above. Let ๐‘› = 100. For each (๐‘Ž, ๐‘) pair we generate the DSBM 25 times and apply the SDP relaxation to recover the community. Figure 1 visualizes the accuracy v.s. (๐‘Ž, ๐‘). The accuracy is calculated as follows 1 2๐‘› โˆ‘ โ€Š ๐‘› ๐‘–=1 ๐Ÿ{๐‘”๐‘–=๐‘ฅ๐‘–} where ๐Ÿ{โ‹…} is the indicator function and ๐’ˆ is the ground-truth and ๐’™ is the solution of SDP relaxation. As depicted in Figure 1, the empirical boundary between the success region and the failure region almost aligns with the curve โˆš๐‘Ž โˆ’ โˆš๐‘ = โˆš2, which suggests that our proved information-theoretical threshold is tight. www.scholink.org/ojs/index.php/asir Applied Science and Innovative Research Vol. 8, No. 1, 2024 71 Published by SCHOLINK INC. Figure 1. Accuracy of the SDP Relaxation under Different ๐’‚ and 's. Each (๐’‚, ๐’ƒ) Pair is Subject to 25 Experiments A Proof for Theorem 3.1 In this section, we are trying to discover the condition when MLE can not fully recover the communities in DSBM and the condition's proof. Let ๐บ be a graph drawn from ๐’ข(๐‘›, ๐‘, ๐‘ž), let ๐‘ = ๐‘Žlogโก(๐‘›) ๐‘› and ๐‘ž = ๐‘logโก(๐‘›) ๐‘› , ๐‘Ž > ๐‘, if โˆš๐‘Ž โˆ’ โˆš๐‘ < โˆš2, then we need to prove that for this condition the exact recovery of DSBM is unsolvable, and therefore MLE fails. We define MLE for DSBM to be: ๐ฟ(๐‘ฅ, ๐‘ฆ) = โˆ โ€Š๐‘–,๐‘— ๐‘ƒ๐‘–,๐‘— ๐ด๐‘–,๐‘—(1 โˆ’ ๐‘ƒ๐‘–๐‘—) 1โˆ’๐ด๐‘–,๐‘— (A.1) Definition A.1. We define a pair of bad vertices in rows, in columns, or in rows and columns respectively by: ๐ต๐‘…(๐บ): = {(๐‘ข, ๐‘ฃ): ๐‘ข โˆˆ ๐ถ1 ๐‘… , ๐‘ฃ โˆˆ ๐ถ2 ๐‘… , ๐ฟ(๏ฟฝฬƒ๏ฟฝ, ๐‘ฆ) > ๐ฟ(๐‘ฅ, ๐‘ฆ)} ๐ต๐ถ(๐บ): = {(๐‘ข, ๐‘ฃ): ๐‘ข โˆˆ ๐ถ1 ๐ถ , ๐‘ฃ โˆˆ ๐ถ2 ๐ถ , ๐ฟ(๐‘ฅ, ๏ฟฝฬƒ๏ฟฝ) > ๐ฟ(๐‘ฅ, ๐‘ฆ)} ๐ต๐‘…,๐ถ(๐บ): = {(๐‘ข, ๐‘ฃ): ๐‘ข โˆˆ ๐ถ1, ๐‘ฃ โˆˆ ๐ถ2, ๐ฟ(๏ฟฝฬƒ๏ฟฝ, ๏ฟฝฬƒ๏ฟฝ) > ๐ฟ(๐‘ฅ, ๐‘ฆ)} (A.2) Then we are trying to prove that for โˆš๐‘Ž โˆ’ โˆš๐‘ < โˆš2, there exists at least one bad vertex in rows or columns, which would result in max{๐ฟ(๏ฟฝฬƒ๏ฟฝ, ๐‘ฆ), ๐ฟ(๐‘ฅ, ๏ฟฝฬƒ๏ฟฝ), ๐ฟ(๏ฟฝฬƒ๏ฟฝ, ๏ฟฝฬƒ๏ฟฝ) โ‰ฅ ๐ฟ(๐‘ฅ, ๐‘ฆ)}. We define a pair of bad vertex (๐‘ข, ๐‘ฃ), the relationship between degrees can be inferred from the following relationship between MLE: ๐ฟ(๏ฟฝฬƒ๏ฟฝ, ๐‘ฆ) > ๐ฟ(๐‘ฅ, ๐‘ฆ) โ†’ ๐‘‘โˆ’ ๐‘…(๐‘ข) + ๐‘‘โˆ’ ๐‘…(๐‘ฃ) > ๐‘‘+ ๐‘…(๐‘ข) + ๐‘‘+ ๐‘…(๐‘ฃ) ๐ฟ(๐‘ฅ, ๏ฟฝฬƒ๏ฟฝ) > ๐ฟ(๐‘ฅ, ๐‘ฆ) โ†’ ๐‘‘โˆ’ ๐ถ(๐‘ข) + ๐‘‘โˆ’ ๐ถ(๐‘ฃ) > ๐‘‘+ ๐ถ(๐‘ข) + ๐‘‘+ ๐ถ(๐‘ฃ)โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก(A. 3) ๐ฟ(๏ฟฝฬƒ๏ฟฝ, ๏ฟฝฬƒ๏ฟฝ) > ๐ฟ(๐‘ฅ, ๐‘ฆ) โ†’ ๐‘‘โˆ’ ๐‘…(๐‘ข) + ๐‘‘โˆ’ ๐‘…(๐‘ฃ) + ๐‘‘โˆ’ ๐ถ(๐‘ข) + ๐‘‘โˆ’ ๐ถ(๐‘ฃ) > ๐‘‘+ ๐‘…(๐‘ข) + ๐‘‘+ ๐‘…(๐‘ฃ) + ๐‘‘+ ๐ถ(๐‘ข) + ๐‘‘+ ๐ถ(๐‘ฃ) www.scholink.org/ojs/index.php/asir Applied Science and Innovative Research Vol. 8, No. 1, 2024 72 Published by SCHOLINK INC. Since if ๐ฟ(๏ฟฝฬƒ๏ฟฝ, ๐‘ฆ) > ๐ฟ(๐‘ฅ, ๐‘ฆ), then ๐ฟ(๐‘ฅ, ๏ฟฝฬƒ๏ฟฝ) > ๐ฟ(๐‘ฅ, ๐‘ฆ)orโก๐ฟ(๏ฟฝฬƒ๏ฟฝ, ๏ฟฝฬƒ๏ฟฝ) > ๐ฟ(๐‘ฅ, ๐‘ฆ). Hence, it is enough to only study the bad vertices in rows or in columns. Definition A.2. We define a set of bad vertices in rows: ๐ต๐‘– ๐‘…(๐บ) = {โˆƒ๐‘ข: ๐‘ข โˆˆ ๐ถ๐‘– ๐‘… , ๐‘‘+ ๐‘…(๐‘ข) โ‰ค ๐‘‘โˆ’ ๐‘…(๐‘ข) โˆ’ 1}, ๐‘– = 1,2 (A.4) where ๐‘– represents the community. Lemma A.1. If ๐ต1 ๐‘…(๐บ) is non-empty and with high probability, then ๐ต๐‘…(๐บ) is non-empty and with non-vanishing probability. Proof. If ๐‘ข โˆˆ ๐ถ1 ๐‘… and ๐‘ฃ โˆˆ ๐ถ2 ๐‘… such that ๐‘‘+ ๐‘…(๐‘ข) โ‰ค ๐‘‘โˆ’ ๐‘…(๐‘ข) โˆ’ 1 and ๐‘‘+ ๐‘…(๐‘ฃ) โ‰ค ๐‘‘โˆ’ ๐‘…(๐‘ฃ) โˆ’ 1 , then combining these we get ๐‘‘โˆ’ ๐‘…(๐‘ข) + ๐‘‘โˆ’ ๐‘…(๐‘ฃ) > ๐‘‘+ ๐‘…(๐‘ข) + ๐‘‘+ ๐‘…(๐‘ฃ). Then we have: โ„™(โˆƒ๐‘ข โˆˆ ๐ต๐‘… or โˆƒ๐‘ฃ โˆˆ ๐ต๐‘…) = โ„™(โˆƒ๐‘ข โˆˆ ๐ต1 ๐‘…(๐บ)) + โ„™(โˆƒ๐‘ฃ โˆˆ ๐ต1 ๐‘…(๐บ)) โˆ’ โ„™(โˆƒ(๐‘ข, ๐‘ฃ) โˆˆ ๐ต๐‘…(๐บ)) โ„™(โˆƒ(๐‘ข, ๐‘ฃ) โˆˆ ๐ต๐‘…(๐บ)) = โ„™(โˆƒ๐‘ข โˆˆ ๐ต1 ๐‘…(๐บ)) + โ„™(โˆƒ๐‘ฃ โˆˆ ๐ต1 ๐‘…(๐บ)) โˆ’ โ„™(โˆƒ๐‘ข โˆˆ ๐ต๐‘… or โˆƒ๐‘ฃ โˆˆ ๐ต๐‘…) (A.5) because the possibility of node ๐‘ข is a bad vertex is the same as node ๐‘ฃ is a bad vertex, so we can write: โ„™(โˆƒ(๐‘ข, ๐‘ฃ) โˆˆ ๐ต๐‘…(๐บ)) โ‰ค 2โ„™(โˆƒ๐‘ข โˆˆ ๐ต1 ๐‘…(๐บ)) โˆ’ 1 (A.6) Lemma A.2. Let ๐บ be a graph drawn from ๐’ข(๐‘›, ๐‘, ๐‘ž), let ๐‘ = ๐‘Žlogโก(๐‘›) ๐‘› and ๐‘ž = ๐‘logโก(๐‘›) ๐‘› , ๐‘Ž > ๐‘, if โˆš๐‘Ž โˆ’ โˆš๐‘ < โˆš2, then: โ„™(โˆƒ๐‘ข โˆˆ ๐ต1 ๐‘…(๐บ)) = 1 โˆ’ ๐‘œ(1) (A.7) Proof. Note that โ„™(โˆƒ๐‘ข โˆˆ ๐ต1 ๐‘…(๐บ)) can be written as: โ„™(โˆƒ๐‘ข โˆˆ ๐ต1 ๐‘…(๐บ)) = ๐‘›โ„™(๐‘‘โˆ’ ๐‘… > ๐‘‘+ ๐‘…) = ๐‘›โ„™(Binโก( ๐‘› 2 , ๐‘ž) > Binโก( ๐‘› 2 , ๐‘)) (A.8) Then, we introduce a new definition. Definition A.3. Let ๐‘š be a natural number, ๐‘, ๐‘ž โˆˆ [0,1], and ๐›ฟ โˆˆ โ„, we define ๐‘‡(๐‘š, ๐‘, ๐‘ž, ๐›ฟ) = โ„™[โˆ‘ โ€Š๐‘š ๐‘–=1 โ€Š (๐‘๐‘– โˆ’๐‘Š๐‘– โ‰ฅ ๐›ฟ)] (A.9) where ๐‘Š1, โ€ฆ ,๐‘Š๐‘š are i.i.d. Bernoulli(p) and ๐‘1, โ€ฆ , ๐‘๐‘š are i.i.d. Bernoulli(q), independent of ๐‘Š1, โ€ฆ ,๐‘Š๐‘š. Definition A.4. We define: ๐‘‰(๐‘š, ๐‘, ๐‘ž, ๐‘ก, ๐‘) โก= ( ๐‘š (๐‘ก + ๐‘) ๐‘š ๐‘› logโก(๐‘›)) ( ๐‘š ๐‘ก ๐‘š ๐‘› logโก(๐‘›)) ๐‘ ๐‘ก ๐‘š ๐‘› logโก(๐‘›)๐‘ž(๐‘ก+๐‘) ๐‘š ๐‘› logโก(๐‘›)(1 โˆ’ ๐‘)๐‘šโˆ’๐‘ก ๐‘š ๐‘› logโก(๐‘›)(1 โˆ’ ๐‘ž)(๐‘ก+๐‘) ๐‘š ๐‘› logโก(๐‘›) (A.10) Where ๐‘ = ๐‘‚(1). We also define the function: ๐‘”(๐‘Ž, ๐‘, ๐‘) = (๐‘Ž + ๐‘) โˆ’ ๐‘logโก(๐‘) โˆ’ 2โˆš( ๐‘ 2 ) 2 + ๐‘Ž๐‘ + ๐‘ 2 logโก(๐‘Ž๐‘ โˆš( ๐‘ 2 ) 2 +๐‘Ž๐‘+ ๐‘ 2 โˆš( ๐‘ 2 ) 2 +๐‘Ž๐‘โˆ’ ๐‘ 2 ) (A.11) Then we have the following results for ๐‘‡โˆ—(๐‘š, ๐‘, ๐‘ž, ๐‘) = max๐‘ก>0 โ€Š๐‘‰(๐‘š, ๐‘, ๐‘ž, ๐‘ก, ๐‘) : [7] For ๐‘š โˆˆ โ„• and โˆ€๐‘ก > 0: www.scholink.org/ojs/index.php/asir Applied Science and Innovative Research Vol. 8, No. 1, 2024 73 Published by SCHOLINK INC. โˆ’logโก(๐‘‡โˆ—(๐‘š, ๐‘, ๐‘ž, ๐‘)) โ‰ฅ ๐‘š ๐‘› logโก(๐‘›) โˆ— ๐‘”(๐‘š, ๐‘›, ๐‘) โˆ’ ๐‘œ ( ๐‘š ๐‘› logโก(๐‘›)) โˆ€๐‘š โˆˆ โ„• (A.12) In the following proof of this lemma, we will omit the ceiling symbol for clarity. In the case of the directed stochastic block model, recall definition A.3, we have: ๐‘‡(๐‘š, ๐‘, ๐‘ž, 0) = โ„™[๐‘ โˆ’๐‘Š โ‰ฅ 0)] (A.13) where ๐‘ is a Binomialโก(๐‘š, ๐‘ž) and ๐‘Š is a Binomial (๐‘š, ๐‘), ๐‘ = ๐‘Žlogโก(๐‘›) ๐‘› , ๐‘ž = ๐‘logโก(๐‘›) ๐‘› . We can re-write (A.10) into: ๐‘‡(๐‘š, ๐‘, ๐‘ž, 0) = โˆ‘ โ€Š๐‘š ๐‘˜1=0 (โˆ‘ โ€Š๐‘š ๐‘˜2=๐‘˜1 โ€Šโ„™(๐‘ = ๐‘˜2))โ„™(๐‘Š = ๐‘˜1) (A.14) Where each term in the double summation can be upper-bounded by ๐‘‡โˆ—(๐‘š, ๐‘, ๐‘ž, 0). Using ๐‘ = 0, we have ๐‘‡(๐‘š, ๐‘, ๐‘ž, 0)โกโ‰ค ๐‘š2๐‘‡โˆ—(๐‘š, ๐‘, ๐‘ž, 0) โˆ’logโก(๐‘‡(๐‘š, ๐‘, ๐‘ž, 0))โกโ‰ฅ โˆ’2logโก(๐‘š) โˆ’ logโก(๐‘‡โˆ—(๐‘š, ๐‘, ๐‘ž, 0)) โกโ‰ฅ โˆ’2logโก(๐‘š) + 2๐‘š ๐‘› ( ๐‘Ž+๐‘ 2 โˆ’ โˆš๐‘Ž๐‘) logโก(๐‘›) (A.15) As long as ๐‘š ๐‘› > logโกlogโก(๐‘›) and ๐‘š โ‰ค ๐‘›2 4 , then we have logโก(๐‘š) = ๐‘œ ( ๐‘š ๐‘› logโก(๐‘›)). Hence, โˆ’logโก(๐‘‡(๐‘š, ๐‘, ๐‘ž, 0)) โ‰ฅ 2๐‘š ๐‘› ( ๐‘Ž+๐‘ 2 โˆ’ โˆš๐‘Ž๐‘) logโก(๐‘›) โˆ’ ๐‘œ ( ๐‘š ๐‘› logโก(๐‘›)) (A.16) In this case, ๐‘‡(๐‘š, ๐‘, ๐‘ž, 0) is equivalent to โ„™(Binโก( ๐‘› 2 , ๐‘ž) > Binโก( ๐‘› 2 , ๐‘)), and continuing (A.8), as ๐‘› approaches infinity, we get: โ„™(โˆƒ๐‘ข โˆˆ ๐ต1 ๐‘…(๐บ)) = ๐‘›โ„™(๐‘‘โˆ’ ๐‘… > ๐‘‘+ ๐‘…) = ๐‘›โ„™(Binโก( ๐‘› 2 , ๐‘ž) > Binโก( ๐‘› 2 , ๐‘)) = ๐‘› 1โˆ’( โˆš๐‘Žโˆ’โˆš๐‘ โˆš2 ) 2 +๐‘œ(1) (A.17) Therefore, when โˆš๐‘Ž โˆ’ โˆš๐‘ < โˆš2, โ„™(โˆƒ๐‘ข โˆˆ ๐ต1 ๐‘…(๐บ)) = 1 โˆ’ ๐‘œ(1), there exists a bad vertex and exact recovery is unachievable. B Proof for Theorem 3.3 Proof for Lemma 3.4 Let ๐’ˆ = (1,โ€ฆ ,1, โˆ’1,โ€ฆ ,โˆ’1,1, . . ,1, โˆ’1,โ€ฆ ,โˆ’1). without loss of generality. By KKT condition, we obtain a sufficient condition for ๐’ˆ๐’ˆโŠค to be the solution of the SDP relaxation (2.5). Therefore, we have ๐šฒ โ‰ฝ 0, and ๐’ˆ๐’ˆโŠค is guaranteed to be the optimal solution to SDP relaxation (2.5) if: 1. ๐’ˆ๐’ˆโŠค is a solution to the primal problem, 2. There exists a matrix ๐’€ feasible for the dual problem such that Trโก((2๐‘จโˆ— โˆ’ ๐‘ฑ2๐‘›)๐’ˆ๐’ˆ โŠค) = Trโก(๐’€). The first condition is already satisfied by the given background, then we need to find a ๐’€ (also known as dual certificate) that would satisfy the second condition. We can use ๐‘ช to substitute 2๐‘จโˆ— โˆ’ ๐‘ฑ2๐‘›, then we have: (๐‘ช๐’ˆ๐’ˆโกโŠค)๐‘–๐‘– = โกcorrectโกedgesโก + โกcorrectโกnon โˆ’ edgesโก- incorrect edges - incorrect non-edges โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก= (๐‘ซ๐ถ +)๐‘–๐‘– + ( ๐‘› 2 โˆ’ (๐‘ซ๐ถ โˆ’)๐‘–๐‘–) โˆ’ ( ๐‘› 2 โˆ’ 1 โˆ’ (๐‘ซ๐ถ +)๐‘–๐‘–) โˆ’ (๐‘ซ๐ถ โˆ’)๐‘–๐‘– + 1 โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก= 2((๐‘ซ๐ถ +)๐‘–๐‘– โˆ’ (๐‘ซ๐ถ โˆ’)๐‘–๐‘–) + 1 (B.1) for ๐‘– โˆˆ [๐‘› + 1,2๐‘›], we let ๐‘— = ๐‘– โˆ’ ๐‘›, then we have: www.scholink.org/ojs/index.php/asir Applied Science and Innovative Research Vol. 8, No. 1, 2024 74 Published by SCHOLINK INC. (๐‘ช๐’ˆ๐’ˆโŠค)๐‘–๐‘– = 2((๐‘ซ๐‘… +)๐‘—๐‘— โˆ’ (๐‘ซ๐‘… โˆ’)๐‘—๐‘—) + 1 (B.2) Therefore, we get Trโก(๐‘ช๐’ˆ๐’ˆโŠค) = Trโก(2(๐‘ซ๐ถ + โˆ’๐‘ซ๐ถ โˆ’) + ๐‘ฐ๐‘›) + Trโก(2(๐‘ซ๐‘… + โˆ’ ๐‘ซ๐‘… โˆ’) + ๐‘ฐ๐‘›), and we are able to find a matrix ๐’€ that is feasible for the dual problem and satisfies the proposed condition: ๐’€ = [ 2(๐‘ซ๐ถ + โˆ’๐‘ซ๐ถ โˆ’) + ๐‘ฐ๐‘› 0 0 2(๐‘ซ๐‘… + โˆ’๐‘ซ๐‘… โˆ’) + ๐‘ฐ๐‘› ]. As a result, if ๐šฒ โ‰ฝ 0, then ๐’ˆ๐’ˆโŠค is the optimal solution to the SDP. In addition, ๐œ†2(๐šฒ) > 0 ensures that ๐’ˆ๐’ˆโŠค is the only solution to SDP. Imagine there is another optimal solution ๐‘ฟโˆ— to the SDP, then we get Trโก(๐‘ฟโ€ฒ๐šฒ) = 0 by complementary slackness. By assumption, the second smallest eigenvalue of ๐šฒ is non-zero, together with the complementary slackness, the fact that ๐‘ฟโ€ฒ โ‰ฝ 0 and ๐šฒ โ‰ฝ 0 , we have ๐‘ฟโ€ฒ = ๐‘˜๐’ˆ๐’ˆโŠค . Since ๐‘ฟ๐‘–๐‘– โ€ฒ = 1,๐‘ฟโ€ฒ = ๐’ˆ๐’ˆโŠค by contradiction. Then we need to estimate ๐”ผ๐šฒ, then we have the following: ๐”ผ[๐šฒ]โก= ๐”ผ [2ฮ“๐‘†๐ต๐‘€ + ๐‘ฐ2๐‘› + [ 0 ๐‘ฑ๐‘› โˆ’ ๐‘ฐ๐‘› ๐‘ฑ๐‘› โˆ’ ๐‘ฐ๐‘› 0 ] + 2 [ ๐‘ฑ๐‘› 0 0 ๐‘ฑ๐‘› ]] โก= 2( ๐‘› 2 (๐‘ โˆ’ ๐‘ž)๐‘ฐ2๐‘› โˆ’ ( ๐‘+๐‘ž 2 [ 0 ๐‘ฑ๐‘› ๐‘ฑ๐‘› 0 ] + ๐‘โˆ’๐‘ž 2 ๐’ˆ๐’ˆโŠค)) โก+ [ 0 ๐‘ฑ๐‘› ๐‘ฑ๐‘› 0 ] + ๐‘ฐ2๐‘› โˆ’ [ 0 ๐‘ฐ๐‘› ๐‘ฐ๐‘› 0 ] + (๐‘ โˆ’ ๐‘ž) [ ๐’ˆโ€ฒ๐’ˆโ€ฒโŠค 0 0 ๐’ˆโ€ฒ๐’ˆโ€ฒโŠค] + 2 [ ๐‘ฑ๐‘› 0 0 ๐‘ฑ๐‘› ] โก= ๐‘›(๐‘ โˆ’ ๐‘ž)(๐‘ฐ2๐‘› โˆ’ [ 0 ๐’ˆโ€ฒ๐’ˆโ€ฒโŠค ๐’ˆโ€ฒ๐’ˆโ€ฒโŠค 0 ] ๐‘› ) + (1 โˆ’ (๐‘ + ๐‘ž)) [ 0 ๐‘ฑ๐‘› ๐‘ฑ๐‘› 0 ] + ๐‘ฐ2๐‘› โˆ’ [ 0 ๐‘ฐ๐‘› ๐‘ฐ๐‘› 0 ] + 2 [ ๐‘ฑ๐‘› 0 0 ๐‘ฑ๐‘› ] (B.3) Suppose ๐‘ < 1 2 and ๐œ†2 = ๐‘›(๐‘ โˆ’ ๐‘ž), whose eigenvector is perpendicular to (๐’ˆโ€ฒ, ๐’ˆโ€ฒ)โŠค and (๐Ÿ, ๐Ÿ)โŠค๐šซ can be re-written as: โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก๐šฒ = 2ฮ“DSBM + ๐‘ฐ2๐‘› + [ 0 ๐‘ฑ๐‘› โˆ’ ๐‘ฐ๐‘› ๐‘ฑ๐‘› โˆ’ ๐‘ฐ๐‘› 0 ] + 2 [ ๐‘ฑ๐‘› 0 0 ๐‘ฑ๐‘› ] (B.4) Using Weyl's inequalities, we get: โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก๐œ†2 > ๐œ†max(๐”ผ[๐šฒ] โˆ’ ๐šฒ) =โˆฅ ๐”ผ[๐šฒ] โˆ’ ๐šฒ โˆฅ โกโ‰ฅ ๐œŽ2(๐”ผ[๐šฒ] โˆ’ ๐œŽ2(๐šฒ)) โก= ๐œ†2(๐”ผ[๐šฒ] โˆ’ ๐œ†2(๐šฒ)) โกโ‰ฅ ๐œ†2(๐”ผ[๐šฒ] โˆ’ ๐œ†2(๐šฒ)) (B.5) This implies that ๐’ˆ๐’ˆโŠค is the unique solution to the semidefinite programming. Proof for Theorem 3.6 The method to approach the problem is by applying spectral approximation of random Laplacian matrix algorithm. However, ฮ“DSBM is not a Laplacian matrix. Therefore, we will try to construct a Laplacian matrix ฮ“DSBM โ€ฒ to help solve the problem. W.L.O.G. we let ๐’ˆ = (๐Ÿ๐‘›/2, โˆ’๐Ÿ๐‘›/2, ๐Ÿ๐‘›/2, โˆ’๐Ÿ๐‘›/2), and we define: ฮ“DSBM โ€ฒ = diagโก(๐’ˆ)ฮ“DSBMdiagโก(๐’ˆ) (B.6) Both the eigenvalue and the diagonal elements of ๐”ผ[ฮ“DSBM โ€ฒ ] โˆ’ ฮ“DSBM โ€ฒ are the same as those of ๐”ผ[ฮ“DSBM] โˆ’ ฮ“DSBM . The off-diagonal entries of ฮ“DSBM โ€ฒ = โˆ’๐‘จ๐‘–๐‘—๐‘”๐‘–๐‘”๐‘– . Then we apply spectral approximation of random Laplacian matrix algorithm, we let ๐‘ณ = ๐”ผ[ฮ“DSBM โ€ฒ ] โˆ’ ฮ“DSBM โ€ฒ , where ๐‘ณ has www.scholink.org/ojs/index.php/asir Applied Science and Innovative Research Vol. 8, No. 1, 2024 75 Published by SCHOLINK INC. independent off-diagonal entries. Then we have: โˆ‘ โ€Š๐‘—โˆˆ[2๐‘›]/๐‘– ๐”ผ[๐‘ณ๐‘–๐‘— 2 ] = ( ๐‘› 2 โˆ’ 1)๐‘(1 โˆ’ ๐‘) + ๐‘› 2 ๐‘ž(1 โˆ’ ๐‘ž) โ‰ค ๐‘› 2 โˆ— 1 4 (๐‘ + ๐‘ž) > ๐‘› 8 2logโก๐‘› ๐‘๐‘› (1 โˆ’ ๐‘ž)2 = logโก๐‘› 4๐‘ max ๐‘–โ‰ ๐‘— โ€Šโˆฅโˆฅ๐‘ณ๐‘–๐‘—โˆฅโˆฅโˆž 2 (B.7) Where it exists a constant ๐šซโ€ฒ such that with high probability, ๐œ†max(๐”ผ[ฮ“DSBM โ€ฒ ] โˆ’ ฮ“๐ท๐‘†๐ต๐‘€ โ€ฒ ) โ‰ค (1 + ๐šซโ€ฒ โˆšlogโก๐‘› ) max ๐‘–โˆˆ[2๐‘›] โ€Š[๐”ผ[(ฮ“DSBM โ€ฒ )๐‘–๐‘–] โˆ’ (ฮ“DSBM โ€ฒ )๐‘–๐‘–] (B.8) and it is the same as the following: ๐œ†max(๐”ผ[ฮ“DSBM] โˆ’ ฮ“๐ท๐‘†๐ต๐‘€) โ‰ค (1 + ๐šซโ€ฒ โˆšlogโก๐‘› ) max ๐‘–โˆˆ[2๐‘›] โ€Š[๐”ผ[(ฮ“DSBM)๐‘–๐‘–] โˆ’ (ฮ“DSBM)๐‘–๐‘–] (B.9) It is worth mentioning that โกโกโกโกโกโก min ๐‘–โˆˆ[2๐‘›] โ€Š((๐’Ÿ+)๐‘–๐‘– โˆ’ (๐’Ÿโˆ’)๐‘–๐‘–)โกโ‰ฅ (1 + ๐šซโ€ฒ โˆšlogโก๐‘› ) max ๐‘–โˆˆ[2๐‘›] โ€Š[๐”ผ[(ฮ“DSBM)๐‘–๐‘–] โˆ’ (ฮ“DSBM)๐‘–๐‘–] โก= (1 โˆ’ ๐šซโ€ฒ โˆšlogโก๐‘› ) ( ๐‘› 2 (๐‘ โˆ’ ๐‘ž) โˆ’ ๐‘)โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก(B. 10) โกโ‰ฅ max ๐‘–โˆˆ[2๐‘›] โ€Š(๐”ผ[(ฮ“DSBM โ€ฒ )๐‘–๐‘–] โˆ’ (ฮ“DSBM โ€ฒ )๐‘–๐‘– Therefore we have: ๐œ†max(๐”ผ[ฮ“DSBM โ€ฒ ] โˆ’ ฮ“๐ท๐‘†๐ต๐‘€ โ€ฒ ) โ‰ค (1 + ๐šซโ€ฒ โˆšlogโก๐‘› )(1 โˆ’ ๐šซโ€ฒ โˆšlogโก๐‘› ) ( ๐‘› 2 (๐‘ โˆ’ ๐‘ž) โˆ’ ๐‘)โกโกโกโกโกโกโกโกโกโก(B. 11) For each ๐šซโ€ฒ, there exists at least one ๐šซโ€ฒ > 0 such that: โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก(1 โˆ’ ๐šซโ€ฒ โˆšlogโก๐‘› )(1 + ๐šซโ€ฒ โˆšlogโก๐‘› ) < 1โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก(B. 12) Hence โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก๐œ†max(๐”ผ[ฮ“DSBM โ€ฒ ] โˆ’ ฮ“๐ท๐‘†๐ต๐‘€ โ€ฒ ) < ๐‘› 2 (๐‘ โˆ’ ๐‘ž)โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก(B. 13) can guarantee the exact recovery of DSBM. Proof for Lemma 3.7 Lemma B.1. Recall definition ๐ด. 3, let ๐‘Ž, ๐‘ and ๐šซโ€ฒ be constants. We have, โกโกโกโก๐‘‡ ( ๐‘› 2 , ๐‘Žlogโก(๐‘›) ๐‘› , ๐‘logโก(๐‘›) ๐‘› , โˆ’ฮ”โ€ฒโˆšlogโก(๐‘›)) โ‰ค expโก[โˆ’ ( ๐‘Ž + ๐‘ 2 โˆ’ โˆš๐‘Ž๐‘ โˆ’ ๐›ฟ(๐‘›)) logโก(๐‘›)]โกโกโกโกโก(B. 14) with lim๐‘›โ†’โˆž โ€Š๐›ฟ(๐‘›) Proof of this lemma can be found in [2]. We are now ready to prove Lemma 3.7 Let ๐‘Ž > ๐‘ be constants and satisfy โˆš๐‘Ž โˆ’ โˆš๐‘ > โˆš2. Given ฮ” > 0, we want to prove that with high probability โกโกโกโกโกโกโกโกโกโกโก min ๐‘–โˆˆ[2๐‘›] โ€Š(๐’Ÿ๐‘–๐‘– + โˆ’ ๐’Ÿ๐‘–๐‘– โˆ’) โ‰ฅ ๐šซ logโก(๐‘›) ๐”ผ[deg๐ถ +โก(๐‘–) โˆ’ deg๐ถ โˆ’โก(๐‘–)] = ๐šซ logโก(๐‘›) ๐‘› 2 (๐‘ โˆ’ ๐‘ž)โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก(B. 15) For fixed ๐‘– throughout the proof. We can write www.scholink.org/ojs/index.php/asir Applied Science and Innovative Research Vol. 8, No. 1, 2024 76 Published by SCHOLINK INC. โกโกโกโกโกโกโกโกโกโกโกโกโกโก(๐ท+)๐‘–๐‘– โˆ’ (๐ทโˆ’)๐‘–๐‘– = ( โˆ‘ โ€Š ๐‘›/2โˆ’1 ๐‘–=1 โ€Š๐‘Š๐‘–) โˆ’ (โˆ‘โ€Š ๐‘›/2 ๐‘–=1 โ€Š๐‘๐‘–) = โˆ‘ โ€Š ๐‘›/2โˆ’1 ๐‘–=1 (๐‘Š๐‘– โˆ’ ๐‘๐‘–) + ๐‘๐‘›/2โกโกโกโกโกโกโกโกโกโกโกโกโก(B. 16) Hence, we substitute ๐‘ and ๐‘ž with ๐‘Žlogโก(๐‘›) ๐‘› and ๐‘logโก(๐‘›) ๐‘› respectively โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก ๐šซ โˆšlogโก(๐‘›) ( ๐‘› 2 (๐‘ โˆ’ ๐‘ž)) = ฮ”โˆšlogโก(๐‘›) ( ๐‘Ž โˆ’ ๐‘ 2 )โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก(B. 17) We have the probability of degin โก(๐‘–) โˆ’ degout โก(๐‘–) < ๐šซ โˆšlogโก(๐‘›) (๐‘›/2(๐‘ โˆ’ ๐‘ž)) is equal to โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก โ„™( โˆ‘ โ€Š ๐‘›/2โˆ’1 ๐‘–=1 โ€Š (๐‘Š๐‘– โˆ’ ๐‘๐‘–) + ๐‘๐‘›/2 < ฮ”โˆšlogโก(๐‘›) ( ๐‘Ž โˆ’ ๐‘ 2 )) =โ„™( โˆ‘ โ€Š ๐‘›/2โˆ’1 ๐‘–=1 โ€Š (๐‘๐‘– โˆ’๐‘Š๐‘–) โˆ’ ๐‘๐‘›/2 > โˆ’ฮ”โˆšlogโก(๐‘›) ( ๐‘Ž โˆ’ ๐‘ 2 )) โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก(B. 18) which is upper bounded by, โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโ„™ [โˆ‘ โ€Š ๐‘›/2 ๐‘–=1 โ€Š (๐‘๐‘– โˆ’๐‘Š๐‘–) > โˆ’ฮ”โˆšlogโก(๐‘›) ( ๐‘Ž โˆ’ ๐‘ 2 )]โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก(B. 19) We let ๐šซโ€ฒ = ๐šซ( ๐‘Žโˆ’๐‘ 2 ) + 1, then using the previous definition, we can obtain the following inequalities: โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโ„™((๐’Ÿ๐‘–๐‘– + โˆ’๐’Ÿ๐‘–๐‘– โˆ’) < ๐šซ logโก(๐‘›) ๐”ผ[deg๐ถ +โก(๐‘–) โˆ’ deg๐ถ โˆ’โก(๐‘–)]) โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโ‰ค ๐‘‡ ( ๐‘› 2 , ๐‘Žlogโก(๐‘›) ๐‘› , ๐‘logโก(๐‘›) ๐‘› , โˆ’๐šซโ€ฒโˆšlogโก(๐‘›)) โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโ‰ค expโก[โˆ’ ( ๐‘Ž + ๐‘ 2 โˆ’ โˆš๐‘Ž๐‘ โˆ’ ๐›ฟ(๐‘›)) logโก(๐‘›)] โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก(B. 20) By using union bound, we can have: โกโกโกโ„™ [ min ๐‘–โˆˆ[2๐‘›] โ€Š(๐‘ซ๐‘–๐‘– + โˆ’๐‘ซ๐‘–๐‘– โˆ’ < ๐šซ โˆšlogโก(๐‘›) ๐‘› 2 (๐‘ โˆ’ ๐‘ž))] โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโ‰ค expโก[โˆ’ ( ๐‘Ž + ๐‘ 2 โˆ’ โˆš๐‘Ž๐‘ โˆ’ 1 โˆ’ ๐›ฟ(๐‘›)) logโก(๐‘›)] โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก(B21) from this, if we have ๐‘Ž+๐‘ 2 โˆ’ โˆš๐‘Ž๐‘ > 1, which can be re-written into โˆš๐‘Ž โˆ’ โˆš๐‘ > โˆš2, then this means that the probability of โ„™ [min๐‘–โˆˆ[2๐‘›] โ€Š(๐‘ซ๐‘–๐‘– + โˆ’๐‘ซ๐‘–๐‘– โˆ’ < ๐šซ โˆšlogโก(๐‘›) ๐‘› 2 (๐‘ โˆ’ ๐‘ž))] is negative. Then when โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโˆš๐‘Ž โˆ’ โˆš๐‘ > โˆš2โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก(B. 22) it holds true with high probability that โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก min ๐‘–โˆˆ[2๐‘›] โ€Š(๐’Ÿ๐‘–๐‘– + โˆ’ ๐’Ÿ๐‘–๐‘– โˆ’) โ‰ฅ ๐šซ logโก(๐‘›) ๐”ผ[deg๐ถ +โก(๐‘–) โˆ’ deg๐ถ โˆ’โก(๐‘–)]โกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโกโก(B. 23) www.scholink.org/ojs/index.php/asir Applied Science and Innovative Research Vol. 8, No. 1, 2024 77 Published by SCHOLINK INC. References Afonso S. Bandeira. (2015). Random Laplacian matrices and convex relaxations. https://doi.org/10.1007/s10208-016-9341-9 Andrea Lancichinetti, Santo Fortunato, & Filippo Radicchi. (2008). Benchmark graphs for testing community detection algorithms. In Physical Review E 78.4. https://doi.org/10.1103/PhysRevE.78.046110 Emmanuel Abbe, Afonso S. Bandeira, & Georgina Hall. (2014). Exact Recovery in the Stochastic Block Model. In CoRR abs/1405.3267. Emmanuel Abbe, Afonso S. Bandeira, & Georgina Hall. (2014). Exact Recovery in the Stochastic Block Model. Girvan, M., & Newman, M. E. J. (2002). Community structure in social and biological networks. In Proceedings of the National Academy of Sciences 99.12 (pp. 7821-7826). https://doi.org/10.1073/pnas.122653799 Newman, M. E. J. (2003). The Structure and Function of Complex Networks. In SIAM Review 45.2 (pp. 167-256). https://doi.org/10.1137/S003614450342480 Santo Fortunato. (2010). Community detection in graphs. In Physics Reports 486.3-5 (pp. 75-174). https://doi.org/10.1016/j.physrep.2009.11.002