40 On the Propagation of Chaos for Recombination Models On the Propagation of Chaos for Recombination Models Lu Kevin Ong Institute of Mathematics University of the Philippines Diliman ABSTRACT We consider binary interactions in an N-particle system. In particular, we use probability distributions known as recombination models to describe these interactions. Chaos propagates when the stochastic independence of two random particles in a particle system persists in time, as the number of particles tends to infinity. The concept of propagation of chaos was first introduced by Kac in connection with the Boltzmann equation, while modeling binary collisions in a gas. We obtain a development of Kac’s program in the framework of recombination models. Specifically, our aim is to prove the relevant propagation of chaos phenomenon for our particle system. We first show that the solution for the master equation of our time-continuous process converges. Then, we use this solution together with the concepts of marginal measure and chaos to prove our desired result. Our main theorem for this study says that if a sequence of measures on our defined particle system is chaotic, then the resulting sequence of measures that had undergone the recombination process is also chaotic. This implies that the study of one particle after recombination gives information on the behavior of a group of particles in our particle system. Keywords: particle system, recombination, master equation, propagation of chaos INTRODUCTION In 1956, Kac investigated the probabilistic foundations of kinetic theory and introduced the concept of propagation of chaos for the Boltzmann equation. Gottlieb (1998) stated in his thesis that Kac invented a class of interacting particle systems wherein particles collide at random with each other while the density of particles evolves deterministically in the limit of infinite particle number. He also described the concept of propagation of chaos in general, and stated that chaos propagates when the stochastic independence of two random particles in a particle system persists in time, as the number of particles tends to infinity. Several topics in propagation of chaos play a major role in the field of probability, as discussed by Sznitman (1991). In particular, he wrote that one motivation for Science Diliman (January-June 2021) 33:1, 40-56 L.K. Ong 41 the subject was to investigate the connection between a detailed and a reduced description of the particles’ evolution. He also stated that propagation of chaos deals with symmetric evolution of particles. That is, the study of one individual provides information on the behavior of the group. Another research related to this topic includes the paper of McKean (1967), where he introduced propagation of chaos for interacting diffusions and analyzed what are now called McKean-Vlasov equations. More recently in 2018, Thai studied a discrete version of the particle approximation of the McKean-Vlasov equations, and she proved the propagation of chaos property as well. Many authors are concerned with proving that specific systems propagate chaos. In this study, we observe the propagation of chaos property for recombination models. Rabani et al. (1995) stated that random matings occur between parental chromosomes via a mechanism known as “crossover”; that is, children inherit pieces of genetic material from different parents according to some random rule. Recombination models are probability distributions that represent this randomness. In 2016, Caputo and Sinclair stated that recombination models based on random mating have a number of applications in the natural sciences and play a significant role in the analysis of genetic algorithms. Moreover, they used quadratic dynamical systems to study the rate of convergence to equilibrium in terms of relative entropy for recombination models. Let Ω n = {-1,1}n for a fixed natural number n. For each natural number N, we consider the state space Ω = Ω n N . We think of each state as a sequence of N particles in the system, where each particle is represented by a string of bits in Ω n . Our main result in this paper is on the propagation of chaos phenomenon for recombination models that is represented by the interaction in this particle system. MATERIALS AND METHODS Recombination Models Let [n] denote the set {1, ..., n}. Given A ⊂ [n] and σ ∈ Ω n , we write σ A for the A-component of σ, that is, the subsequence (σ j , j ∈ A). For example, suppose n = 5 and let σ = (−1, −1, 1, −1, 1), A = {2, 3, 5}. Then σ A = (−1, 1, 1). Definition 1. (Recombination at a Set). Given A ⊂ [n] and (σ, η) ∈ Ω n × Ω n , the recombination of (σ, η) at A consists in exchanging the A-component of σ with the A-component of η. This defines the map (σ, η) → (η A σ A c, σ A η A c ), On the Propagation of Chaos for Recombination Models 42 On the Propagation of Chaos for Recombination Models where Ac is the complement of set A, and the components of η A σ A c ∈ Ω n is defined by (η A σ AC ) j = η j if j ∈A, σ j if j ∈AC . ⎧ ⎨ ⎪ ⎩⎪ ⎫ ⎬ ⎪ ⎭⎪ We have a similar definition for the components of σ A η A c. For example, suppose n = 5 and let σ = (−1, −1, 1, −1, 1), η = (−1, 1, 1, 1, −1), A = {2, 3, 5}. Then η A σ A c = (−1, 1, 1, −1, −1) and σ A η A c = (−1, −1, 1, 1, 1). The following process is motivated by the discussion of Carlen et al. (2010). Definition 2. (Recombination Walk). Let S = (σ(1), σ(2), ..., σ(N)) denote a state in Ω, where σ(i) ∈ Ω n for each i ∈ [N ]. S represents a set of N particles in our system. Recombination walk on Ω is a process that illustrates the evolution of an initial state S by applying recombinations on a random pair of particles at each step. We describe the process as follows: 1. Randomly pick a pair (k, l) of distinct indices in [N], uniformly chosen from among all such pairs. 2. Choose a subset A ⊂ [n] at random according to some probability distribution ν. 3. Update S by leaving σ(i) unchanged for i ≠ k, l, and updating the particles σ(k) and σ(l) via the recombination at A. Let R k,l,A S denote the new state in Ω. That is, if we assume k < l, the mapping R k,l,A on Ω is given by (σ(1), σ(2), ..., σ(N)) → (σ(1), ..., σ(l) σ(k) , ..., σ(k) , σ(l) , ..., σ(N)). Here are some examples of recombination models represented by ν, from Caputo and Siclair (2016): 1. Single sire recombination: v(A) 1 n 1(A = {i} 1=1 n ∑ ), where 1 is an indicator function on subsets of [n]. That is, 1(A = {i}) = 1 if A = {i} for some i ∈[n], 0 otherwise. ⎧ ⎨ ⎪ ⎩⎪ ⎫ ⎬ ⎪ ⎭⎪ 2. One-point crossover: v(A) = 1 n+ 1 1(A = J i i=0 n ∑ ), where J0 = {} and Ji = [i] for i ≥ 1. A A c A A c L.K. Ong 43 3. Uniform crossover: v(A) = 1 2n , for all A ⊂ [n]. 4. The Bernoulli (q) model: for some q ∈ [0, 1/2], v(A) = q |A|(1−q)n−|A|. Master Equation Let S j denote the position after the jth step of the walk and φ ∈ RΩ be a bounded Borel- measurable function on Ω. We let T : φ → Q N φ be the Markov transition operator on RΩ represented by the transition matrix Q N . Based on the defined process above, the function (Q N φ) ∈ RΩ is given by (Q N ϕ)(S) = E[ϕ(S j+1 ) | S j = S] = N 2 ⎛ ⎝⎜ ⎞ ⎠⎟ −1 v(A)φ(R k ,l,A S). A ∑ 1≤k 0, the law µ t (N) of S t has a density F t (N) with respect to π, where F t (N) is the solution of the following equation d dt F N( ) = L N µ(N ) t,S( ) with F (N ) (0,S) = F0 N( ) S( ),                      (1) where L N = N (Q N − I) and I is the identity matrix. Remarks: 1. Note that L N is self-adjoint, since Q N is symmetric. 2. As defined in the proposition, we have µ t (N)(S) = F (N)(t, S)π(S) and thus (1) is equivalent to d dt µ N( ) = L N µ(N ) t,S( ) with µ(N ) (0,S) = µ0(N ) S( ). (2) 3. The solution µ t (N) of (2) is given by µ t (N ) = etLN µ 0 (N ) = t j j!j=0 ∞ ∑ LN j µ 0 (N ). Propagation of Chaos We now present some known definitions needed for our theorem. The following definition is taken from Carlen et al. (2010). Definition 5. (Marginal Measure). Let µ(N) be a probability measure on Ω and let k be a positive integer with k < N. The marginal measure of µ(N) for the first k particles on A⊂ Ωk n is defined as P k (µ(N))[A] = µ(N)[{(σ(1), ..., σ(k)) ∈ A}]. We adopt the following definition from Sznitman (1991). L.K. Ong 45 Definition 6. (Chaos). Let µ be a probability measure on Ω n . Let {µ(N)} ∞N =1 be a sequence of symmetric probability measures on Ω, i.e., the value is the same no matter the order of its arguments. We say that {µ(N)} ∞N =1 is µ-chaotic if for {g k : 1 ≤ k < N } ⊂ C b (Ω n ), where C b (Ω n ) is the set of bounded functions from Ω to R, we have lim N→∞ g(S)µ(N ) (S) S∈Ω ∑ = gt (σ )µ σ ∈Ω n ∑ (σ ). ⎛ ⎝⎜ ⎞ ⎠⎟t=1 k ∏ , (3) where g = g 1 ⊗ g 2 ⊗ ... ⊗ g k ⊗ 1 ⊗ ... ⊗ 1 with N − k copies of the 1. We adopt the following definition from Gottlieb (1998). Definition 7. (Propagation of Chaos). A sequence {Q N } ∞N =1 whose N -th term is a Markov transition function on Ω propagates chaos if, whenever a sequence of measures {µ(N)} ∞N =1 ⊂ Ω is µ-chaotic for some measure µ ∈ Ωn, then for any t ≥ 0, the sequence {µ t (N)} ∞N =1 ⊂ Ω which satisfies (2) is µ̄ t-chaotic for some measure µ̄ t ∈ Ω n . RESULTS AND DISCUSSION We now present our main result for this study in the following theorem. Statement of the Main Result Theorem 8. (Propagation of Chaos for Recombination Models). Let µ(N) be the probability measure on Ω with probability density F (N) with respect to π. Suppose that {µ(N)} ∞N =1 is a µ-chaotic family, where µ is some probability measure on Ω n . For each natural number N, let F (N)(t, ·) denote the solution of (1) at time t, starting from the initial data F (N). Let µ(N)(t, ·) be the measure on Ω with probability density F (N)(t, ·), with initial measure µ(N) at t = 0. Then for any t ≥ 0, {µ(N)(t, ·)} ∞N =1 is µ(t, σ)-chaotic, where µ(t, σ) is the solution of the following problem: µ(0,⋅) = µ d dt µ(t,σ ) = v(A)[µ A (t,σ A )⊗ µ AC (t,σ AC )− µ(t,σ )], A ∑ ⎧ ⎨ ⎪ ⎩ ⎪ (4) where µ A (t,σ A ) = µ(t,σ ). σ AC ∑ On the Propagation of Chaos for Recombination Models 46 On the Propagation of Chaos for Recombination Models Remarks: 1. For each natural number N, we will use the notation µ(N)(·) instead of µ(N)(0, ·). 2. From the discussion of Hauray and Mischler (2014): Suppose µ(N) is symmetric. Define the empirical measure of the system as M n (t,∑) = 1 N δ σ (1)(t ) t=1 N ∑ (∑), where ∑ is a subset of Ω n and δ is the Dirac measure. That is, δ σ (1)(t ) (∑) = 1, if σ (i )(t)∈∑, 0, otherwise. ⎧ ⎨ ⎪ ⎩⎪ Then µ(N) is µ-chaotic is equivalent to saying that lim N→∞ M N (t,Σ) = µ(t,Σ). Moreover, it is also equivalent to condition (3) with k = 2. We will use this later in the proof of our theorem. 3. The differential equation given in (4) has a unique solution, as shown by Baake et al. (2016) in the general case. In our theorem, this solution is given by µ(t, σ), which we will choose appropriately in our proof. We will first prove three lemmas that will be needed for the proof of our theorem. Three Lemmas The first lemma that we will prove concerns the convergence of the series that we will get from the solution of (2). Lemma 9. Let g ∈ C b (Ω) that depends only on σ(1), ..., σ(k). If T < 1/4, for any natural number N, the power series etLNg = t j j!j=0 ∞ ∑ LN j g, (5) absolutely converges for t ∈ [0, T]. L.K. Ong 47 Proof: Suppose that g depends only on one particle and, without loss of generality, we can set this to be the first particle. That is, for some g : Ωn → R, we have g(S) = g(σ(1), ..., σ(N)) = g(σ(1)). Since g ∈ C b (Ω), this implies that g ∈ C b (Ω n ), that is for all σ ∈ Ω n , |g(σ)| < M for some M ∈ R. Let N be a natural number. Since L N = N (Q N − I), by using the definition of Q N , we have for any S = (σ(1), σ(2), ..., σ(N)) that L N g(S) = N N 2 ⎛ ⎝⎜ ⎞ ⎠⎟ −1 v(A)[g(R k ,l,A S A ∑ 1≤k is currently a Ph.D. student and an instructor at the Institute of Mathematics, University of the Philippines Diliman. His research interests include probability theory, mathematical statistics, actuarial mathematics, and dynamical systems. He aims to contribute to the development of mathematics in the Philippines through research and mentorship.