The Evolution of Cooperation in Spatially Heterogeneous Populations

A challenging problem in sociobiology is to understand the emergence of cooperation in a nonsocial world. Recent models of the iterated Prisoner's Dilemma (IPD) game conclude that population mixing due to individual mobility limits cooperation; however, these models represent space only implicitly. Here we develop a dynamical IPD model where temporal and spatial variations in the population are explicitly considered. Our model accounts for the stochastic motion of individuals and the inherent nonrandomness of local interactions. By deriving a spatial version of Hamilton's rule, we find that a threshold level of mobility in selfish always-defect (AD) players is required to beget invasion by social 'tit for tat'(TFT) players. Furthermore, the level of mobility of successful TFT newcomers must be approximately equal to or somewhat higher than that of resident defectors. Significant mobility promotes the assortment of TFT pioneers on the front of invasion and of AD intruders in the core of a cooperative cluster. It also maximizes the likelihood of TFT retaliation. Once this first step whereby TFT takes over AD is completed, more generous and perhaps more suspicious strategies may outperform and displace TFT. We derive the conditions under which this continued evolution of more robust cooperative strategies occurs

Asexual and sexual replication in sporulating organisms

This paper develops models describing asexual and sexual replication in sporulating organisms. Replication via sporulation is the replication strategy for all multicellular life, and may even be observed in unicellular life (such as with budding yeast). We consider diploid populations replicating via one of two possible sporulation mechanisms: (1) Asexual sporulation, whereby adult organisms produce single-celled diploid spores that grow into adults themselves. (2) Sexual sporulation, whereby adult organisms produce single-celled diploid spores that divide into haploid gametes. The haploid gametes enter a haploid "pool", where they may recombine with other haploids to form a diploid spore that then grows into an adult. We consider a haploid fusion rate given by second-order reaction kinetics. We work with a simplified model where the diploid genome consists of only two chromosomes, each of which may be rendered defective with a single point mutation of the wild-type. We find that the asexual strategy is favored when the rate of spore production is high compared to the characteristic growth rate from a spore to a reproducing adult. Conversely, the sexual strategy is favored when the rate of spore production is low compared to the characteristic growth rate from a spore to a reproducing adult. As the characteristic growth time increases, or as the population density increases, the critical ratio of spore production rate to organism growth rate at which the asexual strategy overtakes the sexual one is pushed to higher values. Therefore, the results of this model suggest that, for complex multicellular organisms, sexual replication is favored at high population densities, and low growth and sporulation rates.Comment: 8 pages, 5 figures, to be submitted to Journal of Theoretical Biology, figures not included in this submissio

Group selection models in prebiotic evolution

The evolution of enzyme production is studied analytically using ideas of the group selection theory for the evolution of altruistic behavior. In particular, we argue that the mathematical formulation of Wilson's structured deme model ({\it The Evolution of Populations and Communities}, Benjamin/Cumings, Menlo Park, 1980) is a mean-field approach in which the actual environment that a particular individual experiences is replaced by an {\it average} environment. That formalism is further developed so as to avoid the mean-field approximation and then applied to the problem of enzyme production in the prebiotic context, where the enzyme producer molecules play the altruists role while the molecules that benefit from the catalyst without paying its production cost play the non-altruists role. The effects of synergism (i.e., division of labor) as well as of mutations are also considered and the results of the equilibrium analysis are summarized in phase diagrams showing the regions of the space of parameters where the altruistic, non-altruistic and the coexistence regimes are stable. In general, those regions are delimitated by discontinuous transition lines which end at critical points.Comment: 22 pages, 10 figure

Evolutionary connectionism: algorithmic principles underlying the evolution of biological organisation in evo-devo, evo-eco and evolutionary transitions

The mechanisms of variation, selection and inheritance, on which evolution by natural selection depends, are not fixed over evolutionary time. Current evolutionary biology is increasingly focussed on understanding how the evolution of developmental organisations modifies the distribution of phenotypic variation, the evolution of ecological relationships modifies the selective environment, and the evolution of reproductive relationships modifies the heritability of the evolutionary unit. The major transitions in evolution, in particular, involve radical changes in developmental, ecological and reproductive organisations that instantiate variation, selection and inheritance at a higher level of biological organisation. However, current evolutionary theory is poorly equipped to describe how these organisations change over evolutionary time and especially how that results in adaptive complexes at successive scales of organisation (the key problem is that evolution is self-referential, i.e. the products of evolution change the parameters of the evolutionary process). Here we first reinterpret the central open questions in these domains from a perspective that emphasises the common underlying themes. We then synthesise the findings from a developing body of work that is building a new theoretical approach to these questions by converting well-understood theory and results from models of cognitive learning. Specifically, connectionist models of memory and learning demonstrate how simple incremental mechanisms, adjusting the relationships between individually-simple components, can produce organisations that exhibit complex system-level behaviours and improve the adaptive capabilities of the system. We use the term “evolutionary connectionism” to recognise that, by functionally equivalent processes, natural selection acting on the relationships within and between evolutionary entities can result in organisations that produce complex system-level behaviours in evolutionary systems and modify the adaptive capabilities of natural selection over time. We review the evidence supporting the functional equivalences between the domains of learning and of evolution, and discuss the potential for this to resolve conceptual problems in our understanding of the evolution of developmental, ecological and reproductive organisations and, in particular, the major evolutionary transitions

Learning and innovative elements of strategy adoption rules expand cooperative network topologies

Cooperation plays a key role in the evolution of complex systems. However, the level of cooperation extensively varies with the topology of agent networks in the widely used models of repeated games. Here we show that cooperation remains rather stable by applying the reinforcement learning strategy adoption rule, Q-learning on a variety of random, regular, small-word, scale-free and modular network models in repeated, multi-agent Prisoners Dilemma and Hawk-Dove games. Furthermore, we found that using the above model systems other long-term learning strategy adoption rules also promote cooperation, while introducing a low level of noise (as a model of innovation) to the strategy adoption rules makes the level of cooperation less dependent on the actual network topology. Our results demonstrate that long-term learning and random elements in the strategy adoption rules, when acting together, extend the range of network topologies enabling the development of cooperation at a wider range of costs and temptations. These results suggest that a balanced duo of learning and innovation may help to preserve cooperation during the re-organization of real-world networks, and may play a prominent role in the evolution of self-organizing, complex systems.Comment: 14 pages, 3 Figures + a Supplementary Material with 25 pages, 3 Tables, 12 Figures and 116 reference

The meaning of life in a developing universe

The evolution of life on Earth has produced an organism that is beginning to model and understand its own evolution and the possible future evolution of life in the universe. These models and associated evidence show that evolution on Earth has a trajectory. The scale over which living processes are organized cooperatively has increased progressively, as has its evolvability. Recent theoretical advances raise the possibility that this trajectory is itself part of a wider developmental process. According to these theories, the developmental process has been shaped by a larger evolutionary process that involves the reproduction of universes. This evolutionary process has tuned the key parameters of the universe to increase the likelihood that life will emerge and develop to produce outcomes that are successful in the larger process (e.g. a key outcome may be to produce life and intelligence that intentionally reproduces the universe and tunes the parameters of ‘offspring’ universes). Theory suggests that when life emerges on a planet, it moves along this trajectory of its own accord. However, at a particular point evolution will continue to advance only if organisms emerge that decide to advance the evolutionary process intentionally. The organisms must be prepared to make this commitment even though the ultimate nature and destination of the process is uncertain, and may forever remain unknown. Organisms that complete this transition to intentional evolution will drive the further development of life and intelligence in the universe. Humanity’s increasing understanding of the evolution of life in the universe is rapidly bringing it to the threshold of this major evolutionary transition

Growth dynamics and the evolution of cooperation in microbial populations

Microbes providing public goods are widespread in nature despite running the risk of being exploited by free-riders. However, the precise ecological factors supporting cooperation are still puzzling. Following recent experiments, we consider the role of population growth and the repetitive fragmentation of populations into new colonies mimicking simple microbial life-cycles. Individual-based modeling reveals that demographic fluctuations, which lead to a large variance in the composition of colonies, promote cooperation. Biased by population dynamics these fluctuations result in two qualitatively distinct regimes of robust cooperation under repetitive fragmentation into groups. First, if the level of cooperation exceeds a threshold, cooperators will take over the whole population. Second, cooperators can also emerge from a single mutant leading to a robust coexistence between cooperators and free-riders. We find frequency and size of population bottlenecks, and growth dynamics to be the major ecological factors determining the regimes and thereby the evolutionary pathway towards cooperation.Comment: 26 pages, 6 figure

Considering Intra-individual Genetic Heterogeneity to Understand Biodiversity

In this chapter, I am concerned with the concept of Intra-individual Genetic Hetereogeneity (IGH) and its potential influence on biodiversity estimates. Definitions of biological individuality are often indirectly dependent on genetic sampling -and vice versa. Genetic sampling typically focuses on a particular locus or set of loci, found in the the mitochondrial, chloroplast or nuclear genome. If ecological function or evolutionary individuality can be defined on the level of multiple divergent genomes, as I shall argue is the case in IGH, our current genetic sampling strategies and analytic approaches may miss out on relevant biodiversity. Now that more and more examples of IGH are available, it is becoming possible to investigate the positive and negative effects of IGH on the functioning and evolution of multicellular individuals more systematically. I consider some examples and argue that studying diversity through the lens of IGH facilitates thinking not in terms of units, but in terms of interactions between biological entities. This, in turn, enables a fresh take on the ecological and evolutionary significance of biological diversity

Horizontal DNA transfer mechanisms of bacteria as weapons of intragenomic conflict

Horizontal DNA transfer (HDT) is a pervasive mechanism of diversification in many microbial species, but its primary evolutionary role remains controversial. Much recent research has emphasised the adaptive benefit of acquiring novel DNA, but here we argue instead that intragenomic conflict provides a coherent framework for understanding the evolutionary origins of HDT. To test this hypothesis, we developed a mathematical model of a clonally descended bacterial population undergoing HDT through transmission of mobile genetic elements (MGEs) and genetic transformation. Including the known bias of transformation toward the acquisition of shorter alleles into the model suggested it could be an effective means of counteracting the spread of MGEs. Both constitutive and transient competence for transformation were found to provide an effective defence against parasitic MGEs; transient competence could also be effective at permitting the selective spread of MGEs conferring a benefit on their host bacterium. The coordination of transient competence with cell-cell killing, observed in multiple species, was found to result in synergistic blocking of MGE transmission through releasing genomic DNA for homologous recombination while simultaneously reducing horizontal MGE spread by lowering the local cell density. To evaluate the feasibility of the functions suggested by the modelling analysis, we analysed genomic data from longitudinal sampling of individuals carrying Streptococcus pneumoniae. This revealed the frequent within-host coexistence of clonally descended cells that differed in their MGE infection status, a necessary condition for the proposed mechanism to operate. Additionally, we found multiple examples of MGEs inhibiting transformation through integrative disruption of genes encoding the competence machinery across many species, providing evidence of an ongoing "arms race." Reduced rates of transformation have also been observed in cells infected by MGEs that reduce the concentration of extracellular DNA through secretion of DNases. Simulations predicted that either mechanism of limiting transformation would benefit individual MGEs, but also that this tactic's effectiveness was limited by competition with other MGEs coinfecting the same cell. A further observed behaviour we hypothesised to reduce elimination by transformation was MGE activation when cells become competent. Our model predicted that this response was effective at counteracting transformation independently of competing MGEs. Therefore, this framework is able to explain both common properties of MGEs, and the seemingly paradoxical bacterial behaviours of transformation and cell-cell killing within clonally related populations, as the consequences of intragenomic conflict between self-replicating chromosomes and parasitic MGEs. The antagonistic nature of the different mechanisms of HDT over short timescales means their contribution to bacterial evolution is likely to be substantially greater than previously appreciated