Predictive Entropy Search for Bayesian optimization with unknown constraints

Unknown constraints arise in many types of expensive black-box optimization problems. Several methods have been proposed recently for performing Bayesian optimization with constraints, based on the expected improvement (EI) heuristic. However, EI can lead to pathologies when used with constraints. For example, in the case of decoupled constraints---i.e., when one can independently evaluate the objective or the constraints---EI can encounter a pathology that prevents exploration. Additionally, computing EI requires a current best solution, which may not exist if none of the data collected so far satisfy the constraints. By contrast, information-based approaches do not suffer from these failure modes. In this paper, we present a new information-based method called Predictive Entropy Search with Constraints (PESC). We analyze the performance of PESC and show that it compares favorably to EI-based approaches on synthetic and benchmark problems, as well as several real-world examples. We demonstrate that PESC is an effective algorithm that provides a promising direction towards a unified solution for constrained Bayesian optimization.José Miguel Hernández-Lobato acknowledges support from the Rafael del Pino Foundation. Zoubin Ghahramani acknowledges support from Google Focused Research Award and EPSRC grant EP/I036575/1. Matthew W. Hoffman acknowledges support from EPSRC grant EP/J012300/1.This is the final published version. It first appeared at http://jmlr.org/proceedings/papers/v37/hernandez-lobatob15.html

A General Framework for Constrained Bayesian Optimization using Information-based Search

We present an information-theoretic framework for solving global black-box optimization problems that also have black-box constraints. Of particular interest to us is to efficiently solve problems with $\textit{decoupled}$ constraints, in which subsets of the objective and constraint functions may be evaluated independently. For example, when the objective is evaluated on a CPU and the constraints are evaluated independently on a GPU. These problems require an acquisition function that can be separated into the contributions of the individual function evaluations. We develop one such acquisition function and call it Predictive Entropy Search with Constraints (PESC). PESC is an approximation to the expected information gain criterion and it compares favorably to alternative approaches based on improvement in several synthetic and real-world problems. In addition to this, we consider problems with a mix of functions that are fast and slow to evaluate. These problems require balancing the amount of time spent in the meta-computation of PESC and in the actual evaluation of the target objective. We take a bounded rationality approach and develop a partial update for PESC which trades off accuracy against speed. We then propose a method for adaptively switching between the partial and full updates for PESC. This allows us to interpolate between versions of PESC that are efficient in terms of function evaluations and those that are efficient in terms of wall-clock time. Overall, we demonstrate that PESC is an effective algorithm that provides a promising direction towards a unified solution for constrained Bayesian optimization.Rafael del Pino Foundation, Google Focused Research Award, Engineering and Physical Sciences Research Council (Grant IDs: EP/I036575/1, EP/J012300/1

TEMPRANILLO is a regulator of juvenility in plants

Many plants are incapable of flowering in inductive daylengths during the early juvenile vegetative phase (JVP). Arabidopsis mutants with reduced expression of TEMPRANILLO (TEM), a repressor of FLOWERING LOCUS T (FT) had a shorter JVP than wild-type plants. Reciprocal changes in mRNA expression of TEM and FT were observed in both Arabidopsis and antirrhinum, which correlated with the length of the JVP. FT expression was induced just prior to the end of the JVP and levels of TEM1 mRNA declined rapidly at the time when FT mRNA levels were shown to increase. TEM orthologs were isolated from antirrhinum (AmTEM) and olive (OeTEM) and were expressed most highly during their juvenile phase. AmTEM functionally complemented AtTEM1 in the tem1 mutant and over-expression of AmTEM prolonged the JVP through repression of FT and CONSTANS (CO). We propose that TEM may have a general role in regulating JVP in herbaceous and woody species

Tomato protoplast DNA transformation: physical linkage and recombination of exogenous DNA sequences

Tomato protoplasts have been transformed with plasmid DNA's, containing a chimeric kanamycin resistance gene and putative tomato origins of replication. A calcium phosphate-DNA mediated transformation procedure was employed in combination with either polyethylene glycol or polyvinyl alcohol. There were no indications that the tomato DNA inserts conferred autonomous replication on the plasmids. Instead, Southern blot hybridization analysis of seven kanamycin resistant calli revealed the presence of at least one kanamycin resistance locus per transformant integrated in the tomato nuclear DNA. Generally one to three truncated plasmid copies were found integrated into the tomato nuclear DNA, often physically linked to each other. For one transformant we have been able to use the bacterial ampicillin resistance marker of the vector plasmid pUC9 to 'rescue' a recombinant plasmid from the tomato genome. Analysis of the foreign sequences included in the rescued plasmid showed that integration had occurred in a non-repetitive DNA region. Calf-thymus DNA, used as a carrier in transformation procedure, was found to be covalently linked to plasmid DNA sequences in the genomic DNA of one transformant. A model is presented describing the fate of exogenously added DNA during the transformation of a plant cell. The results are discussed in reference to the possibility of isolating DNA sequences responsible for autonomous replication in tomato.

The Problem Distiller Tool: supporting teachers in uncovering why their students have problems understanding Threshold Concepts

In pressThis study explored the use of a web-based tool entitled ‘Problem Distiller’ designed to support teachers in uncovering why their students have problems understanding Threshold Concepts. Data collected involved interviews with two math teachers, invited to experiment the Problem Distiller tool and Think Aloud protocol. Content analysis was used to process and analyse the collected data.. Findings show that teachers found it helpful when the information they entered through the Problem Distiller was fed back as they constructed an online diagnostic quiz. Focusing on the teachers’ understanding of why the students have problems is an effective way of tackling the barriers posed by Threshold Concepts and can be integrated with existing strategies and teaching approaches.CIEC – Research Centre on Child Studies, IE, UMinho (FCT R&D unit 317), PortugalEuropean Community's Seventh Framework ProgrammeThe research leading to these results has received funding from the European Community's Seventh Framework Programme under grant agreement no. 317964 JUXTALEARN. We would like to thank the interviewed teachers for their valuable collaboration

Coordinated optimization of visual cortical maps (I) Symmetry-based analysis

In the primary visual cortex of primates and carnivores, functional architecture can be characterized by maps of various stimulus features such as orientation preference (OP), ocular dominance (OD), and spatial frequency. It is a long-standing question in theoretical neuroscience whether the observed maps should be interpreted as optima of a specific energy functional that summarizes the design principles of cortical functional architecture. A rigorous evaluation of this optimization hypothesis is particularly demanded by recent evidence that the functional architecture of OP columns precisely follows species invariant quantitative laws. Because it would be desirable to infer the form of such an optimization principle from the biological data, the optimization approach to explain cortical functional architecture raises the following questions: i) What are the genuine ground states of candidate energy functionals and how can they be calculated with precision and rigor? ii) How do differences in candidate optimization principles impact on the predicted map structure and conversely what can be learned about an hypothetical underlying optimization principle from observations on map structure? iii) Is there a way to analyze the coordinated organization of cortical maps predicted by optimization principles in general? To answer these questions we developed a general dynamical systems approach to the combined optimization of visual cortical maps of OP and another scalar feature such as OD or spatial frequency preference.Comment: 90 pages, 16 figure

Coordinated optimization of visual cortical maps (II) Numerical studies

It is an attractive hypothesis that the spatial structure of visual cortical architecture can be explained by the coordinated optimization of multiple visual cortical maps representing orientation preference (OP), ocular dominance (OD), spatial frequency, or direction preference. In part (I) of this study we defined a class of analytically tractable coordinated optimization models and solved representative examples in which a spatially complex organization of the orientation preference map is induced by inter-map interactions. We found that attractor solutions near symmetry breaking threshold predict a highly ordered map layout and require a substantial OD bias for OP pinwheel stabilization. Here we examine in numerical simulations whether such models exhibit biologically more realistic spatially irregular solutions at a finite distance from threshold and when transients towards attractor states are considered. We also examine whether model behavior qualitatively changes when the spatial periodicities of the two maps are detuned and when considering more than 2 feature dimensions. Our numerical results support the view that neither minimal energy states nor intermediate transient states of our coordinated optimization models successfully explain the spatially irregular architecture of the visual cortex. We discuss several alternative scenarios and additional factors that may improve the agreement between model solutions and biological observations.Comment: 55 pages, 11 figures. arXiv admin note: substantial text overlap with arXiv:1102.335

Multiple agency perspective, family control, and private information abuse in an emerging economy

Using a comprehensive sample of listed companies in Hong Kong this paper investigates how family control affects private information abuses and firm performance in emerging economies. We combine research on stock market microstructure with more recent studies of multiple agency perspectives and argue that family ownership and control over the board increases the risk of private information abuse. This, in turn, has a negative impact on stock market performance. Family control is associated with an incentive to distort information disclosure to minority shareholders and obtain private benefits of control. However, the multiple agency roles of controlling families may have different governance properties in terms of investors’ perceptions of private information abuse. These findings contribute to our understanding of the conflicting evidence on the governance role of family control within a multiple agency perspectiv

Prevalence of Disorders Recorded in Dogs Attending Primary-Care Veterinary Practices in England

Purebred dog health is thought to be compromised by an increasing occurence of inherited diseases but inadequate prevalence data on common disorders have hampered efforts to prioritise health reforms. Analysis of primary veterinary practice clinical data has been proposed for reliable estimation of disorder prevalence in dogs. Electronic patient record (EPR) data were collected on 148,741 dogs attending 93 clinics across central and south-eastern England. Analysis in detail of a random sample of EPRs relating to 3,884 dogs from 89 clinics identified the most frequently recorded disorders as otitis externa (prevalence 10.2%, 95% CI: 9.1-11.3), periodontal disease (9.3%, 95% CI: 8.3-10.3) and anal sac impaction (7.1%, 95% CI: 6.1-8.1). Using syndromic classification, the most prevalent body location affected was the head-and-neck (32.8%, 95% CI: 30.7-34.9), the most prevalent organ system affected was the integument (36.3%, 95% CI: 33.9-38.6) and the most prevalent pathophysiologic process diagnosed was inflammation (32.1%, 95% CI: 29.8-34.3). Among the twenty most-frequently recorded disorders, purebred dogs had a significantly higher prevalence compared with crossbreds for three: otitis externa (P = 0.001), obesity (P = 0.006) and skin mass lesion (P = 0.033), and popular breeds differed significantly from each other in their prevalence for five: periodontal disease (P = 0.002), overgrown nails (P = 0.004), degenerative joint disease (P = 0.005), obesity (P = 0.001) and lipoma (P = 0.003). These results fill a crucial data gap in disorder prevalence information and assist with disorder prioritisation. The results suggest that, for maximal impact, breeding reforms should target commonly-diagnosed complex disorders that are amenable to genetic improvement and should place special focus on at-risk breeds. Future studies evaluating disorder severity and duration will augment the usefulness of the disorder prevalence information reported herein

Structural analysis of MDM2 RING separates degradation from regulation of p53 transcription activity

MDM2–MDMX complexes bind the p53 tumor-suppressor protein, inhibiting p53's transcriptional activity and targeting p53 for proteasomal degradation. Inhibitors that disrupt binding between p53 and MDM2 efficiently activate a p53 response, but their use in the treatment of cancers that retain wild-type p53 may be limited by on-target toxicities due to p53 activation in normal tissue. Guided by a novel crystal structure of the MDM2–MDMX–E2(UbcH5B)–ubiquitin complex, we designed MDM2 mutants that prevent E2–ubiquitin binding without altering the RING-domain structure. These mutants lack MDM2's E3 activity but retain the ability to limit p53′s transcriptional activity and allow cell proliferation. Cells expressing these mutants respond more quickly to cellular stress than cells expressing wild-type MDM2, but basal p53 control is maintained. Targeting the MDM2 E3-ligase activity could therefore widen the therapeutic window of p53 activation in tumors