An external replication on the effects of test-driven development using a multi-site blind analysis approach

Context: Test-driven development (TDD) is an agile practice claimed to improve the quality of a software product, as well as the productivity of its developers. A previous study (i.e., baseline experiment) at the University of Oulu (Finland) compared TDD to a test-last development (TLD) approach through a randomized controlled trial. The results failed to support the claims. Goal: We want to validate the original study results by replicating it at the University of Basilicata (Italy), using a different design. Method: We replicated the baseline experiment, using a crossover design, with 21 graduate students. We kept the settings and context as close as possible to the baseline experiment. In order to limit researchers bias, we involved two other sites (UPM, Spain, and Brunel, UK) to conduct blind analysis of the data. Results: The Kruskal-Wallis tests did not show any significant difference between TDD and TLD in terms of testing effort (p-value = .27), external code quality (p-value = .82), and developers' productivity (p-value = .83). Nevertheless, our data revealed a difference based on the order in which TDD and TLD were applied, though no carry over effect. Conclusions: We verify the baseline study results, yet our results raises concerns regarding the selection of experimental objects, particularly with respect to their interaction with the order in which of treatments are applied. We recommend future studies to survey the tasks used in experiments evaluating TDD. Finally, to lower the cost of replication studies and reduce researchers' bias, we encourage other research groups to adopt similar multi-site blind analysis approach described in this paper.This research is supported in part by the Academy of Finland Project 278354

Results of the fifth international spectroradiometer comparison for improved solar spectral irradiance measurements and related impact on reference solar cell calibration

This paper reports on the results of the fifth spectral irradiance measurement intercomparison and the impact these results have on the spread of spectral mismatch calculations in the outdoor characterization of reference solar cell and photovoltaic (PV) devices. Ten laboratories and commercial partners with their own instruments were involved in the comparison. Solar spectral irradiance in clear sky condition was measured with both fast fixed and slow rotating grating spectroradiometers. This paper describes the intercomparison campaign, describes different statistical analysis used on acquired data, reports on the results, and analyzes the impact these results would have on the primary calibration of a c-Si PV reference cell under natural sunlight

Readout system test benches

We propose to develop and exploit versatile multi-purpose Personal Computer-based Test Benches to support the evaluation and design of the basic elements required for digital front-end readout and data transmission systems for an LHC experiment. These test benches will have modular hardware facilities for the operation of new readout system components under realistic conditions, and will implement advanced modern software engineering concepts. They will support components such as fast ADCs, hybrid fibre-optic transceivers, and the prototype VLSI systolic array and data-flow processors currently being developed in national research laboratories and by the emerging European HDTV industry. These efforts would also lay the foundations for projects involving the development of custom-designed VLSI circuits

New Developments in the Spectral Asymptotics of Quantum Gravity

A vanishing one-loop wave function of the Universe in the limit of small three-geometry is found, on imposing diffeomorphism-invariant boundary conditions on the Euclidean 4-ball in the de Donder gauge. This result suggests a quantum avoidance of the cosmological singularity driven by full diffeomorphism invariance of the boundary-value problem for one-loop quantum theory. All of this is made possible by a peculiar spectral cancellation on the Euclidean 4-ball, here derived and discussed.Comment: 7 pages, latex file. Paper prepared for the Conference "QFEXT05: Quantum Field Theory Under the Influence of External Conditions", Barcelona, September 5 - September 9, 2005. In the final version, the presentation has been further improved, and yet other References have been adde

Prospects for K+→π+ννˉK^+ \to \pi^+ \nu \bar{ \nu } at CERN in NA62

The NA62 experiment will begin taking data in 2015. Its primary purpose is a 10% measurement of the branching ratio of the ultrarare kaon decay $K^+ \to \pi^+ \nu \bar{ \nu }$, using the decay in flight of kaons in an unseparated beam with momentum 75 GeV/c.The detector and analysis technique are described here.Comment: 8 pages for proceedings of 50 Years of CP

Recent NA48/2 and NA62 results

The NA48/2 Collaboration at CERN has accumulated and analysed unprecedented statistics of rare kaon decays in the $K_{e4}$ modes: $K_{e4}(+-)$ ($K^\pm \to \pi^+ \pi^- e^\pm \nu$) and $K_{e4}(00)$ ($K^\pm \to \pi^0 \pi^0 e^\pm \nu$) with nearly one percent background contamination. It leads to the improved measurement of branching fractions and detailed form factor studies. New final results from the analysis of 381 $K^\pm \to \pi^\pm \gamma \gamma$ rare decay candidates collected by the NA48/2 and NA62 experiments at CERN are presented. The results include a decay rate measurement and fits to Chiral Perturbation Theory (ChPT) description.Comment: Prepared for the Proceedings of "Moriond QCD and High Energy Interactions. March 22-29 2014." conferenc

Status of the apeNEXT project

We present the current status of the apeNEXT project. Aim of this project is the development of the next generation of APE machines which will provide multi-teraflop computing power. Like previous machines, apeNEXT is based on a custom designed processor, which is specifically optimized for simulating QCD. We discuss the machine design, report on benchmarks, and give an overview on the status of the software development

Results from an ethnographically-informed study in the context of test driven development

Background: Test-driven development (TDD) is an iterative software development technique where unit tests are defined before production code. Previous studies fail to analyze the values, beliefs, and assumptions that inform and shape TDD. Aim: We designed and conducted a qualitative study to understand the values, beliefs, and assumptions of TDD. In particular, we sought to understand how novice and professional software developers, arranged in pairs (a driver and a pointer), perceive and apply TDD. Method: 14 novice software developers, i.e., graduate students in Computer Science at the University of Basilicata, and six professional software developers (with one to 10 years work experience) participated in our ethnographicallyinformed study. We asked the participants to implement a new feature for an existing software written in Java. We immersed ourselves in the context of the study, and collected data by means of contemporaneous field notes, audio recordings, and other artifacts. Results: A number of insights emerge from our analysis of the collected data, the main ones being: (i) refactoring (one of the phases of TDD) is not performed as often as the process requires and it is considered less important than other phases, (ii) the most important phase is implementation, (iii) unit tests are almost never up-to-date, (iv) participants first build a sort of mental model of the source code to be implemented and only then write test cases on the basis of this model; and (v) apart from minor differences, professional developers and students applied TDD in a similar fashion. Conclusions: Developers write quick-and-dirty production code to pass the tests and ignore refactoring.Copyright is held by the owner/auther(s)