Human-machine diversity in the use of computerised advisory systems: a case study

Computer-based advisory systems form with their users composite, human-machine systems. Redundancy and diversity between the human and the machine are often important for the dependability of such systems. We discuss the modelling approach we applied in a case study. The goal is to assess failure probabilities for the analysis of X-ray films for detecting cancer, performed by a person assisted by a computer-based tool. Differently from most approaches to human reliability assessment, we focus on the effects of failure diversity — or correlation — between humans and machines. We illustrate some of the modelling and prediction problems, especially those caused by the presence of the human component. We show two alternative models, with their pros and cons, and illustrate, via numerical examples and analytically, some interesting and non-intuitive answers to questions about reliability assessment and design choices for human-computer systems

How to discriminate between computer-aided and computer-hindered decisions: a case study in mammography

Background. Computer aids can affect decisions in complex ways, potentially even making them worse; common assessment methods may miss these effects. We developed a method for estimating the quality of decisions, as well as how computer aids affect it, and applied it to computer-aided detection (CAD) of cancer, reanalyzing data from a published study where 50 professionals (“readers”) interpreted 180 mammograms, both with and without computer support. Method. We used stepwise regression to estimate how CAD affected the probability of a reader making a correct screening decision on a patient with cancer (sensitivity), thereby taking into account the effects of the difficulty of the cancer (proportion of readers who missed it) and the reader’s discriminating ability (Youden’s determinant). Using regression estimates, we obtained thresholds for classifying a posteriori the cases (by difficulty) and the readers (by discriminating ability). Results. Use of CAD was associated with a 0.016 increase in sensitivity (95% confidence interval [CI], 0.003–0.028) for the 44 least discriminating radiologists for 45 relatively easy, mostly CAD-detected cancers. However, for the 6 most discriminating radiologists, with CAD, sensitivity decreased by 0.145 (95% CI, 0.034–0.257) for the 15 relatively difficult cancers. Conclusions. Our exploratory analysis method reveals unexpected effects. It indicates that, despite the original study detecting no significant average effect, CAD helped the less discriminating readers but hindered the more discriminating readers. Such differential effects, although subtle, may be clinically significant and important for improving both computer algorithms and protocols for their use. They should be assessed when evaluating CAD and similar warning systems

Jet precession in the active nucleus of M81. Ongoing VLBI monitoring

In a recent publication, we reported results of a multi-frequency VLBI campaign of observations of the Active Galactic Nucleus (AGN) in galaxy M\,81, phase-referenced to the supernova SN\,1993J. We were able to extract precise information on the relative astrometry of the AGN radio emission at different epochs and frequencies. We found strong evidence of precession in the AGN jet (i.e., a systematic evolution in the jet inclination at each frequency) coupled to changes in the overall flux density at the different frequencies. In these proceedings, we summarise the main contents of our previous publication and we report on (preliminary) new results from our follow-up VLBI observations, now phase-referenced to the young supernova SN2008iz. We also briefly discuss how these results match the picture of our previously-reported precession model.Comment: 6 pages, 3 figures. Proceedings of EVN meeting 201

Effects of incorrect computer-aided detection (CAD) output on human decision-making in mammography

To investigate the effects of incorrect computer output on the reliability of the decisions of human users. This work followed an independent UK clinical trial that evaluated the impact of computer-aided detection(CAD) in breast screening. The aim was to use data from this trial to feed into probabilistic models (similar to those used in "reliability engineering") which would detect and assess possible ways of improving the human-CAD interaction. Some analyses required extra data; therefore, two supplementary studies were conducted. Study 1 was designed to elucidate the effects of computer failure on human performance. Study 2 was conducted to clarify unexpected findings from Study 1

Optical detection of the radio supernova SN 2000ft in the circumnuclear region of the luminous infrared galaxy NGC 7469

SN 2000ft is detected in two independent Planetary Camera images (F547W and F814W) taken May 13, 2000, about two months before the predicted date of the explosion (July 19, 2000), based on the analysis of its radio light evolution by Alberdi and collaborators. The apparent optical magnitudes and red color of SN 2000ft indicate that it is observed through an extinction of at least A$_V$= 3.0 magnitudes. The extinction corrected lower limit to the absolute visual magnitude (M$_V$ $\leq -$ 18.0), identifies SN 2000ft as a luminous supernova in the optical, as other luminous radio supernovae before. SN 2000ft exploded in a region located at only 0.1 arcsec (i.e. 34 +/- 3 pc) west of a faint cluster (C24). No parent cluster is identified within the detection limits of the HST short exposures. The unambiguous detection of SN 2000ft in the visual shows that multi-epoch sub-arcsecond (FWHM less than 0.1 arcsec) optical imaging is also a valid tool that should be explored further to detect supernovae in the dusty (circum)nuclear regions of (U)LIRGs

Analysis of Alloy 718 surfaces milled by abrasive waterjet and post-processed by plain waterjet technology

This work analyzes the surfaces obtained in Alloy 718 when they are milled by Abrasive Waterjet (AWJ) at different conditions. This analysis revealed that all surfaces have a homogeneous roughness in the transversal and the longitudinal directions, present embedded abrasive particles and have hardened about 50% with respect to the untreated bulk Alloy 718. On the other hand, Plain Waterjet (PWJ) technology was used for removing the abrasive particles embedded in surfaces of Alloy 718 milled previously by AWJ technology. The effect of this process on the surface characteristics is also analyzed. For all tested conditions, this technology removed all the particles embedded in the surface. In addition, the PWJ technology process in general smoothened the surfaces produced by AWJ milling and it also released near-surface stresses.The authors acknowledge the support of the Ministry of Economy and Competitiveness of the Spanish Government for support of project EVOCA II (reference DPI2013-45308-P)

Direct Detection of the Tertiary Component in the Massive Multiple HD 150 136 with VLTI

Massive stars are of fundamental importance for almost all aspects of astrophysics, but there still exist large gaps in our understanding of their properties and formation because they are rare and therefore distant. It has been found that most O-stars are multiples. HD 150 136 is the nearest system to Earth with >100 M_sol, and provides a unique opportunity to study an extremely massive system. Recently, evidence for the existence of a third component in HD 150 136, in addition to the tight spectroscopic binary that forms the main component, was found in spectroscopic observations. Our aim was to image and obtain astrometric and photometric measurements of this component using long baseline optical interferometry to further constrain the nature of this component. We observed HD150136 with the near-infrared instrument AMBER attached to the ESO VLT Interferometer. The recovered closure phases are robust to systematic errors and provide unique information on the source asymmetry. Therefore, they are of crucial relevance for both image reconstruction and model fitting of the source structure. The third component in HD 150 136 is clearly detected in the high-quality data from AMBER. It is located at a projected angular distance of 7.3 mas, or about 13 AU at the line-of-sight distance of HD 150 136, at a position angle of 209 degrees East of North, and has a flux ratio of 0.25 with respect to the inner binary. We resolved the third component of HD 150 136 in J, H and K filters. The luminosity and color of the tertiary agrees with the predictions and shows that it is also an O main-sequence star. The small measured angular separation indicates that the tertiary may be approaching the periastron of its orbit. These results, only achievable with long baseline near infrared interferometry, constitute the first step towards the understanding of the massive star formation mechanisms