Post-hoc derivation of SOHO Michelson doppler imager flat fields

<p><b>Context:</b> The SOHO satellite now offers a unique perspective on the Sun as it is the only space-based instrument that can provide large, high-resolution data sets over an entire 11-year solar cycle. This unique property enables detailed studies of long-term variations in the Sun. One significant problem when looking for such changes is determining what component of any variation is due to deterioration of the instrument and what is due to the Sun itself. One of the key parameters that changes over time is the apparent sensitivity of individual pixels in the CCD array. This can change considerably as a result of optics damage, radiation damage, and aging of the sensor itself. In addition to reducing the sensitivity of the telescope over time, this damage significantly changes the uniformity of the flat field of the instrument, a property that is very hard to recalibrate in space. For procedures such as feature tracking and intensity analysis, this can cause significant errors.</p> <p><b>Aims:</b> We present a method for deriving high-precision flat fields for high-resolution MDI continuum data, using analysis of existing continuum and magnetogram data sets.</p> <p><b>Methods:</b> A flat field is constructed using a large set (1000-4000 frames) of cospatial magnetogram and continuum data. The magnetogram data is used to identify and mask out magnetically active regions on the continuum data, allowing systematic biases to be avoided. This flat field can then be used to correct individual continuum images from a similar time.</p> <p><b>Results:</b> This method allows us to reduce the residual flat field error by around a factor 6-30, depending on the area considered, enough to significantly change the results from correlation-tracking analysis. One significant advantage of this method is that it can be done retrospectively using archived data, without requiring any special satellite operations.</p&gt

Predicting Long-Range Traversability from Short-Range Stereo-Derived Geometry

Based only on its appearance in imagery, this program uses close-range 3D terrain analysis to produce training data sufficient to estimate the traversability of terrain beyond 3D sensing range. This approach is called learning from stereo (LFS). In effect, the software transfers knowledge from middle distances, where 3D geometry provides training cues, into the far field where only appearance is available. This is a viable approach because the same obstacle classes, and sometimes the same obstacles, are typically present in the mid-field and the farfield. Learning thus extends the effective look-ahead distance of the sensors

A Statistical Graphical Model of the California Reservoir System

The recent California drought has highlighted the potential vulnerability of the state's water management infrastructure to multiyear dry intervals. Due to the high complexity of the network, dynamic storage changes in California reservoirs on a state-wide scale have previously been difficult to model using either traditional statistical or physical approaches. Indeed, although there is a significant line of research on exploring models for single (or a small number of) reservoirs, these approaches are not amenable to a system-wide modeling of the California reservoir network due to the spatial and hydrological heterogeneities of the system. In this work, we develop a state-wide statistical graphical model to characterize the dependencies among a collection of 55 major California reservoirs across the state; this model is defined with respect to a graph in which the nodes index reservoirs and the edges specify the relationships or dependencies between reservoirs. We obtain and validate this model in a data-driven manner based on reservoir volumes over the period 2003–2016. A key feature of our framework is a quantification of the effects of external phenomena that influence the entire reservoir network. We further characterize the degree to which physical factors (e.g., state-wide Palmer Drought Severity Index (PDSI), average temperature, snow pack) and economic factors (e.g., consumer price index, number of agricultural workers) explain these external influences. As a consequence of this analysis, we obtain a system-wide health diagnosis of the reservoir network as a function of PDSI

The Helioseismic and Magnetic Imager (HMI) Vector Magnetic Field Pipeline: SHARPs -- Space-weather HMI Active Region Patches

A new data product from the Helioseismic and Magnetic Imager (HMI) onboard the Solar Dynamics Observatory (SDO) called Space-weather HMI Active Region Patches (SHARPs) is now available. SDO/HMI is the first space-based instrument to map the full-disk photospheric vector magnetic field with high cadence and continuity. The SHARP data series provide maps in patches that encompass automatically tracked magnetic concentrations for their entire lifetime; map quantities include the photospheric vector magnetic field and its uncertainty, along with Doppler velocity, continuum intensity, and line-of-sight magnetic field. Furthermore, keywords in the SHARP data series provide several parameters that concisely characterize the magnetic-field distribution and its deviation from a potential-field configuration. These indices may be useful for active-region event forecasting and for identifying regions of interest. The indices are calculated per patch and are available on a twelve-minute cadence. Quick-look data are available within approximately three hours of observation; definitive science products are produced approximately five weeks later. SHARP data are available at http://jsoc.stanford.edu and maps are available in either of two different coordinate systems. This article describes the SHARP data products and presents examples of SHARP data and parameters.Comment: 27 pages, 7 figures. Accepted to Solar Physic

The Helioseismic and Magnetic Imager (HMI) Vector Magnetic Field Pipeline: Overview and Performance

The Helioseismic and Magnetic Imager (HMI) began near-continuous full-disk solar measurements on 1 May 2010 from the Solar Dynamics Observatory (SDO). An automated processing pipeline keeps pace with observations to produce observable quantities, including the photospheric vector magnetic field, from sequences of filtergrams. The primary 720s observables were released in mid 2010, including Stokes polarization parameters measured at six wavelengths as well as intensity, Doppler velocity, and the line-of-sight magnetic field. More advanced products, including the full vector magnetic field, are now available. Automatically identified HMI Active Region Patches (HARPs) track the location and shape of magnetic regions throughout their lifetime. The vector field is computed using the Very Fast Inversion of the Stokes Vector (VFISV) code optimized for the HMI pipeline; the remaining 180 degree azimuth ambiguity is resolved with the Minimum Energy (ME0) code. The Milne-Eddington inversion is performed on all full-disk HMI observations. The disambiguation, until recently run only on HARP regions, is now implemented for the full disk. Vector and scalar quantities in the patches are used to derive active region indices potentially useful for forecasting; the data maps and indices are collected in the SHARP data series, hmi.sharp_720s. Patches are provided in both CCD and heliographic coordinates. HMI provides continuous coverage of the vector field, but has modest spatial, spectral, and temporal resolution. Coupled with limitations of the analysis and interpretation techniques, effects of the orbital velocity, and instrument performance, the resulting measurements have a certain dynamic range and sensitivity and are subject to systematic errors and uncertainties that are characterized in this report.Comment: 42 pages, 19 figures, accepted to Solar Physic

Visualization Component of Vehicle Health Decision Support System

The visualization front-end of a Decision Support System (DSS) also includes an analysis engine linked to vehicle telemetry, and a database of learned models for known behaviors. Because the display is graphical rather than text-based, the summarization it provides has a greater information density on one screen for evaluation by a flight controller.This tool provides a system-level visualization of the state of a vehicle, and drill-down capability for more details and interfaces to separate analysis algorithms and sensor data streams. The system-level view is a 3D rendering of the vehicle, with sensors represented as icons, tied to appropriate positions within the vehicle body and colored to indicate sensor state (e.g., normal, warning, anomalous state, etc.). The sensor data is received via an Information Sharing Protocol (ISP) client that connects to an external server for real-time telemetry. Users can interactively pan, zoom, and rotate this 3D view, as well as select sensors for a detail plot of the associated time series data. Subsets of the plotted data can be selected and sent to an external analysis engine to either search for a similar time series in an historical database, or to detect anomalous events. The system overview and plotting capabilities are completely general in that they can be applied to any vehicle instrumented with a collection of sensors. This visualization component can interface with the ISP for data streams used by NASA s Mission Control Center at Johnson Space Center. In addition, it can connect to, and display results from, separate analysis engine components that identify anomalies or that search for past instances of similar behavior. This software supports NASA's Software, Intelligent Systems, and Modeling element in the Exploration Systems Research and Technology Program by augmenting the capability of human flight controllers to make correct decisions, thus increasing safety and reliability. It was designed specifically as a tool for NASA's flight controllers to monitor the International Space Station and a future Crew Exploration Vehicle

Towards real-time classification of astronomical transients

Exploration of time domain is now a vibrant area of research in astronomy, driven by the advent of digital synoptic sky surveys. While panoramic surveys can detect variable or transient events, typically some follow-up observations are needed; for short-lived phenomena, a rapid response is essential. Ability to automatically classify and prioritize transient events for follow-up studies becomes critical as the data rates increase. We have been developing such methods using the data streams from the Palomar-Quest survey, the Catalina Sky Survey and others, using the VOEventNet framework. The goal is to automatically classify transient events, using the new measurements, combined with archival data (previous and multi-wavelength measurements), and contextual information (e.g., Galactic or ecliptic latitude, presence of a possible host galaxy nearby, etc.); and to iterate them dynamically as the follow-up data come in (e.g., light curves or colors). We have been investigating Bayesian methodologies for classification, as well as discriminated follow-up to optimize the use of available resources, including Naive Bayesian approach, and the non-parametric Gaussian process regression. We will also be deploying variants of the traditional machine learning techniques such as Neural Nets and Support Vector Machines on datasets of reliably classified transients as they build up

How to optimize nonlinear force-free coronal magnetic field extrapolations from SDO/HMI vector magnetograms?

The SDO/HMI instruments provide photospheric vector magnetograms with a high spatial and temporal resolution. Our intention is to model the coronal magnetic field above active regions with the help of a nonlinear force-free extrapolation code. Our code is based on an optimization principle and has been tested extensively with semi-analytic and numeric equilibria and been applied before to vector magnetograms from Hinode and ground based observations. Recently we implemented a new version which takes measurement errors in photospheric vector magnetograms into account. Photospheric field measurements are often due to measurement errors and finite nonmagnetic forces inconsistent as a boundary for a force-free field in the corona. In order to deal with these uncertainties, we developed two improvements: 1.) Preprocessing of the surface measurements in order to make them compatible with a force-free field 2.) The new code keeps a balance between the force-free constraint and deviation from the photospheric field measurements. Both methods contain free parameters, which have to be optimized for use with data from SDO/HMI. Within this work we describe the corresponding analysis method and evaluate the force-free equilibria by means of how well force-freeness and solenoidal conditions are fulfilled, the angle between magnetic field and electric current and by comparing projections of magnetic field lines with coronal images from SDO/AIA. We also compute the available free magnetic energy and discuss the potential influence of control parameters.Comment: 17 Pages, 6 Figures, Sol. Phys., accepte