Saliency Benchmarking Made Easy: Separating Models, Maps and Metrics

Dozens of new models on fixation prediction are published every year and compared on open benchmarks such as MIT300 and LSUN. However, progress in the field can be difficult to judge because models are compared using a variety of inconsistent metrics. Here we show that no single saliency map can perform well under all metrics. Instead, we propose a principled approach to solve the benchmarking problem by separating the notions of saliency models, maps and metrics. Inspired by Bayesian decision theory, we define a saliency model to be a probabilistic model of fixation density prediction and a saliency map to be a metric-specific prediction derived from the model density which maximizes the expected performance on that metric given the model density. We derive these optimal saliency maps for the most commonly used saliency metrics (AUC, sAUC, NSS, CC, SIM, KL-Div) and show that they can be computed analytically or approximated with high precision. We show that this leads to consistent rankings in all metrics and avoids the penalties of using one saliency map for all metrics. Our method allows researchers to have their model compete on many different metrics with state-of-the-art in those metrics: "good" models will perform well in all metrics.Comment: published at ECCV 201

Thrombospondin-1 Contributes to Mortality in Murine Sepsis through Effects on Innate Immunity

BACKGROUND:Thrombospondin-1 (TSP-1) is involved in many biological processes, including immune and tissue injury response, but its role in sepsis is unknown. Cell surface expression of TSP-1 on platelets is increased in sepsis and could activate the anti-inflammatory cytokine transforming growth factor beta (TGFβ1) affecting outcome. Because of these observations we sought to determine the importance of TSP-1 in sepsis. METHODOLOGY/PRINCIPAL FINDINGS:We performed studies on TSP-1 null and wild type (WT) C57BL/6J mice to determine the importance of TSP-1 in sepsis. We utilized the cecal ligation puncture (CLP) and intraperitoneal E. coli injection (i.p. E. coli) models of peritoneal sepsis. Additionally, bone-marrow-derived macrophages (BMMs) were used to determine phagocytic activity. TSP-1-/- animals experienced lower mortality than WT mice after CLP. Tissue and peritoneal lavage TGFβ1 levels were unchanged between animals of each genotype. In addition, there is no difference between the levels of major innate cytokines between the two groups of animals. PLF from WT mice contained a greater bacterial load than TSP-1-/- mice after CLP. The survival advantage for TSP-1-/- animals persisted when i.p. E. coli injections were performed. TSP-1-/- BMMs had increased phagocytic capacity compared to WT. CONCLUSIONS:TSP-1 deficiency was protective in two murine models of peritoneal sepsis, independent of TGFβ1 activation. Our studies suggest TSP-1 expression is associated with decreased phagocytosis and possibly bacterial clearance, leading to increased peritoneal inflammation and mortality in WT mice. These data support the contention that TSP-1 should be more fully explored in the human condition