Improving Sketch Colorization using Adversarial Segmentation Consistency

We propose a new method for producing color images from sketches. Current solutions in sketch colorization either necessitate additional user instruction or are restricted to the "paired" translation strategy. We leverage semantic image segmentation from a general-purpose panoptic segmentation network to generate an additional adversarial loss function. The proposed loss function is compatible with any GAN model. Our method is not restricted to datasets with segmentation labels and can be applied to unpaired translation tasks as well. Using qualitative, and quantitative analysis, and based on a user study, we demonstrate the efficacy of our method on four distinct image datasets. On the FID metric, our model improves the baseline by up to 35 points. Our code, pretrained models, scripts to produce newly introduced datasets and corresponding sketch images are available at https://github.com/giddyyupp/AdvSegLoss.Comment: Under review at Pattern Recognition Letters. arXiv admin note: substantial text overlap with arXiv:2102.0619

Glucocorticoids—All-Rounders Tackling the Versatile Players of the Immune System

Glucocorticoids regulate fundamental processes of the human body and control cellular functions such as cell metabolism, growth, differentiation, and apoptosis. Moreover, endogenous glucocorticoids link the endocrine and immune system and ensure the correct function of inflammatory events during tissue repair, regeneration, and pathogen elimination via genomic and rapid non-genomic pathways. Due to their strong immunosuppressive, anti-inflammatory and anti-allergic effects on immune cells, tissues and organs, glucocorticoids significantly improve the quality of life of many patients suffering from diseases caused by a dysregulated immune system. Despite the multitude and seriousness of glucocorticoid-related adverse events including diabetes mellitus, osteoporosis and infections, these agents remain indispensable, representing the most powerful, and cost-effective drugs in the treatment of a wide range of rheumatic diseases. These include rheumatoid arthritis, vasculitis, and connective tissue diseases, as well as many other pathological conditions of the immune system. Depending on the therapeutically affected cell type, glucocorticoid actions strongly vary among different diseases. While immune responses always represent complex reactions involving different cells and cellular processes, specific immune cell populations with key responsibilities driving the pathological mechanisms can be identified for certain autoimmune diseases. In this review, we will focus on the mechanisms of action of glucocorticoids on various leukocyte populations, exemplarily portraying different autoimmune diseases as heterogeneous targets of glucocorticoid actions: (i) Abnormalities in the innate immune response play a crucial role in the initiation and perpetuation of giant cell arteritis (GCA). (ii) Specific types of CD4+ T helper (Th) lymphocytes, namely Th1 and Th17 cells, represent important players in the establishment and course of rheumatoid arthritis (RA), whereas (iii) B cells have emerged as central players in systemic lupus erythematosus (SLE). (iv) Allergic reactions are mainly triggered by several different cytokines released by activated Th2 lymphocytes. Using these examples, we aim to illustrate the versatile modulating effects of glucocorticoids on the immune system. In contrast, in the treatment of lymphoproliferative disorders the pro-apoptotic action of glucocorticoids prevails, but their mechanisms differ depending on the type of cancer. Therefore, we will also give a brief insight into the current knowledge of the mode of glucocorticoid action in oncological treatment focusing on leukemia

Adversarial segmentation loss for sketch colorization

We introduce a new method for generating color images from sketches or edge maps. Current methods either require some form of additional user-guidance or are limited to the “paired” translation approach. We argue that segmentation information could provide valuable guidance for sketch colorization. To this end, we propose to leverage semantic image segmentation, as provided by a general purpose panoptic segmentation network, to create an additional adversarial loss function. Our loss function can be integrated to any baseline GAN model. Our method is not limited to datasets that contain segmentation labels, and it can be trained for “unpaired” translation tasks. We show the effectiveness of our method on four different datasets spanning scene level indoor, outdoor, and children book illustration images using qualitative, quantitative and user study analysis. Our model improves its baseline up to 35 points on the FID metric. Our code and pretrained models can be found at https://github.com/giddyyupp/AdvSegLoss

HoughNet: Integrating Near and Long-Range Evidence for Visual Detection

IEEEThis paper presents HoughNet, a one-stage, anchor-free, voting-based, bottom-up object detection method. Inspired by the Generalized Hough Transform, HoughNet determines the presence of an object at a certain location by the sum of the votes cast on that location. Votes are collected from both near and long-distance locations based on a log-polar vote field. Thanks to this voting mechanism, HoughNet is able to integrate both near and long-range, class-conditional evidence for visual recognition, thereby generalizing and enhancing current object detection methodology, which typically relies on only local evidence. On the COCO dataset, HoughNet's best model achieves 46.4 $AP$ (and 65.1 $AP_{50}$), performing on par with the state-of-the-art in bottom-up object detection and outperforming most major one-stage and two-stage methods. We further validate the effectiveness of our proposal in other visual detection tasks, namely, video object detection, instance segmentation, 3D object detection and keypoint detection for human pose estimation, and an additional “labels to photo” image generation task, where the integration of our voting module consistently improves performance in all cases. Code is available at https://github.com/nerminsamet/houghnet

Distribution of elements in seeds of some wild and cultivated fruits. Nutrition and authenticity aspects

BACKGROUND: The compositional, functional, and nutritional properties of fruits are important for defining their quality. Fruit seeds should be better exploited as they are also considered to be a good source of bioactive components. Twenty macro, micro, and trace elements were identified and quantified in the seeds of 70 genuine wild and cultivated fruit species/cultivars by inductively coupled plasma atomic emission spectrometry and inductively coupled plasma mass spectrometry. Sophisticated chemometric techniques were also used to establish criteria for the classification of the analyzed samples. RESULTS Calcium and P were the most abundant elements, followed by K and Na. The content of microelements and trace elements differed among the different cultivars/genotypes. The content of Ba, Pb, and Sr was significantly higher in wild fruits, whereas Fe, Mg, Mn, Ni and Zn content was higher in cultivated fruits. CONCLUSION All of the statistical procedures that were used - Kruskal-Wallis, Mann-Whitney U-test, and principal component analysis (PCA) - confirm a unique set of parameters that could be used as phytochemical biomarkers to differentiate fruit-seed samples belonging to different cultivars/genotypes according to their botanical origin. This kind of investigation may contribute to intercultivar/genetic discrimination and may enhance the possibilities of acquiring a valuable authenticity factor