MBDP: A Model-based Approach to Achieve both Robustness and Sample Efficiency via Double Dropout Planning

Model-based reinforcement learning is a widely accepted solution for solving excessive sample demands. However, the predictions of the dynamics models are often not accurate enough, and the resulting bias may incur catastrophic decisions due to insufficient robustness. Therefore, it is highly desired to investigate how to improve the robustness of model-based RL algorithms while maintaining high sampling efficiency. In this paper, we propose Model-Based Double-dropout Planning (MBDP) to balance robustness and efficiency. MBDP consists of two kinds of dropout mechanisms, where the rollout-dropout aims to improve the robustness with a small cost of sample efficiency, while the model-dropout is designed to compensate for the lost efficiency at a slight expense of robustness. By combining them in a complementary way, MBDP provides a flexible control mechanism to meet different demands of robustness and efficiency by tuning two corresponding dropout ratios. The effectiveness of MBDP is demonstrated both theoretically and experimentally

The Genes of CYP, ZEP, and CCD1/4 Play an Important Role in Controlling Carotenoid and Aroma Volatile Apocarotenoid Accumulation of Apricot Fruit

Carotenoids are important coloration molecules and indispensable component of the human diet. And these compounds confer most of the apricot fruit yellow or orange color. In China, fruit of some apricot cultivar present light-yellow color but strong flowery flavor, however, the chemical mechanism remains unknown. Here, carotenoids and aroma volatile apocarotenoids (AVAs) in three skin types of apricot cultivars (orange, yellow, and light-yellow skinned) were determined by HPLC and GC-MS, respectively. And the transcript levels of carotenogenic genes were analyzed by qRT-PCR. The orange-skinned cultivars “Hongyu” and “Danxing” fruit presented the most abundant total carotenoid, β-carotene and specific α-carotene contents, and β-carotene (52–77%) increased to become the dominant carotenoid during fruit ripening. The transcript levels of lycopene β-cyclase (LCYb) and β-carotene hydroxylase (CHYb) sharply increased during ripening. The yellow-skinned cultivars “Sulian No. 2” and “Akeyaleke” fruit contained lower levels of total carotenoids and β-carotene but were rich in phytoene. The light-yellow coloration of “Baixing” and “Luntaixiaobaixing” fruit was attributed to low amounts of total carotenoids, lutein, and neoxanthin and an absence of β-cryptoxanthin, but high level of aroma volatile apocarotenoids (AVAs) such as β-ionone were detected in these cultivars fruit, accompanied by low transcript levels of carotene hydroxylase (CYP) and zeaxanthin epoxidase (ZEP) but high levels of carotenoid cleavage dioxygenase 1 (CCD1) and CCD4. Correlation analysis showed that the expression level of CCD1 negatively correlated with carotenoid accumulation but positively with AVAs production. These collected results suggest that both carotenoid biosynthesis and degradation are important for apricot coloration and aroma formation. CYP, ZEP, CCD1, and CCD4 may be the key regulation points for carotenoid and AVAs accumulation in apricot fruit, which provide important targets for quality-oriented molecular breeding.</jats:p

Comparative Analysis of Three Types of Peaches: Identification of the Key Individual Characteristic Flavor Compounds by Integrating Consumers' Acceptability with Flavor Quality

In order to recognize the key flavor compounds influencing the consumers' choice for honey peach, nectarine, and flat peach and provide important information for orientation breeding, sugars, organic acids, and aroma volatiles in 3 types of peaches were examined by high performance liquid chromatography (HPLC) and gas chromatography–mass spectrometry (GC–MS) and their key individual characteristic flavor compounds were identified by multivariate analysis integrated with consumers' evaluation. No significant differences in sugar and organic acid were observed between 3 types of peaches. In hierarchical clustering analysis (HCA) and principal component analysis (PCA) models, 3 types of peaches could not be differentiated by sugars or organic acids, but could be identified completely by aroma volatiles or by flavor compounds. A partial least squares regression (PLSR) model revealed that the key individual characteristic volatiles in nectarine, honey peach, and flat peach are C9 compounds and terpenic compounds, norisoprenoids and C6 compounds, and benzaldehyde, γ-decalactone, and δ-dodecalactone, respectively. These results suggest that sugars and organic acids form the background flavor of peach fruit and lactones shape the typical peach aroma. However, the individual aroma volatiles play the decisive role in unique flavor determination of different types of peaches

Profiling Taste and Aroma Compound Metabolism during Apricot Fruit Development and Ripening

Sugars, organic acids and volatiles of apricot were determined by HPLC and GC-MS during fruit development and ripening, and the key taste and aroma components were identified by integrating flavor compound contents with consumers’ evaluation. Sucrose and glucose were the major sugars in apricot fruit. The contents of all sugars increased rapidly, and the accumulation pattern of sugars converted from glucose-predominated to sucrose-predominated during fruit development and ripening. Sucrose synthase (SS), sorbitol oxidase (SO) and sorbitol dehydrogenase (SDH) are under tight developmental control and they might play important roles in sugar accumulation. Almost all organic acids identified increased during early development and then decrease rapidly. During early development, fruit mainly accumulated quinate and malate, with the increase of citrate after maturation, and quinate, malate and citrate were the predominant organic acids at the ripening stage. The odor activity values (OAV) of aroma volatiles showed that 18 aroma compounds were the characteristic components of apricot fruit. Aldehydes and terpenes decreased significantly during the whole development period, whereas lactones and apocarotenoids significantly increased with fruit ripening. The partial least squares regression (PLSR) results revealed that β-ionone, γ-decalactone, sucrose and citrate are the key characteristic flavor factors contributing to consumer acceptance. Carotenoid cleavage dioxygenases (CCD) may be involved in β-ionone formation in apricot fruit

Effect of Post-Harvest LED and UV Light Irradiation on the Accumulation of Flavonoids and Limonoids in the Segments of Newhall Navel Oranges (<i>Citrus sinensis</i> Osbeck)

To investigate the effect of post-harvest light irradiation on the accumulation of flavonoids and limonoids, harvested Newhall navel oranges were continuously exposed to light-emitting diode (LED) and ultraviolet (UV) light irradiation for 6 days, and the composition and content of flavonoids and limonoids in the segments were determined using UPLC-qTOF-MS at 0, 6, and 15 days after harvest. In total, six polymethoxylated flavonoids (PMFs), five flavone-O/C-glycosides, seven flavanone-O-glycosides, and three limonoids were identified in the segments. The accumulation of these components was altered by light irradiation. Red and blue light resulted in higher levels of PMFs during exposure periods. The accumulation of PMFs was also significantly induced after white light, UVB and UVC irradiation were removed. Red and UVC irradiation induced the accumulation of flavone and flavanone glycosides throughout the entire experimental period. Single light induced limonoid accumulation during exposure periods, but limonoid levels decreased significantly when irradiation was removed. Principal component analysis showed a clear correlation between PMFs and white light, between flavonoid glycosides and red light and UVC, and between limonoids and UVC. These results suggest that the accumulation of flavonoids and limonoids in citrus is regulated by light irradiation. White light, red light and UVC irradiation might be a good potential method for improving the nutrition and flavor quality of post-harvest citrus

Effect of Post-Harvest LED and UV Light Irradiation on the Accumulation of Flavonoids and Limonoids in the Segments of Newhall Navel Oranges (Citrus sinensis Osbeck)

To investigate the effect of post-harvest light irradiation on the accumulation of flavonoids and limonoids, harvested Newhall navel oranges were continuously exposed to light-emitting diode (LED) and ultraviolet (UV) light irradiation for 6 days, and the composition and content of flavonoids and limonoids in the segments were determined using UPLC-qTOF-MS at 0, 6, and 15 days after harvest. In total, six polymethoxylated flavonoids (PMFs), five flavone-O/C-glycosides, seven flavanone-O-glycosides, and three limonoids were identified in the segments. The accumulation of these components was altered by light irradiation. Red and blue light resulted in higher levels of PMFs during exposure periods. The accumulation of PMFs was also significantly induced after white light, UVB and UVC irradiation were removed. Red and UVC irradiation induced the accumulation of flavone and flavanone glycosides throughout the entire experimental period. Single light induced limonoid accumulation during exposure periods, but limonoid levels decreased significantly when irradiation was removed. Principal component analysis showed a clear correlation between PMFs and white light, between flavonoid glycosides and red light and UVC, and between limonoids and UVC. These results suggest that the accumulation of flavonoids and limonoids in citrus is regulated by light irradiation. White light, red light and UVC irradiation might be a good potential method for improving the nutrition and flavor quality of post-harvest citrus.</jats:p

LED and UV Light Utilizing Flavonoids and Limonoids to Investigate the Effect of Post-harvest Light Irradiation

To investigate the effect of post-harvest light irradiation on the accumulation of flavonoids and limonoids, harvested Newhall navel oranges were continuously exposed to light-emitting diode (LED) and ultraviolet (UV) light irradiation for 6 days, and the composition and content of flavonoids and limonoids in the segments were determined using UPLC-qTOF-MS at 0, 6, and 15 days after harvest. In total, six polymethoxylated flavonoids (PMFs), five flavone-O/C-glycosides, seven flavanone-O-glycosides, and three limonoids were identified in the segments. The accumulation of these components was altered by light irradiation. Red and blue light resulted in higher levels of PMFs during exposure periods. The accumulation of PMFs was also significantly induced after white light, UVB and UVC irradiation were removed. Red and UVC irradiation induced the accumulation of flavone and flavanone glycosides throughout the entire experimental period. Single light induced limonoid accumulation during exposure periods, but limonoid levels decreased significantly when irradiation was removed. Principal component analysis showed a clear correlation between PMFs and white light, between flavonoid glycosides and red light and UVC, and between limonoids and UVC. These results suggest that the accumulation of flavonoids and limonoids in citrus is regulated by light irradiation. White light, red light and UVC irradiation might be a good potential method for improving the nutrition and flavor quality of post-harvest citrus.</p

LED and UV Light Utilizing Flavonoids and Limonoids to Investigate the Effect of Post-harvest Light Irradiation

To investigate the effect of post-harvest light irradiation on the accumulation of flavonoids and limonoids, harvested Newhall navel oranges were continuously exposed to light-emitting diode (LED) and ultraviolet (UV) light irradiation for 6 days, and the composition and content of flavonoids and limonoids in the segments were determined using UPLC-qTOF-MS at 0, 6, and 15 days after harvest. In total, six polymethoxylated flavonoids (PMFs), five flavone-O/C-glycosides, seven flavanone-O-glycosides, and three limonoids were identified in the segments. The accumulation of these components was altered by light irradiation. Red and blue light resulted in higher levels of PMFs during exposure periods. The accumulation of PMFs was also significantly induced after white light, UVB and UVC irradiation were removed. Red and UVC irradiation induced the accumulation of flavone and flavanone glycosides throughout the entire experimental period. Single light induced limonoid accumulation during exposure periods, but limonoid levels decreased significantly when irradiation was removed. Principal component analysis showed a clear correlation between PMFs and white light, between flavonoid glycosides and red light and UVC, and between limonoids and UVC. These results suggest that the accumulation of flavonoids and limonoids in citrus is regulated by light irradiation. White light, red light and UVC irradiation might be a good potential method for improving the nutrition and flavor quality of post-harvest citrus