136 research outputs found
Successfully Applying Lottery Ticket Hypothesis to Diffusion Model
Despite the success of diffusion models, the training and inference of
diffusion models are notoriously expensive due to the long chain of the reverse
process. In parallel, the Lottery Ticket Hypothesis (LTH) claims that there
exists winning tickets (i.e., aproperly pruned sub-network together with
original weight initialization) that can achieve performance competitive to the
original dense neural network when trained in isolation. In this work, we for
the first time apply LTH to diffusion models. We empirically find subnetworks
at sparsity 90%-99% without compromising performance for denoising diffusion
probabilistic models on benchmarks (CIFAR-10, CIFAR-100, MNIST). Moreover,
existing LTH works identify the subnetworks with a unified sparsity along
different layers. We observe that the similarity between two winning tickets of
a model varies from block to block. Specifically, the upstream layers from two
winning tickets for a model tend to be more similar than the downstream layers.
Therefore, we propose to find the winning ticket with varying sparsity along
different layers in the model. Experimental results demonstrate that our method
can find sparser sub-models that require less memory for storage and reduce the
necessary number of FLOPs. Codes are available at
https://github.com/osier0524/Lottery-Ticket-to-DDPM
Recommended from our members
Safeguarding pollinators and their values to human well-being
Wild and managed pollinators provide a wide range of benefits to society in terms of contributions to food security, farmer
and beekeeper livelihoods, social and cultural values, as well as the maintenance of wider biodiversity and ecosystem
stability. Pollinators face numerous threats, including changes in land-use and management intensity, climate change,
pesticides and genetically modified crops, pollinator management and pathogens, and invasive alien species. There are
well-documented declines in some wild and managed pollinators in several regions of the world. However, many effective
policy and management responses can be implemented to safeguard pollinators and sustain pollination services
Ecological plasticity governs ecosystem services in multilayer networks
Agriculture is under pressure to achieve sustainable development goals for biodiversity and ecosystem services. Services in agro-ecosystems are typically driven by key species, and changes in the community composition and species abundance can have multifaceted effects. Assessment of individual services overlooks co-variance between different, but related, services coupled by a common group of species. This partial view ignores how effects propagate through an ecosystem. We conduct an analysis of 374 agricultural multilayer networks of two related services of weed seed regulation and gastropod mollusc predation delivered by carabid beetles. We found that weed seed regulation increased with the herbivore predation interaction frequency, computed from the network of trophic links between carabids and weed seeds in the herbivore layer. Weed seed regulation and herbivore interaction frequencies declined as the interaction frequencies between carabids and molluscs in the carnivore layer increased. This suggests that carabids can switch to gastropod predation with community change, and that link turnover rewires the herbivore and carnivore network layers affecting seed regulation. Our study reveals that ecosystem services are governed by ecological plasticity in structurally complex, multi-layer networks. Sustainable management therefore needs to go beyond the autecological approaches to ecosystem services that predominate, particularly in agriculture
Ecological networks reveal resilience of agro-ecosystems to changes in farming management
International audienc
An ecological future for weed science to sustain crop production and the environment. A review
Sustainable strategies for managing weeds are critical to meeting agriculture's potential to feed the world's population while conserving the ecosystems and biodiversity on which we depend. The dominant paradigm of weed management in developed countries is currently founded on the two principal tools of herbicides and tillage to remove weeds. However, evidence of negative environmental impacts from both tools is growing, and herbicide resistance is increasingly prevalent. These challenges emerge from a lack of attention to how weeds interact with and are regulated by the agroecosystem as a whole. Novel technological tools proposed for weed control, such as new herbicides, gene editing, and seed destructors, do not address these systemic challenges and thus are unlikely to provide truly sustainable solutions. Combining multiple tools and techniques in an Integrated Weed Management strategy is a step forward, but many integrated strategies still remain overly reliant on too few tools. In contrast, advances in weed ecology are revealing a wealth of options to manage weedsat the agroecosystem levelthat, rather than aiming to eradicate weeds, act to regulate populations to limit their negative impacts while conserving diversity. Here, we review the current state of knowledge in weed ecology and identify how this can be translated into practical weed management. The major points are the following: (1) the diversity and type of crops, management actions and limiting resources can be manipulated to limit weed competitiveness while promoting weed diversity; (2) in contrast to technological tools, ecological approaches to weed management tend to be synergistic with other agroecosystem functions; and (3) there are many existing practices compatible with this approach that could be integrated into current systems, alongside new options to explore. Overall, this review demonstrates that integrating systems-level ecological thinking into agronomic decision-making offers the best route to achieving sustainable weed management
Minor sperm abnormalities in young male post-pubertal patients with juvenile dermatomyositis
The global burden of cancer attributable to risk factors, 2010-19: a systematic analysis for the Global Burden of Disease Study 2019
The global burden of cancer attributable to risk factors, 2010-19: a systematic analysis for the Global Burden of Disease Study 2019
Relating Ambrosia artemisiifolia and other weeds to the management of Hungarian sunflower crops
- …
