Provably Good Solutions to the Knapsack Problem via Neural Networks of Bounded Size

The development of a satisfying and rigorous mathematical understanding of the performance of neural networks is a major challenge in artificial intelligence. Against this background, we study the expressive power of neural networks through the example of the classical NP-hard Knapsack Problem. Our main contribution is a class of recurrent neural networks (RNNs) with rectified linear units that are iteratively applied to each item of a Knapsack instance and thereby compute optimal or provably good solution values. We show that an RNN of depth four and width depending quadratically on the profit of an optimum Knapsack solution is sufficient to find optimum Knapsack solutions. We also prove the following tradeoff between the size of an RNN and the quality of the computed Knapsack solution: for Knapsack instances consisting of $n$ items, an RNN of depth five and width $w$ computes a solution of value at least $1-\mathcal{O}(n^2/\sqrt{w})$ times the optimum solution value. Our results build upon a classical dynamic programming formulation of the Knapsack Problem as well as a careful rounding of profit values that are also at the core of the well-known fully polynomial-time approximation scheme for the Knapsack Problem. A carefully conducted computational study qualitatively supports our theoretical size bounds. Finally, we point out that our results can be generalized to many other combinatorial optimization problems that admit dynamic programming solution methods, such as various Shortest Path Problems, the Longest Common Subsequence Problem, and the Traveling Salesperson Problem.Comment: A short version of this paper appears in the proceedings of AAAI 202

A note on the generalized min-sum set cover problem

In this paper, we consider the generalized min-sum set cover problem, introduced by Azar, Gamzu, and Yin. Bansal, Gupta, and Krishnaswamy give a 485-approximation algorithm for the problem. We are able to alter their algorithm and analysis to obtain a 28-approximation algorithm, improving the performance guarantee by an order of magnitude. We use concepts from $\alpha$-point scheduling to obtain our improvements

Stochastic scheduling on unrelated machines

Two important characteristics encountered in many real-world scheduling problems are heterogeneous machines/processors and a certain degree of uncertainty about the actual sizes of jobs. The first characteristic entails machine dependent processing times of jobs and is captured by the classical unrelated machine scheduling model.The second characteristic is adequately addressed by stochastic processing times of jobs as they are studied in classical stochastic scheduling models. While there is an extensive but separate literature for the two scheduling models, we study for the first time a combined model that takes both characteristics into account simultaneously. Here, the processing time of job $j$ on machine $i$ is governed by random variable $P_{ij}$, and its actual realization becomes known only upon job completion. With $w_j$ being the given weight of job $j$, we study the classical objective to minimize the expected total weighted completion time $E[\sum_j w_jC_j]$, where $C_j$ is the completion time of job $j$. By means of a novel time-indexed linear programming relaxation, we compute in polynomial time a scheduling policy with performance guarantee $(3+\Delta)/2+\epsilon$. Here, $\epsilon>0$ is arbitrarily small, and $\Delta$ is an upper bound on the squared coefficient of variation of the processing times. We show that the dependence of the performance guarantee on $\Delta$ is tight, as we obtain a $\Delta/2$ lower bound for the type of policies that we use. When jobs also have individual release dates $r_{ij}$, our bound is $(2+\Delta)+\epsilon$. Via $\Delta=0$, currently best known bounds for deterministic scheduling are contained as a special case

Robust randomized matchings

The following game is played on a weighted graph: Alice selects a matching $M$ and Bob selects a number $k$. Alice's payoff is the ratio of the weight of the $k$ heaviest edges of $M$ to the maximum weight of a matching of size at most $k$. If $M$ guarantees a payoff of at least $\alpha$ then it is called $\alpha$-robust. In 2002, Hassin and Rubinstein gave an algorithm that returns a $1/\sqrt{2}$-robust matching, which is best possible. We show that Alice can improve her payoff to $1/\ln(4)$ by playing a randomized strategy. This result extends to a very general class of independence systems that includes matroid intersection, b-matchings, and strong 2-exchange systems. It also implies an improved approximation factor for a stochastic optimization variant known as the maximum priority matching problem and translates to an asymptotic robustness guarantee for deterministic matchings, in which Bob can only select numbers larger than a given constant. Moreover, we give a new LP-based proof of Hassin and Rubinstein's bound

Generalizing the Kawaguchi-Kyan Bound to Stochastic Parallel Machine Scheduling

Minimizing the sum of weighted completion times on $m$ identical parallel machines is one of the most important and classical scheduling problems. For the stochastic variant where processing times of jobs are random variables, M\"ohring, Schulz, and Uetz (1999) presented the first and still best known approximation result achieving, for arbitrarily many machines, performance ratio $1+\frac12(1+\Delta)$, where $\Delta$ is an upper bound on the squared coefficient of variation of the processing times. We prove performance ratio $1+\frac12(\sqrt{2}-1)(1+\Delta)$ for the same underlying algorithm---the Weighted Shortest Expected Processing Time (WSEPT) rule. For the special case of deterministic scheduling (i.e., $\Delta=0$), our bound matches the tight performance ratio $\frac12(1+\sqrt{2})$ of this algorithm (WSPT rule), derived by Kawaguchi and Kyan in a 1986 landmark paper. We present several further improvements for WSEPT's performance ratio, one of them relying on a carefully refined analysis of WSPT yielding, for every fixed number of machines $m$, WSPT's exact performance ratio of order $\frac12(1+\sqrt{2})-O(1/m^2)$

Protective activity of aromatic amines and imines against oxidative nerve cell death

Oxidative stress is a widespread phenomenon in the pathology of neurodegenerative diseases such as Alzheimer's disease, Parkinson's disease, and amyotrophic lateral sclerosis. Neuronal cell death due to oxidative stress may causally contribute to the pathogeneses of these diseases. Therefore, neuroprotective antioxidants are considered to be a promising approach to slow down disease progression. We have investigated different aromatic amine and imine compounds for neuroprotective antioxidant functions in cell culture, and found that these compounds possess excellent cytoprotective potential in diverse paradigms of oxidative neuronal cell death, including clonal cell lines, primary cerebellar neurons, and organotypic hippocampal slice cultures. Aromatic amines and imines are effective against oxidative glutamate toxicity, glutathione depletion, and hydrogen peroxide toxicity. Their mode of action as direct antioxidants; was experimentally confirmed by electron spin resonance spectroscopy, cell-free brain lipid peroxidation assays, and intracellular peroxide measurements. With half-maximal effective concentrations of 20-75 nm in different neuroprotection experiments, the aromatic imines phenothiazine, phenoxazine, and iminostilbene proved to be about two orders of magnitude more effective than common phenolic antioxidants. This remarkable efficacy could be directly correlated to calculated properties of the compounds by means of a novel, quantitative structure-activity relationship model. We conclude that bridged bisarylimines with a single free NH-bond, such as iminostilbene, are superior neuroprotective antioxidants, and may be promising lead structures for rational drug development