Towards Robust Neural Networks via Random Self-ensemble

Recent studies have revealed the vulnerability of deep neural networks: A small adversarial perturbation that is imperceptible to human can easily make a well-trained deep neural network misclassify. This makes it unsafe to apply neural networks in security-critical applications. In this paper, we propose a new defense algorithm called Random Self-Ensemble (RSE) by combining two important concepts: {\bf randomness} and {\bf ensemble}. To protect a targeted model, RSE adds random noise layers to the neural network to prevent the strong gradient-based attacks, and ensembles the prediction over random noises to stabilize the performance. We show that our algorithm is equivalent to ensemble an infinite number of noisy models $f_\epsilon$ without any additional memory overhead, and the proposed training procedure based on noisy stochastic gradient descent can ensure the ensemble model has a good predictive capability. Our algorithm significantly outperforms previous defense techniques on real data sets. For instance, on CIFAR-10 with VGG network (which has 92\% accuracy without any attack), under the strong C\&W attack within a certain distortion tolerance, the accuracy of unprotected model drops to less than 10\%, the best previous defense technique has $48\%$ accuracy, while our method still has $86\%$ prediction accuracy under the same level of attack. Finally, our method is simple and easy to integrate into any neural network.Comment: ECCV 2018 camera read

Chinese and North American Culture: a New Perspective in Linguistics Studies

We explored the two cultures in the two countries. There has been discussed on Chinese culture and North American culture. Chinese language, ceramics, architecture, music, dance, literature, martial arts, cuisine, visual arts, philosophy, business etiquette, religion, politics, and history have global influence, while its traditions and festivals are also celebrated, instilled, and practiced by people around the world. The culture of North America refers to the arts and other manifestations of human activities and achievements from the continent of North America. The American way of life or simply the American way is the unique lifestyle of the people of the United States of America. It refers to a nationalist ethos that adheres to the principle of life, liberty and the pursuit of happiness

Synthesizing and characterization of hole doped nickel based layer superconductor (La1−x_{1-x}Srx_{x})ONiAs

We report the synthesizing and characterization of the hole doped Ni-based superconductor ($La_{1-x}Sr_{x})ONiAs$. By substituting La with Sr, the superconducting transition temperature $T_c$ is increased from 2.75 K of the parent phase $LaONiAs$ to 3.7 K at the doping levels x= 0.1 - 0.2. The curve $T_c$ versus hole concentration shows a symmetric behavior as the electron doped samples $La(O_{1-x}F_{x})NiAs$. The normal state resistivity in Ni-based samples shows a good metallic behavior and reveals the absence of an anomaly which appears in the Fe-based system at about 150 K, suggesting that this anomaly is not a common feature for all systems. Hall effect measurements indicate that the electron conduction in the parent phase $LaONiAs$ is dominated by electron-like charge carriers, while with more Sr doping, a hole-like band will emerge and finally prevail over the conduction, and accordingly the superconducting transition temperature $T_c$ increases.Comment: 4 pages, 5 figure