Semantic feature-based visual attention model for pedestrian detection

Objective Pedestrian detection under video surveillance systems has always been a hot topic in computer vision research. These systems are widely used in train stations, airports, large commercial plazas, and other public places. However, pedestrian detection remains difficult because of complex backgrounds. Given its development in recent years, the visual attention mechanism has attracted increasing attention in object detection and tracking research, and previous studies have achieved substantial progress and breakthroughs. We propose a novel pedestrian detection method based on the semantic features under the visual attention mechanism. Method The proposed semantic feature-based visual attention model is a spatial-temporal model that consists of two parts: the static visual attention model and the motion visual attention model. The static visual attention model in the spatial domain is constructed by combining bottom-up with top-down attention guidance. Based on the characteristics of pedestrians, the bottom-up visual attention model of Itti is improved by intensifying the orientation vectors of elementary visual features to make the visual saliency map suitable for pedestrian detection. In terms of pedestrian attributes, skin color is selected as a semantic feature for pedestrian detection. The regional and Gaussian models are adopted to construct the skin color model. Skin feature-based visual attention guidance is then proposed to complete the top-down process. The bottom-up and top-down visual attentions are linearly combined using the proper weights obtained from experiments to construct the static visual attention model in the spatial domain. The spatial-temporal visual attention model is then constructed via the motion features in the temporal domain. Based on the static visual attention model in the spatial domain, the frame difference method is combined with optical flowing to detect motion vectors. Filtering is applied to process the field of motion vectors. The saliency of motion vectors can be evaluated via motion entropy to make the selected motion feature more suitable for the spatial-temporal visual attention model. Result Standard datasets and practical videos are selected for the experiments. The experiments are performed on a MATLAB R2012a platform. The experimental results show that our spatial-temporal visual attention model demonstrates favorable robustness under various scenes, including indoor train station surveillance videos and outdoor scenes with swaying leaves. Our proposed model outperforms the visual attention model of Itti, the graph-based visual saliency model, the phase spectrum of quaternion Fourier transform model, and the motion channel model of Liu in terms of pedestrian detection. The proposed model achieves a 93% accuracy rate on the test video. Conclusion This paper proposes a novel pedestrian method based on the visual attention mechanism. A spatial-temporal visual attention model that uses low-level and semantic features is proposed to calculate the saliency map. Based on this model, the pedestrian targets can be detected through focus of attention shifts. The experimental results verify the effectiveness of the proposed attention model for detecting pedestrians

Auricle shaping using 3D printing and autologous diced cartilage.

ObjectiveTo reconstruct the auricle using a porous, hollow, three-dimensional (3D)-printed mold and autologous diced cartilage mixed with platelet-rich plasma (PRP).MethodsMaterialise Magics v20.03 was used to design a 3D, porous, hollow auricle mold. Ten molds were printed by selective laser sintering with polyamide. Cartilage grafts were harvested from one ear of a New Zealand rabbit, and PRP was prepared using 10 mL of auricular blood from the same animal. Ear cartilage was diced into 0.5- to 2.0-mm pieces, weighed, mixed with PRP, and then placed inside the hollow mold. Composite grafts were then implanted into the backs of respective rabbits (n = 10) for 4 months. The shape and composition of the diced cartilage were assessed histologically, and biomechanical testing was used to determine stiffness.ResultsThe 3D-printed auricle molds were 0.6-mm thick and showed connectivity between the internal and external surfaces, with round pores of 0.1 to 0.3 cm. After 4 months, the diced cartilage pieces had fused into an auricular shape with high fidelity to the anthropotomy. The weight of the diced cartilage was 5.157 ± 0.230 g (P > 0.05, compared with preoperative). Histological staining showed high chondrocyte viability and the production of collagen II, glycosaminoglycans, and other cartilaginous matrix components. In unrestricted compression tests, auricle stiffness was 0.158 ± 0.187 N/mm, similar to that in humans.ConclusionAuricle grafts were constructed successfully through packing a 3D-printed, porous, hollow auricle mold with diced cartilage mixed with PRP. The auricle cartilage contained viable chondrocytes, appropriate extracellular matrix components, and good mechanical properties.Levels of evidenceNA. Laryngoscope, 129:2467-2474, 2019

Near-infrared Hong-Ou-Mandel interference on a silicon quantum photonic circuit

Near-infrared Hong-Ou-Mandel quantum interference is observed in silicon nanophotonic directional couplers with raw visibilities on-chip at 90.5%. Spectrally-bright 1557-nm two-photon states are generated in a periodically-poled KTiOPO4 waveguide chip, serving as the entangled photon source and pumped with a self-injection locked laser, for the photon statistical measurements. Efficient four-port coupling in the communications C-band and in the high-index-contrast silicon photonics platform is demonstrated, with matching theoretical predictions of the quantum interference visibility. Constituents for the residual quantum visibility imperfection are examined, supported with theoretical analysis of the sequentially-triggered multipair biphoton contribution and techniques for visibility compensation, towards scalable high-bitrate quantum information processing and communications.Comment: 15 pages, 6 figure

Harnessing high-dimensional hyperentanglement through a biphoton frequency comb

Quantum entanglement is a fundamental resource for secure information processing and communications, where hyperentanglement or high-dimensional entanglement has been separately proposed towards high data capacity and error resilience. The continuous-variable nature of the energy-time entanglement makes it an ideal candidate for efficient high-dimensional coding with minimal limitations. Here we demonstrate the first simultaneous high-dimensional hyperentanglement using a biphoton frequency comb to harness the full potential in both energy and time domain. The long-postulated Hong-Ou-Mandel quantum revival is exhibited, with up to 19 time-bins, 96.5% visibilities. We further witness the high-dimensional energy-time entanglement through Franson revivals, which is observed periodically at integer time-bins, with 97.8% visibility. This qudit state is observed to simultaneously violate the generalized Bell inequality by up to 10.95 deviations while observing recurrent Clauser-Horne-Shimony-Holt S-parameters up to 2.76. Our biphoton frequency comb provides a platform in photon-efficient quantum communications towards the ultimate channel capacity through energy-time-polarization high-dimensional encoding

Magnetic domain wall engineering in a nanoscale permalloy junction

Nanoscale magnetic junctions provide a useful approach to act as building blocks for magnetoresistive random access memories (MRAM), where one of the key issues is to control the magnetic domain configuration. Here, we study the domain structure and the magnetic switching in the Permalloy (Fe20Ni80) nanoscale magnetic junctions with different thicknesses by using micromagnetic simulations. It is found that both the 90-° and 45-° domain walls can be formed between the junctions and the wire arms depending on the thickness of the device. The magnetic switching fields show distinct thickness dependencies with a broad peak varying from 7 nm to 22 nm depending on the junction sizes, and the large magnetic switching fields favor the stability of the MRAM operation

Fatigue assessment on suspenders under stochastic wind and traffic loads based on in-situ monitoring data

As a critical component of a suspension bridge, the integrity of the suspenders plays a critical role in the serviceability and reliability of the bridge during its life time. Despite the wide recognition of the importance of the suspenders, very few studies have been devoted to the condition evaluation of suspenders in operation. The present study performs the fatigue assessment on the suspenders accounting for the stochastic wind and traffic loads using the in-situ monitoring data. To this end, a probabilistic numerical framework is proposed to predict the time-dependent fatigue reliability of the suspenders under stochastic wind and traffic loads during the bridge’s life time, based on the linear fatigue damage rule. As a demonstration, the proposed numerical framework is applied to a long-span suspension bridge located in a mountainous canyon. The results indicate that it is of paramount importance to consider both the wind and traffic load effects in the fatigue reliability evaluation of the suspenders. In addition, it was also found that among the suspenders under investigation, the short suspender at the bridge mid-span (S36) is more prone to the fatigue damage, while the long suspender at the end of the bridge girder (S2) is less prone to the fatigue damage. Finally, provided with a target reliability index of 3.0, the fatigue life of the suspenders S36 and S2, considering the life time wind and traffic load, is estimated as 53 years and 167 years, respectively. The present research could provide essential guidelines for the optimization of inspection and replacement in maintenance practices for suspenders

QMix: Quality-aware Learning with Mixed Noise for Robust Retinal Disease Diagnosis

Due to the complexity of medical image acquisition and the difficulty of annotation, medical image datasets inevitably contain noise. Noisy data with wrong labels affects the robustness and generalization ability of deep neural networks. Previous noise learning methods mainly considered noise arising from images being mislabeled, i.e. label noise, assuming that all mislabeled images are of high image quality. However, medical images are prone to suffering extreme quality issues, i.e. data noise, where discriminative visual features are missing for disease diagnosis. In this paper, we propose a noise learning framework, termed as QMix, that learns a robust disease diagnosis model under mixed noise. QMix alternates between sample separation and quality-aware semisupervised training in each training epoch. In the sample separation phase, we design a joint uncertainty-loss criterion to effectively separate (1) correctly labeled images; (2) mislabeled images with high quality and (3) mislabeled images with low quality. In the semi-supervised training phase, we train a disease diagnosis model to learn robust feature representation from the separated samples. Specifically, we devise a sample-reweighing loss to mitigate the effect of mislabeled images with low quality during training. Meanwhile, a contrastive enhancement loss is proposed to further distinguish mislabeled images with low quality from correctly labeled images. QMix achieved state-of-the-art disease diagnosis performance on five public retinal image datasets and exhibited substantial improvement on robustness against mixed noise

Primal Dual Alternating Proximal Gradient Algorithms for Nonsmooth Nonconvex Minimax Problems with Coupled Linear Constraints

Nonconvex minimax problems have attracted wide attention in machine learning, signal processing and many other fields in recent years. In this paper, we propose a primal dual alternating proximal gradient (PDAPG) algorithm and a primal dual proximal gradient (PDPG-L) algorithm for solving nonsmooth nonconvex-strongly concave and nonconvex-linear minimax problems with coupled linear constraints, respectively. The corresponding iteration complexity of the two algorithms are proved to be $\mathcal{O}\left( \varepsilon ^{-2} \right)$ and $\mathcal{O}\left( \varepsilon ^{-3} \right)$ to reach an $\varepsilon$-stationary point, respectively. To our knowledge, they are the first two algorithms with iteration complexity guarantee for solving the two classes of minimax problems

Element specific spin and orbital moments of nanoscale CoFeB amorphous thin films on GaAs(100)

CoFeB amorphous films have been synthesized on GaAs(100) and studied with X-ray magnetic circular dichroism (XMCD) and transmission electron microscopy (TEM). We have found that the ratios of the orbital to spin magnetic moments of both the Co and Fe in the ultrathin amorphous film have been enhanced by more than 300% compared with those of the bulk crystalline Co and Fe, and specifically a large orbital moment of 0.56 μB from the Co atoms has been observed and at the same time the spin moment of the Co atoms remains comparable to that of the bulk hcp Co. The results indicate that the large uniaxial magnetic anisotropy (UMA) observed in the ultrathin CoFeB film on GaAs(100) is related to the enhanced spin-orbital coupling of the Co atoms in the CoFeB. This work offers experimental evidences of the correlation between the UMA and the element specific spin and orbital moments in the CoFeB amorphous film on the GaAs(100) substrate, which is of significance for spintronics applications