Appearance-and-Relation Networks for Video Classification

Spatiotemporal feature learning in videos is a fundamental problem in computer vision. This paper presents a new architecture, termed as Appearance-and-Relation Network (ARTNet), to learn video representation in an end-to-end manner. ARTNets are constructed by stacking multiple generic building blocks, called as SMART, whose goal is to simultaneously model appearance and relation from RGB input in a separate and explicit manner. Specifically, SMART blocks decouple the spatiotemporal learning module into an appearance branch for spatial modeling and a relation branch for temporal modeling. The appearance branch is implemented based on the linear combination of pixels or filter responses in each frame, while the relation branch is designed based on the multiplicative interactions between pixels or filter responses across multiple frames. We perform experiments on three action recognition benchmarks: Kinetics, UCF101, and HMDB51, demonstrating that SMART blocks obtain an evident improvement over 3D convolutions for spatiotemporal feature learning. Under the same training setting, ARTNets achieve superior performance on these three datasets to the existing state-of-the-art methods.Comment: CVPR18 camera-ready version. Code & models available at https://github.com/wanglimin/ARTNe

A stability condition for turbulence model: From EMMS model to EMMS-based turbulence model

The closure problem of turbulence is still a challenging issue in turbulence modeling. In this work, a stability condition is used to close turbulence. Specifically, we regard single-phase flow as a mixture of turbulent and non-turbulent fluids, separating the structure of turbulence. Subsequently, according to the picture of the turbulent eddy cascade, the energy contained in turbulent flow is decomposed into different parts and then quantified. A turbulence stability condition, similar to the principle of the energy-minimization multi-scale (EMMS) model for gas-solid systems, is formulated to close the dynamic constraint equations of turbulence, allowing the heterogeneous structural parameters of turbulence to be optimized. We call this model the `EMMS-based turbulence model', and use it to construct the corresponding turbulent viscosity coefficient. To validate the EMMS-based turbulence model, it is used to simulate two classical benchmark problems, lid-driven cavity flow and turbulent flow with forced convection in an empty room. The numerical results show that the EMMS-based turbulence model improves the accuracy of turbulence modeling due to it considers the principle of compromise in competition between viscosity and inertia.Comment: 26 pages, 13 figures, 2 table