Learning Descriptors for Object Recognition and 3D Pose Estimation

Detecting poorly textured objects and estimating their 3D pose reliably is still a very challenging problem. We introduce a simple but powerful approach to computing descriptors for object views that efficiently capture both the object identity and 3D pose. By contrast with previous manifold-based approaches, we can rely on the Euclidean distance to evaluate the similarity between descriptors, and therefore use scalable Nearest Neighbor search methods to efficiently handle a large number of objects under a large range of poses. To achieve this, we train a Convolutional Neural Network to compute these descriptors by enforcing simple similarity and dissimilarity constraints between the descriptors. We show that our constraints nicely untangle the images from different objects and different views into clusters that are not only well-separated but also structured as the corresponding sets of poses: The Euclidean distance between descriptors is large when the descriptors are from different objects, and directly related to the distance between the poses when the descriptors are from the same object. These important properties allow us to outperform state-of-the-art object views representations on challenging RGB and RGB-D data.Comment: CVPR 201

On the usefulness of the directional distance function in analyzing environmental policy on manure management

The purpose of this paper is to model the manure management policy implemented in the European Union, and more specifically the limit imposed on the spreading of organic nitrogen. A theoretical model is defined in such a way that a number of specificities concerning livestock production can be introduced.The theoretical framework is used to investigate how the land can be shared out optimally between the non-productive purpose of spreading manure in a manner compliant with the environmental regulation and the productive function of providing crops.Then,we define an empirical model derived from the previous theoretical model, using the directional distance function.It provides a framework for deriving shadow prices of pollutant, of productive and non productive use of land and of the constraint on organic manure involved by the European environmental regulation.Environmental Economics and Policy,

Electronic structure of the Ca3Co4O9\rm Ca_3Co_4O_9 compound from ab initio local interactions

We used fully correlated ab initio calculations to determine the effective parameters of Hubbard and t - J models for the thermoelectric misfit compound $\rm Ca_3Co_4O_9$. As for the $\rm Na_xCoO_2$ family the Fermi level orbitals are the $a_{1g}$ orbitals of the cobalt atoms ; the $e'_g$ being always lower in energy by more than 240\,meV. The electron correlation is found very large $U/t\sim 26$ as well as the parameters fluctuations as a function of the structural modulation. The main consequences are a partial $a_{1g}$ electrons localization and a fluctuation of the in-plane magnetic exchange from AFM to FM. The behavior of the Seebeck coefficient as a function of temperature is discussed in view of the ab initio results, as well as the 496\,K phase transition

Numerical generation of hyperspherical harmonics for tetra-atomic systems

A numerical generation method of hyperspherical harmonics for tetra-atomic systems, in terms of row-orthonormal hyperspherical coordinates—a hyper-radius and eight angles—is presented. The nine-dimensional coordinate space is split into three three-dimensional spaces, the physical rotation, kinematic rotation, and kinematic invariant spaces. The eight-angle principal-axes-of-inertia hyperspherical harmonics are expanded in Wigner rotation matrices for the physical and kinematic rotation angles. The remaining two-angle harmonics defined in kinematic invariant space are expanded in a basis of trigonometric functions, and the diagonalization of the kinetic energy operator in this basis provides highly accurate harmonics. This trigonometric basis is chosen to provide a mathematically exact and finite expansion for the harmonics. Individually, each basis function does not satisfy appropriate boundary conditions at the poles of the kinetic energy operator; however, the numerically generated linear combination of these functions which constitutes the harmonic does. The size of this basis is minimized using the symmetries of the system, in particular, internal symmetries, involving different sets of coordinates in nine-dimensional space corresponding to the same physical configuration

Beyond KernelBoost

In this Technical Report we propose a set of improvements with respect to the KernelBoost classifier presented in [Becker et al., MICCAI 2013]. We start with a scheme inspired by Auto-Context, but that is suitable in situations where the lack of large training sets poses a potential problem of overfitting. The aim is to capture the interactions between neighboring image pixels to better regularize the boundaries of segmented regions. As in Auto-Context [Tu et al., PAMI 2009] the segmentation process is iterative and, at each iteration, the segmentation results for the previous iterations are taken into account in conjunction with the image itself. However, unlike in [Tu et al., PAMI 2009], we organize our recursion so that the classifiers can progressively focus on difficult-to-classify locations. This lets us exploit the power of the decision-tree paradigm while avoiding over-fitting. In the context of this architecture, KernelBoost represents a powerful building block due to its ability to learn on the score maps coming from previous iterations. We first introduce two important mechanisms to empower the KernelBoost classifier, namely pooling and the clustering of positive samples based on the appearance of the corresponding ground-truth. These operations significantly contribute to increase the effectiveness of the system on biomedical images, where texture plays a major role in the recognition of the different image components. We then present some other techniques that can be easily integrated in the KernelBoost framework to further improve the accuracy of the final segmentation. We show extensive results on different medical image datasets, including some multi-label tasks, on which our method is shown to outperform state-of-the-art approaches. The resulting segmentations display high accuracy, neat contours, and reduced noise

On Rendering Synthetic Images for Training an Object Detector

We propose a novel approach to synthesizing images that are effective for training object detectors. Starting from a small set of real images, our algorithm estimates the rendering parameters required to synthesize similar images given a coarse 3D model of the target object. These parameters can then be reused to generate an unlimited number of training images of the object of interest in arbitrary 3D poses, which can then be used to increase classification performances. A key insight of our approach is that the synthetically generated images should be similar to real images, not in terms of image quality, but rather in terms of features used during the detector training. We show in the context of drone, plane, and car detection that using such synthetically generated images yields significantly better performances than simply perturbing real images or even synthesizing images in such way that they look very realistic, as is often done when only limited amounts of training data are available

Feature Mapping for Learning Fast and Accurate 3D Pose Inference from Synthetic Images

We propose a simple and efficient method for exploiting synthetic images when training a Deep Network to predict a 3D pose from an image. The ability of using synthetic images for training a Deep Network is extremely valuable as it is easy to create a virtually infinite training set made of such images, while capturing and annotating real images can be very cumbersome. However, synthetic images do not resemble real images exactly, and using them for training can result in suboptimal performance. It was recently shown that for exemplar-based approaches, it is possible to learn a mapping from the exemplar representations of real images to the exemplar representations of synthetic images. In this paper, we show that this approach is more general, and that a network can also be applied after the mapping to infer a 3D pose: At run time, given a real image of the target object, we first compute the features for the image, map them to the feature space of synthetic images, and finally use the resulting features as input to another network which predicts the 3D pose. Since this network can be trained very effectively by using synthetic images, it performs very well in practice, and inference is faster and more accurate than with an exemplar-based approach. We demonstrate our approach on the LINEMOD dataset for 3D object pose estimation from color images, and the NYU dataset for 3D hand pose estimation from depth maps. We show that it allows us to outperform the state-of-the-art on both datasets.Comment: CVPR 201

Geometric phase effects in H3 predissociation

We model the predissociation of H3 in the electronic state corresponding to the upper sheet of the conically intersecting 1 2A[prime] and 2 2A[prime] states, and we show that product-state rovibrational distributions are strongly influenced by the geometric phase. Similarly, the differences in the product-state energy distributions in recent three-body dissociation experiments for the 2s,2A1[prime] and 2p,2A2[double-prime] states of H3 are shown to result from the presence of the geometric phase in this system, and thus provide experimental evidence of the influence of this phase in a molecular dynamical process