Affective feedback: an investigation into the role of emotions in the information seeking process

User feedback is considered to be a critical element in the information seeking process, especially in relation to relevance assessment. Current feedback techniques determine content relevance with respect to the cognitive and situational levels of interaction that occurs between the user and the retrieval system. However, apart from real-life problems and information objects, users interact with intentions, motivations and feelings, which can be seen as critical aspects of cognition and decision-making. The study presented in this paper serves as a starting point to the exploration of the role of emotions in the information seeking process. Results show that the latter not only interweave with different physiological, psychological and cognitive processes, but also form distinctive patterns, according to specific task, and according to specific user

Typical Phone Use Habits: Intense Use Does Not Predict Negative Well-Being

Not all smartphone owners use their device in the same way. In this work, we uncover broad, latent patterns of mobile phone use behavior. We conducted a study where, via a dedicated logging app, we collected daily mobile phone activity data from a sample of 340 participants for a period of four weeks. Through an unsupervised learning approach and a methodologically rigorous analysis, we reveal five generic phone use profiles which describe at least 10% of the participants each: limited use, business use, power use, and personality- & externally induced problematic use. We provide evidence that intense mobile phone use alone does not predict negative well-being. Instead, our approach automatically revealed two groups with tendencies for lower well-being, which are characterized by nightly phone use sessions.Comment: 10 pages, 6 figures, conference pape

Ranking News-Quality Multimedia

News editors need to find the photos that best illustrate a news piece and fulfill news-media quality standards, while being pressed to also find the most recent photos of live events. Recently, it became common to use social-media content in the context of news media for its unique value in terms of immediacy and quality. Consequently, the amount of images to be considered and filtered through is now too much to be handled by a person. To aid the news editor in this process, we propose a framework designed to deliver high-quality, news-press type photos to the user. The framework, composed of two parts, is based on a ranking algorithm tuned to rank professional media highly and a visual SPAM detection module designed to filter-out low-quality media. The core ranking algorithm is leveraged by aesthetic, social and deep-learning semantic features. Evaluation showed that the proposed framework is effective at finding high-quality photos (true-positive rate) achieving a retrieval MAP of 64.5% and a classification precision of 70%.Comment: To appear in ICMR'1

Affect-based information retrieval

One of the main challenges Information Retrieval (IR) systems face nowadays originates from the semantic gap problem: the semantic difference between a user’s query representation and the internal representation of an information item in a collection. The gap is further widened when the user is driven by an ill-defined information need, often the result of an anomaly in his/her current state of knowledge. The formulated search queries, which are submitted to the retrieval systems to locate relevant items, produce poor results that do not address the users’ information needs. To deal with information need uncertainty IR systems have employed in the past a range of feedback techniques, which vary from explicit to implicit. The first category of feedback techniques necessitates the communication of explicit relevance judgments, in return for better query reformulations and recommendations of relevant results. However, the latter happens at the expense of users’ cognitive resources and, furthermore, introduces an additional layer of complexity to the search process. On the other hand, implicit feedback techniques make inferences on what is relevant based on observations of user search behaviour. By doing so, they disengage users from the cognitive burden of document rating and relevance assessments. However, both categories of RF techniques determine topical relevance with respect to the cognitive and situational levels of interaction, failing to acknowledge the importance of emotions in cognition and decision making. In this thesis I investigate the role of emotions in the information seeking process and develop affective feedback techniques for interactive IR. This novel feedback framework aims to aid the search process and facilitate a more natural and meaningful interaction. I develop affective models that determine topical relevance based on information gathered from various sensory channels, and enhance their performance using personalisation techniques. Furthermore, I present an operational video retrieval system that employs affective feedback to enrich user profiles and offers meaningful recommendations of unseen videos. The use of affective feedback as a surrogate for the information need is formalised as the Affective Model of Browsing. This is a cognitive model that motivates the use of evidence extracted from the psycho-somatic mobilisation that occurs during cognitive appraisal. Finally, I address some of the ethical and privacy issues that arise from the social-emotional interaction between users and computer systems. This study involves questionnaire data gathered over three user studies, from 74 participants of different educational background, ethnicity and search experience. The results show that affective feedback is a promising area of research and it can improve many aspects of the information seeking process, such as indexing, ranking and recommendation. Eventually, it may be that relevance inferences obtained from affective models will provide a more robust and personalised form of feedback, which will allow us to deal more effectively with issues such as the semantic gap

Essays in the Economics of Aging

This thesis is made up of three main essays that aim to develop a deeper understanding of issues involving the public insurance programs for the elderly, and the risks they insure against. In the first essay (Chapter 2), using data from the Health and Retirement Study linked to administrative Medicare and Medicaid records, along with the Medical Expenditure Panel Survey, we estimate the stochastic process for total and out-of-pocket medical spending. By focussing on dynamics, we consider not only the risk of catastrophic expenses in a single year, but also the risk of moderate but persistent expenses that accumulate into a catastrophic lifetime cost. We also assess the reduction in out-of-pocket medical spending provided by public insurance schemes such as Medicare or Medicaid. We find that although Medicare and Medicaid pay the majority of medical expenses, households at age 65 will on average incur $59,000 in out-of-pocket costs with 10 percent of households incurring more than$121,000 in out-of-pocket expenses over their remaining lives. In the second essay (Chapter 3), we compare dementia prevalence and how it varies by socioeconomic status (SES) in the United States and England. We compare between country differences in age-gender standardized dementia prevalence, across the SES gradient. Dementia prevalence was estimated in each country using an algorithm based on an identical battery of demographic, cognitive, and functional measures. Dementia prevalence is higher among the disadvantaged in both countries, with the United States being more unequal according to four measures of SES. Once past health factors and education were controlled for, most of the within country inequalities disappeared; however, the cross-country difference in prevalence for those in the lowest income decile remained disproportionately high. This provides evidence that disadvantage in the United States is a disproportionately high risk factor for dementia. In the final essay (Chapter 4), we assess the optimal structure the U.S. Social Security system, taking into account the current system’s unfunded liabilities, transition dynamics and political feasibility constraints. We base the assessment on an estimated overlapping generations general equilibrium model that features both aggregate and idiosyncratic uncertainty. The quantitative analysis establishes that although transition costs greatly restrict the U.S. government’s ability to move away from the current Social Security system, ignoring the political feasibility constraints allows the government to increase welfare by transitioning to a more progressive and less costly to operate system. However, taking into account the political feasibility constraints overturns this result, as no reform is simultaneously welfare increasing and politically feasible

Using Learning Analytics to Devise Interactive Personalised Nudges for Active Video Watching

Videos can be a powerful medium for acquiring soft skills, where learning requires contextualisation in personal experience and ability to see different perspectives. However, to learn effectively while watching videos, students need to actively engage with video content. We implemented interactive notetaking during video watching in an active video watching system (AVW) as a means to encourage engagement. This paper proposes a systematic approach to utilise learning analytics for the introduction of adaptive intervention - a choice architecture for personalised nudges in the AVW to extend learning. A user study was conducted and used as an illustration. By characterising clusters derived from user profiles, we identify different styles of engagement, such as parochial learning, habitual video watching, and self-regulated learning (which is the target ideal behaviour). To find opportunities for interventions, interaction traces in the AVW were used to identify video intervals with high user interest and relevant behaviour patterns that indicate when nudges may be triggered. A prediction model was developed to identify comments that are likely to have high social value, and can be used as examples in nudges. A framework for interactive personalised nudges was then conceptualised for the case study

Self-Supervised Reinforcement Learning for Recommender Systems

In session-based or sequential recommendation, it is important to consider a number of factors like long-term user engagement, multiple types of user-item interactions such as clicks, purchases etc. The current state-of-the-art supervised approaches fail to model them appropriately. Casting sequential recommendation task as a reinforcement learning (RL) problem is a promising direction. A major component of RL approaches is to train the agent through interactions with the environment. However, it is often problematic to train a recommender in an on-line fashion due to the requirement to expose users to irrelevant recommendations. As a result, learning the policy from logged implicit feedback is of vital importance, which is challenging due to the pure off-policy setting and lack of negative rewards (feedback). In this paper, we propose self-supervised reinforcement learning for sequential recommendation tasks. Our approach augments standard recommendation models with two output layers: one for self-supervised learning and the other for RL. The RL part acts as a regularizer to drive the supervised layer focusing on specific rewards(e.g., recommending items which may lead to purchases rather than clicks) while the self-supervised layer with cross-entropy loss provides strong gradient signals for parameter updates. Based on such an approach, we propose two frameworks namely Self-Supervised Q-learning(SQN) and Self-Supervised Actor-Critic(SAC). We integrate the proposed frameworks with four state-of-the-art recommendation models. Experimental results on two real-world datasets demonstrate the effectiveness of our approach.Comment: SIGIR202

Protein pathways as a catalyst to directed evolution of the topology of artificial neural networks

In the present article, we propose a paradigm shift on evolving Artificial Neural Networks (ANNs) towards a new bio-inspired design that is grounded on the structural properties, interactions, and dynamics of protein networks (PNs): the Artificial Protein Network (APN). This introduces several advantages previously unrealized by state-of-the-art approaches in NE: (1) We can draw inspiration from how nature, thanks to millions of years of evolution, efficiently encodes protein interactions in the DNA to translate our APN to silicon DNA. This helps bridge the gap between syntax and semantics observed in current NE approaches. (2) We can learn from how nature builds networks in our genes, allowing us to design new and smarter networks through EA evolution. (3) We can perform EA crossover/mutation operations and evolution steps, replicating the operations observed in nature directly on the genotype of networks, thus exploring and exploiting the phenotypic space, such that we avoid getting trapped in sub-optimal solutions. (4) Our novel definition of APN opens new ways to leverage our knowledge about different living things and processes from biology. (5) Using biologically inspired encodings, we can model more complex demographic and ecological relationships (e.g., virus-host or predator-prey interactions), allowing us to optimise for multiple, often conflicting objectives.Comment: 8 pages, 6 figure