Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networks

22 May, 2020 by Tek Min Tan

Patent Name: Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networks

Filing No: 10201704115T (SG)

Filing Date: 19 May 2017

Country to be Filed: Singapore

Description: Factorization Machines (FMs) are a supervised learning approach that enhances the linear regression model by incorporating the second-order feature interactions. Despite effectiveness, FM can be hindered by its modelling of all feature interactions with the same weight, as not all feature interactions are equally useful and predictive. For example, the interactions with useless features may even introduce noises and adversely degrade the performance. In this work, we improve FM by discriminating the importance of different feature interactions. We propose a novel model named Attentional Factorization Machine (AFM), which learns the importance of each feature interaction from data via a neural attention network. Extensive experiments on two real-world datasets demonstrate the effectiveness of AFM. Empirically, it is shown on regression task AFM betters FM with a 8.6% relative improvement, and consistently outperforms the state-of-the-art deep learning methods Wide&Deep [Cheng et al., 2016] and DeepCross[Shan et al., 2016] with a much simpler structure and fewer model parameters. Our implementation of AFM is publicly available at: https://github.com/hexiangnan/attentional factorization machine. 

Patents

QLive: Low Latency Live Streaming Solution

25 May, 2020

Advanced Conversational Recommender System

25 May, 2020

Multi-Channel Graph Neural Network (MuGNN)

25 May, 2020

Food Recognition Enhanced Using Privileged Information

25 May, 2020

Knowledge Enhanced Translation-based User Preference Model (KTUP)

25 May, 2020

A Contextual Relation Networks for Mixed-Dish Recognition

25 May, 2020

Tree Enhanced Embedding Model Predictive Analysis Methods and Systems

25 May, 2020

Machine Learning Using Partial Order Hypergraphs

25 May, 2020

Video Visual Relation Detection

25 May, 2020

Object Trajectory Proposal

25 May, 2020

Neural Factorization Machines for Predictive Analytics

25 May, 2020

Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networks

22 May, 2020

Back