Effectively Modeling Sentence Interactions With Factorization Machines for Fact Verification

Abstract

Fact verification is a very challenging task that requires retrieving multiple evidence sentences from a reliable corpus to authenticate claims. Many claims require the simultaneous integration and reasoning of several pieces of evidence for verification. Existing models exhibit limitations in two aspects: 1) during the sentence selection stage, they only consider the interaction between the claim and the evidence, disregarding the intersentence information, and 2) most fusion strategies employed in current research, such as addition, concatenation, or simple neural networks, fail to capture the relationships and logical information among the evidence. To alleviate these problems, we propose select and fact verification modeling (SFVM). Our model utilizes a multihead self-attention mechanism combined with a gating mechanism to facilitate sentence interaction and enhance sentence embeddings. Then, we utilize factorization machines to effectively express the compressed alignment vectors, which are then used to expand the representations of the base evidence. To distinguish the importance of features, we use the evidence fusion network to determine the importance of various feature interactions. Results from experiments on the two public datasets showed that SFVM can utilize richer information between the claim and the evidence for fact verification and achieve competitive performance on the FEVER dataset.