Loading...

ColBERT: Using BERT sentence embedding in parallel neural networks for computational humor

Annamoradnejad, I ; Sharif University of Technology | 2024

13 Viewed
  1. Type of Document: Article
  2. DOI: 10.1016/j.eswa.2024.123685
  3. Publisher: 2024
  4. Abstract:
  5. Automatic humor detection has compelling use cases in modern technologies, such as humanoid robots, chatbots, and virtual assistants. In this paper, we propose a novel approach for detecting and rating humor in short texts based on a popular linguistic theory of humor. The proposed technical method initiates by separating sentences of the given text and utilizing the BERT model to generate embeddings for each one. The embeddings are fed to a neural network as parallel lines of hidden layers in order to determine the congruity and other latent relationships between the sentences, and eventually, predict humor in the text. We accompany the paper with a novel dataset consisting of 200,000 short texts, labeled for the binary task of humor detection. In addition to evaluating our work on the novel dataset, we participated in a live machine-learning competition to rate humor in Spanish tweets. The proposed model obtained F1 scores of 0.982 and 0.869 in the performed experiments which outperform general and state-of-the-art models. The evaluation results confirm the model's strength and robustness and suggest two important factors in achieving high accuracy in the current task: (1) usage of sentence embeddings and (2) utilizing the linguistic structure of humor in designing the proposed model. © 2024 Elsevier Ltd
  6. Keywords:
  7. Jokes dataset ; Anthropomorphic robots ; Computation theory ; Linguistics ; Multilayer neural networks ; BERT sentence embedding ; Computational humor ; Humanoid robot ; Humor detection ; Humor rating ; Joke dataset ; Modern technologies ; Parallel neural networks ; Short texts ; Embeddings
  8. Source: Expert Systems with Applications ; Volume 249 , 2024 ; 09574174 (ISSN)
  9. URL: https://www.sciencedirect.com/science/article/pii/S0957417424005517