NaCTeM

Shared Task on Financial Misinformation Detection at FinNLP-FNP-LLMFinLegal

2024-09-04

Background

In the financial sector, the accuracy of information is crucial for the integrity of decisions, market operation, risk management, compliance, and trust establishment. However, the proliferation of digital media has escalated the spread of financial misinformation. Such misinformation, including deceptive investment propositions and biased news articles, can manipulate market prices and influence economic sentiment, presenting substantial risks. The advent of LLMs in finance has introduced transformative potential for analysis, prediction, and decision-making. In this challenge, participants are expected to engineer LLMs capable of not only identifying fraudulent financial content but also generating clear, concise explanations that elucidate the reasoning behind the classification by levering claims and contextual information. This requirement for explanation generation is crucial, as it adds an additional layer of transparency and trust in the AI's decision-making process, enhancing the model's utility for investors, regulatory bodies, and the broader financial community.

Task

This shared task tests the ability of LLM to verify financial misinformation while generating plausible explanations. Participants need to develop or adapt LLMs to identify financial claims (True/False/Not Enough Information) and give explanations for their decision according to the related information, following the designed prompt template of the query.

For detailed information, including how to get started, please visit: https://coling2025fmd.thefin.ai/

The task is being organised as part of the joint workshop of FinNLP, FNP, and LLMFinLegal (https://sites.google.com/nlg.csie.ntu.edu.tw/finnlp-fnp-llmfinlegal/home), which aims to explore the intersection of Natural Language Processing (NLP), Machine Learning (ML), and Large Language Models (LLMs) within the financial and legal domains.

Key Dates for the Challenge Phase

  • Registration Open: 15 August 2024
  • Training Set Release: 15 September 2024
  • Blind Test Set Release: 30 October 2024
  • Systems Submission Deadline: 7 November 2024
  • Results Release: 12 November 2024

Paper Phase

  • Submissions Due: 25 November 2024
  • Notification: 5 December 2024
  • Camera-Ready Version Due: 13 December 2024
  • Workshop Date: 19-20 January 2025

Shared Task Organisers

Zhiwei Liu - University of Manchester, UK
Keyi Wang - Columbia University, Northwestern University, USA
Zhuo Bao - Internet Domain Name System Beijing Engineering Research Center Co, China
Jiping Dong - University of Chinese Academy of Sciences, China
Boyang Gu - Imperial College London, UK
Kailai Yang - University of Manchester, UK
Dong Li - FinAI, Singapore
Sophia Ananiadou - University of Manchester, UK; Archimedes RC, Greece

Previous itemNext item
Back to news summary page