Shared tasks are collaborative initiatives where researchers and practitioners work together to address a common challenge using shared datasets and evaluation metrics. These tasks foster competition, collaboration, and advancement within the field, playing a significant role in both academic and industry communities. FinEval provides a venue for the community to share valuable insights and inspiration. Every year, we will call for proposals for the next edition of FinEval, which is collocated with the FinNLP workshop.

We encourage submissions for tasks that test systems on financial text analysis, with a particular focus on cross-lingual, application-oriented tasks, and novel uses of NLP in finance. Tasks for non-English languages and cross-domain applications are welcome.

Your task proposal will be evaluated on:

• Novelty: Is the task addressing a unique or under-explored problem in financial NLP?
• Interest: Will the task attract broad participation?
• Data Quality: Is the data collection plan robust, with high inter-annotator agreement and appropriate licensing?
• Evaluation: Is the evaluation methodology rigorous, and will it inspire future research?
• Impact: What long-term impact will this task have on financial NLP?
• Ethics: Data should avoid PII and adhere to ethical guidelines, including privacy compliance and ethical data use.

Organizers should be prepared to:

• Ensure data quality and licensing, addressing ethical and security concerns.
• Provide format checkers, baseline systems, and evaluation tools for participants.
• Manage a competition platform (e.g., CodaLab) and maintain communication channels.
• Write and present a task description paper at the FinEval session in FinNLP workshop.
• Organize and review participant submissions and related documentation.

• Lead Organizer: Oversees the task, ensuring timely completion of deliverables.
• Co-Organizers: Assist with data preparation, evaluation, and participant communication.
• Advisory Organizers: Provide guidance, not necessarily engaged in daily tasks.

Note: A minimum of two organizers is required per task. Single-organizer submissions will not be accepted.

Task proposals should be in PDF format, following the ACL Template, and must be no longer than 4 pages (plus references). Include the following sections:

• Overview: Summary, community interest, and anticipated impact.
• Data & Resources: Data sources, copyright details, data quantity, quality assurance, and ethical considerations.
• Pilot Task: (recommended) Results and insights from initial studies.
• Evaluation: Clear evaluation methodology and criteria.
• Task Reruns: If a rerun, provide justification and expected impact.
• Task Organizers: Names, affiliations, contact details, and relevant experience.

Please send the proposal to aclsigfintech@gmail.com