Benchmarks / pixiu-flare

PIXIU / FLARE

An open-source financial LLM resource bundling the FinMA instruction-tuned models, a 136K-sample instruction dataset, and the FLARE evaluation benchmark.

  • benchmark
  • financial-llm
  • instruction-tuning
  • evaluation
  • flare

added 2026-08-15 · MIT · external

Use this

$ git clone https://github.com/The-FinAI/PIXIU

Prerequisites

tradingbasicaiadvancedprogrammingmoderatesetupmoderate

Details

authorsQianqian Xie, Weiguang Han, Xiao Zhang, Yanzhao Lai, Min Peng, Alejandro Lopez-Lira, Jimin Huang
originexternal
licenseMIT
taskssentiment-analysis, classification, knowledge-extraction, numerical-reasoning, summarization, credit-scoring, forecasting
marketsequities

PIXIU released the first open financial LLM suite in three parts: FinMA, LLaMA-based models fine-tuned on financial instructions; FIT, an instruction dataset of 136K samples covering multiple financial tasks and document types; and FLARE, the evaluation benchmark that originally spanned five financial NLP tasks plus a prediction task over nine datasets (arXiv:2306.05443).

FLARE has since grown into the FinBen evaluation suite (~32 datasets across sentiment analysis, classification, knowledge extraction, numerical reasoning, summarization, credit scoring, and forecasting) with a public leaderboard; English, Spanish, and Chinese are covered. Models and evaluation datasets are published on Hugging Face under The FinAI organization.

Connections

Extended by: FinBen