Skip to content
All projects

2022

GAT for Text Line Detection

4M-parameter Graph Attention + GRU model for line detection on receipts - state-of-the-art 97.23% F1 on CORD with 100–200× fewer parameters.

Matching key–value pairs on receipts depends on knowing which OCR detections sit on the same line, and existing line-detection models were built for structured documents and generalised poorly to receipts.

We modelled OCR detections as a graph and combined Graph Attention layers with Gated Recurrent Units to predict line membership. An ablation study validated each architectural choice.

The paper was presented at the Document Intelligence Workshop at KDD 2022 in Washington DC.

Highlights

  • 97.23% F1 on the CORD dataset (state of the art)
  • ~4M parameters - 100–200× smaller than competing models
  • Co-authored with David Montero Martín, David Jiménez and Javier Yebes