A fast hierarchical method for multi-script and arbitrary oriented scene text extraction

Lluis Gomez*, Dimosthenis Karatzas

*Corresponding author for this work

Research output: Contribution to journalArticleResearchpeer-review

15 Citations (Scopus)


Typography and layout lead to the hierarchical organization of text in words, text lines, paragraphs. This inherent structure is a key property of text in any script and language, which has nonetheless been minimally leveraged by existing scene text detection methods. This paper addresses the problem of text segmentation in natural scenes from a hierarchical perspective. Contrary to existing methods, we make explicit use of text structure, aiming directly to the detection of region groupings corresponding to text within a hierarchy produced by an agglomerative similarity clustering process over individual regions. We propose an optimal way to construct such an hierarchy introducing a feature space designed to produce text group hypotheses with high recall and a novel stopping rule combining a discriminative classifier and a probabilistic measure of group meaningfulness based on perceptual organization. Results obtained over four standard datasets, covering text in variable orientations and different languages, demonstrate that our algorithm, while being trained in a single mixed dataset, outperforms state-of-the-art methods in unconstrained scenarios.

Original languageEnglish
Pages (from-to)335-349
Number of pages15
JournalInternational journal on document analysis and recognition
Issue number4
Publication statusPublished - 1 Dec 2016


  • Detection
  • Hierarchical grouping
  • Perceptual organization
  • Scene text
  • Segmentation


Dive into the research topics of 'A fast hierarchical method for multi-script and arbitrary oriented scene text extraction'. Together they form a unique fingerprint.

Cite this