Information extraction - tree alignment approach to pattern discovery in web documents

4Citations
Citations of this article
9Readers
Mendeley users who have this article in their library.
Get full text

Abstract

The World Wide Web has now entered its mature age. It not only hosts and serves large amounts of pages but also offers large amounts of information potentially useful for individuals and businesses. Modern decision support can no more be effective without timely and accurate access to this unprecedented source of data. However, unlike in a database, the structure of data available on the Web is not known apriori and its understanding seems to require human intervention. Yet the conjunction of layout rules and simple domain knowledge enables in many cases the automatic understanding of such unstructured data. In such cases we say that data is semi-structured. Wrapper generation for automatic extraction of information from theWeb has therefore been a crucial challenge in the recent years. Various authors have suggested different approaches for extracting semi-structured data from the Web, ranging from analyzing the layout and syntax of Web documents to learning extraction rules from user’s training examples. In this paper, we propose to exploit the HTML structure of Web documents that contain information in the form of multiple homogeneous records. We use a Tree Alignment algorithm with a novel combination of heuristics to detect repeated patterns and infer extraction rules. The performance study shows that our approach is effective in practice, yielding practical performance and accurate results.

Cite

CITATION STYLE

APA

Hemnani, A., & Bressan, S. (2002). Information extraction - tree alignment approach to pattern discovery in web documents. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 2453, pp. 789–798). Springer Verlag. https://doi.org/10.1007/3-540-46146-9_78

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free