Automatic extraction of concepts from texts

The extraction of relevant terms from texts is an extensively researched task in Text-Mining. Relevant terms have been applied in diverse areas such as Information Retrieval or document clustering and classification. Relevance has, however, a rather fuzzy nature since the classification of some terms as relevant or not relevant is not consensual. Concepts, on the other hand, have a less fuzzy nature. Instead of inferring the importance of a term during the extraction process, as is usually done, it is proposed to focus on the extraction of generic concepts from texts and leave the decision about relevance to downstream applications. This book, therefore, presents ConceptExtractor, a statistical and language-independent methodology. Concepts extracted by this method can be used to identify keywords in documents or to extract semantic relations from texts, among other possible applications.

Autorentext

João Ventura is currently a full-stack developer with an interest in data extraction and processing. He received his PhD degree from the Universidade Nova de Lisboa in 2014 with his work on the extraction of concepts from texts. He is also the founder of Flatangle.