Self-Adaptive Semantic Focused Crawler for Mining Services Information Discovery

Hai Dong, F. K. Hussain
2014 IEEE Transactions on Industrial Informatics  
It is well recognized that the Internet has become the largest marketplace in the world, and online advertising is very popular with numerous industries, including the traditional mining service industry where mining service advertisements are effective carriers of mining service information. However, service users may encounter three major issues -heterogeneity, ubiquity, and ambiguity, when searching for mining service information over the Internet. In this paper, we present the framework of
more » ... novel self-adaptive semantic focused crawler -SASF crawler, with the purpose of precisely and efficiently discovering, formatting, and indexing mining service information over the Internet, by taking into account the three major issues. This framework incorporates the technologies of semantic focused crawling and ontology learning, in order to maintain the performance of this crawler, regardless of the variety in the Web environment. The innovations of this research lie in the design of an unsupervised framework for vocabulary-based ontology learning, and a hybrid algorithm for matching semantically relevant concepts and metadata. A series of experiments are conducted in order to evaluate the performance of this crawler. The conclusion and the direction of future work are given in the final section. Index Terms-Mining service industry, ontology learning, semantic focused crawler, service advertisement, service information discovery. 2 His areas of active research are cloud computing, services computing, trust and reputation modeling, semantic web technologies and industrial informatics. He works actively in the domain of cloud computing and business intelligence. In the area of business intelligence the focus of his research is to develop smart technological measures such as trust and reputation technologies and semantic web for enhanced and accurate decision making.
doi:10.1109/tii.2012.2234472 fatcat:hotreldsujernfadxiuoka2rq4