Web Crawlers for Searching Hidden Pages: A Survey

K. F.Bharati, P. Premchand, A. Govardhan
2013 International Journal of Computer Applications  
Many researchers have addressed the need of a dynamic proven model of web crawler that will address the need of several dynamic commerce, research and ecommerce establishments over the web that majorly runs with the help of a search engine. The entire web architecture is changing from a traditional to a semantic. And on the other hand the web crawlers. The web crawler of today is vulnerable to omit several tons of pages without searching and also is incapable of capturing the hidden pages.
more » ... are several research problems of information retrieval, far from optimization such as supporting user to analyze the problem to determine information needs. The paper makes an analytical survey of several proven web crawlers capable of searching hidden pages. It also addresses the prospects and constraints of the methods and the ways to further enhance.
doi:10.5120/10706-5649 fatcat:3crkmxj5undb5o3blm37lafomq