The size of Internet is large and it had grown enormously, search engines are the tools for web site navigation and search. Search engines maintain indices for web documents and provides search facilities by continuously downloading web pages for processing. This process of downloading web pages is known as web crawling. In this book Architecture for effective migrating parallel web crawling approach with domain specific and incremental crawling strategy is proposed. The major advantages of parallel web crawler are that the analysis portion of the crawling process is done locally at the residence of data rather than inside the web search engine repository. This significantly reduces network load and traffic which in turn improves the performance, effectiveness and efficiency of the crawling process. The another advantage of migrating parallel crawler is that the size of the web grows, it becomes necessary to parallelize a crawling process, in order to finish downloading web pages in comparatively shorter time. Domain specific crawling will yield high quality pages.
Dr. Md. Faizan Farooqui have done MCA,M.Tech, Ph.D, working as Associate Professor at Dept. of Computer Application, Integral University, Lucknow, India. He has overall 18+ years experience in the field of Academics. He is actively involved in research and have published papers in reputed Journals and also member of various professional bodies.
Über den Autor
O Dr. Md. Faizan Farooqui fez MCA,M.Tech, Ph.D., trabalhando como Professor Associado no Departamento de Aplicações Informáticas, Universidade Integral, Lucknow, Índia. Ele tem mais de 18 anos de experiência no campo académico. Está activamente envolvido na investigação e publicou artigos em revistas de renome e também membro de vários organismos profissionais.
Klappentext
The size of Internet is large and it had grown enormously, search engines are the tools for web site navigation and search. Search engines maintain indices for web documents and provides search facilities by continuously downloading web pages for processing. This process of downloading web pages is known as web crawling. In this book Architecture for effective migrating parallel web crawling approach with domain specific and incremental crawling strategy is proposed. The major advantages of parallel web crawler are that the analysis portion of the crawling process is done locally at the residence of data rather than inside the web search engine repository. This significantly reduces network load and traffic which in turn improves the performance, effectiveness and efficiency of the crawling process. The another advantage of migrating parallel crawler is that the size of the web grows, it becomes necessary to parallelize a crawling process, in order to finish downloading web pages in comparatively shorter time. Domain specific crawling will yield high quality pages.
