Survey on Mobile Optimized Search Crawler
Keywords:
Search engine, Crawler, Web server, Mobile application server, Wireless markup language, Wireless application protocolAbstract
The web crawler is the central component of a search engine which works like an indexer, finds out hyperlinks and computes keyword density of each web page. It assigns a page rank to each crawled web page by using some ranking
algorithm and stores the visited links for the future use. Search results retrieve very fast from desktop browser, but it takes more time when user is on mobile. When a keyword is searched from a mobile browser, the traditional web servers take a long time to interpret this request. Also, the web server has to format search results into the form which mobile device can interpret. Thus, to eliminate this overhead on the web server, a Mobile Application Server has to be introduced instead of the web server to interpret requests from mobile devices
References
Feng Zhao, Jingyu Zhou, Chang Nie, Heqing Huang and Hai Jin, “SmartCrawler : A two-stage crawler for efficiently harvesting deep-web interfaces”, Services Computing, IEEE Transactions, Volume-PP, Issue-99, DOI-10.11.09, 2015.
Mehdi Bahrami, Mukesh Singhal and Zixuan Zhuang, “A Cloud-based Web Crawler Architecture”, Intelligence in Next Generation Networks (ICIN), 2015 18th International Conference, Page No (216-233), 17-19 Feb 2015.
Kausar M. A., Nasar M. and Singh S. K., “Maintaining the repository of search engine freshness using mobile crawler”, Emerging Research Areas and 2013 International Conference on Microelectronics, Communications and Renewable Energy (AICERA/ICMiCR), 2013 Annual International Conference, Page No (1-6), 2013.
Jian-Hong Liu, Jing Chen, Yi-Li Wu and Pei-Li Wang, “AASMP - Android Application Server for Mobile Platforms”, IEEE 2013 16th International Conference on Computational Science and Engineering, Page No (643- 650), 2013.
Vinay Kancherla, “Smart Crawler for a Concept based Semantic Search Engine”, Master's Theses and Graduate Research at SJSU ScholarWorks, Paper 380, 12 Jan 2014.
Pavalam S.M, S.V. KumarRaja, M. Jawhar and Felix K. Akorli, “Web crawler in mobile systems”, International Journal of Machine Learning and Computing, Volume-02, Issue-04, Page No (531-534), August 2012.
Beena Mahar and C K Jha, “A comparative study on Web crawling for searching Hidden web”, International Journal of Computer Science and Information Technologies, Volume-02, Issue-03, Page No (2159-2163), 2015.
Vladislav Shkapenyuk and Torsten Suel, “Design and implementation of a high-performance distributed Web crawler”, Data Engineering, 2002. IEEE Proceedings. 18th International Conference, Page No (357-368), 2002.
Jason Rennie and Andrew McCallum, “Using reinforcement learning to spider the web efficiently”, Proceedings of the 16th International Conference on Machine Learning (ICML), Page No (335-343), 1999.
Hardik P. Trivedi, Gaurav N. Daxini, Jignesh A. Oswal, Vinay D. Gor and Swati Mali, “An Approach to Design Personalized Focused Crawler”, International Journal of Computer Sciences and Engineering, Volume-02, Issue-03, Page No (144-147), March 2014.
“Mobile Application Server”, http://www.mobileinfo.com/application_servers.htm , 4 July, 2015.
“Search Engine”, http://websearch.about.com/od/enginesanddirectories/a/searc hengine.htm , 15 July, 2015.
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors contributing to this journal agree to publish their articles under the Creative Commons Attribution 4.0 International License, allowing third parties to share their work (copy, distribute, transmit) and to adapt it, under the condition that the authors are given credit and that in the event of reuse or distribution, the terms of this license are made clear.
