The week's pick
Random Articles
Reseach Article
Architectural Design of Meta Crawler for Terrorist Network Mining
| Communications on Applied Electronics |
| Foundation of Computer Science (FCS), NY, USA |
| Volume 5 - Number 8 |
| Year of Publication: 2016 |
| Authors: R. D. Gaharwar, D. B. Shah |
10.5120/cae2016652352
|
R. D. Gaharwar, D. B. Shah . Architectural Design of Meta Crawler for Terrorist Network Mining. Communications on Applied Electronics. 5, 8 ( Aug 2016), 37-40. DOI=10.5120/cae2016652352
Abstract
Nowadays world is flooded with the digital data as well as with different types of search services but none of the search service gives the complete view of internet data. Moreover there is scarcity of the Meta Crawlers that are application specific. This paper presents architectural design of Meta crawler designed especially for Terrorist Web Mining. This architectural design is use to create an effective Meta crawling service that span across search engines. Meta crawler collates the search results of multiple search engines to fetch the terrorist Networks related information. Search results from single search engine may prove insufficient and spamming affected hence there is need for Meta Crawler which filters the results aggregated. Meta Crawler proposed in this paper has a multithreaded architecture hence this Terrorist Meta Crawler design have advantages like performance efficiency and scalability. This architecture can be used to designed a terrorist network related dynamic Meta Crawler.
References
- Sergey Brin and Lawrence Page, "The Anatomy of a Large-Scale Hypertextual Web Search Engine," in 7th World Wide Conference(WWW7), Brisbane, 1998.
- Heydon, Allan, and Marc Najork. "Mercator: A scalable, extensible web crawler." World Wide Web 2.4 (1999): 219-229.
- Etzioni, Oren. "Moving up the information food chain: Deploying softbots on the world wide web." AI magazine 18.2 (1997): 11.
- R. D. Gaharwar, D. B. Shah, and G.K.S. Gaharwar, "Proposed Architecture for Terrorist Web Miner," International Journal of Computer Applications, vol. 128, no. 9, pp. 18-20, October 2015.
- Gyongi, Zoltan, and Hector Garcia-Molina, "Spam: It's not just for inboxes anymore.”, Computer 38.10 (2005): 28-34.
- Yang, X., & Zhang, M. (2000). Necessary Constraints for Fusion Algorithms in Meta Search Engine Systems. In Proc. of the Int’l Conf. on Intelligent Technologies (pp. 409-416)
- Selberg, E., & Etzioni, O. (1995, December). Multi-service search and comparison using the MetaCrawler. In Proceedings of the Fourth Int'l WWW Conference, Boston.
- Laria, Víctor González, Richard Griffiths, and Graham Winstanley. "Application of a clustering algorithm to recover topic content in an unstructured text-based environment."
- Selberg, E., & Etzioni, O. (1997). The MetaCrawler architecture for resource aggregation on the Web. IEEE expert, 12(1), 11-14.
Index Terms
Keywords