International Journal of Advanced Computing and Communication Systems

A Review- Effective Mechanism of Web Crawling to Access the Website

John Augustine P and Savitha N, Department of CSE, Sri Eshwar College Of Engineering, Coimbatore, Tamilnadu, India.

International Journal of Advanced Computing and Communication Systems

ISSN (Online) : 2347 - 9299

ISSN (Print) : 2347 - 9280

Received On :

Revised On :

Accepted On :

Published On :

Volume 04, Issue 03

Page No : 007-010

Abstract

Web application security is the process of securing data stored online from unauthorized access and modification. There are so many known exploits and the complexity of web servers and web sites. One of the known vulnerabilities will be present and allow an attacker access to the site. Web crawler visits a web page; it "reads" the visible text, the hyperlinks, and the content of the various tags used in the site, such as keyword rich Meta tags. Crawling which helps to extract the sub links from seed link and helps to scan the website for testing the possible vulnerabilities. We implement Web Crawler used to crawl the website by using Breadth First Search (BFS) algorithm. BFS is a graph search algorithm that begins at the root node and explores all the neighboring nodes. The BFS is one of the algorithm we used in crawling functionality. It begins at a root node and inspects all the neighboring nodes. It is a searching method which search all the nodes one by one. BFS is an uninformed search method that aims to expand and examine all nodes of a graph or combination of sequences by systematically searching through every solution. It is step by step process to search all the nodes completely. Using this algorithm we crawl the sub links from the “seed link” of a websites.

Keywords

BFS,AppsecTool,HTML,URL,XSS,CSRF.

Cite this Article

John Augustine P and Savitha N, “A Review- Effective Mechanism of Web Crawling to Access the Website, ”International Journal of Advanced Computing and Communication Systems, pp. 007-010, November, 2017.

Copyright

© 2017 John Augustine P and Savitha N. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.