This post originated from an RSS feed registered with Java Buzz
by Goldy Lukka.
Original Post: Creating your own Web Spider
Feed Title: Xyling Java Blogs
Feed URL: http://www.javablogs.xyling.com/thisWeek.rss
Feed Description: Your one stop source for Java Related Resources.
Have you ever wanted to create your own database of Websites that meet specific criteria? Web spiders, sometimes referred to as Web crawlers, are programs that follow Web links from one site to another, examining content and recording locations. Commercial search sites use Web spiders to populate their databases; researchers can use spiders to find relevant information. Creating your own spider allows you to control the search for content, domains, and Webpage characteristics, such as text density and embedded multimedia content. This article shows you how to create your own powerful Web spider in Java using Java HTML and network classes.
Source code included.
[Resource-Type: Article; Category: Java/J2SE; XRating: 5] Title of the post takes you to the Article at JavaWorld
Previous Topic
