Skip to content

Flargebla/webcrawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 

Repository files navigation

The Stevens Webcrawler Project

###Started by Connor Zapfel on February 1st, 2016

##Current Project Leads:

  • Connor Zapfel, class of 2018, Cybersecurity major
  • Jonathan Eugenio, class of 2018, Physics major

=================================================

##What is the goal of this project? We want to build our own webcrawler that can successfully navigate through websites and recover the desired information

##Where can I get more information about webcrawlers? Glad you asked. Wikipedia has information on webcrawlers right here

There is also more information here as well

##What do you hope to accomplish? We want to successfully create our own webcrawler. In the process we hope to understand more about how they work, and the skills and knowledge utilized and gained will certainly be a valuable reward, even if there are issues with the webcrawler

##Is there a roadmap of the project?

Time Frame Feature
As Soon as possible Develop the basic framework of the crawler utilizing a java class
Some time after that Develop the ability to store information in a text pad or even an excel document
Around the same time Implement the ability to differentiate company names
Beyond Webcrawler will be able to search for individual items on a page

##Any other questions? Sure, send us any questions, comments, concerns, fan mail, etc.

About

Fun webcrawler project

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages