Web Hosting Talk







View Full Version : Crawler Engine Script?


Mike Bell
03-16-2005, 10:30 AM
Do any of you guys know of a free, or very cheap script for crawling sites? A search engine script? I need open source to customize... but I didn't wanna re-invent the wheel if there is something out there to start from. Programming lang isn't important..... I'm adaptable :)

Thanks in advance!

destnj
03-16-2005, 10:29 PM
Try cnet and then type in what your looking for in the search engine

Corey Bryant
03-16-2005, 10:35 PM
Are you wanting something like SiteFerret (http://www.web-demos.co.uk/products/product.asp?pid=4) or even WebWiz Site Search (http://www.webwizguide.com/asp/sample_scripts/site_search_script.asp)?

insanelymacintosh
03-16-2005, 10:37 PM
Maybe http://www.mnogosearch.org/ it looks like it uses a SQL database for the backend. Don't know what lang.

Mike Bell
03-16-2005, 10:37 PM
Acutally was looking for something like a real search engine. Sounds like I'm going to have to build it myself though. Haven't really found much in the way of what I need. Thanks for the tips tho :)

Corey Bryant
03-16-2005, 10:39 PM
SiteFerret / WebWiz is a search engine only for your site. Or do you mean more like a directory to store links?

insanelymacintosh
03-16-2005, 10:48 PM
I think http://openfts.sourceforge.net/ will let you index pages that are from other sites and not just your own.