For everyone who asked !
http://www.namx.co.uk/webgrab.tar.gz
A few notes about this:
These scripts are designed to be exexcute in the shell.
They are not intended for execution on webservers thru apache , but could be adapted easily.
You will need to edit at least grab.php, and set the correct path or URL in the line starting: $url=
You will see 2 example entries comment.
You will need a mysql database connect in a file called db.php,
Heres the contents of db.php
<?
// db connection details
////////////////////////
//error_reporting(0);
$db_server = "YOURMYSQLSERVERNAME.com";
$db_user = "YOURMYSQLUSER";
$db_pass = "YOURMYSQLPASS";
$database = "YOURMYSQLDB";
// connect to our db
/////////////////////
if (!($mysql_link = mysql_connect("$db_server", "$db_user", "$db_pass")))
{
// change this print to a syslog eventually !
print ("Could not use $database database, exiting");
exit;
}
if (!(mysql_select_db("$database", $mysql_link)))
{
// change this print to a syslog eventually !
print ("No Mysql service available, exiting");
exit;
}
?>
and a table within the db called websites.
Here is an sql statement to do that ,assuming you have a db already
CREATE TABLE websites (
primary_domain varchar(128) NOT NULL default '',
transfer_used float NOT NULL default '0',
UNIQUE KEY primary_domain (primary_domain)
) TYPE=MyISAM;
Good luck - icq 81854162 if you need help
Linear Mode
