Results 1 to 7 of 7
  1. #1
    Join Date
    Jan 2005
    Location
    England
    Posts
    69

    Calling all PHP programmers (Bot needed)

    Hello anyone who is reading this thread, do you have experience with coding web crawler bots?

    I am looking for a bot which will crawl certain websites and then save the content into a database. (MYSQL). A search query will then be used to search for certain keywords/information in the database.

    Please send me a private message

    Thank You

  2. #2
    Join Date
    Dec 2006
    Location
    Halifax, NS, Canada
    Posts
    1
    Replying because it wont let me PM you (I thought I needed 5 posts to use the PM system? apparently not)

    Anyway, I write webcrawling bots all the time. I've created bots to download all the images on a particular site, to pull the artist and track information for music albums from amazon.com, to grab all the email addresses from a particular site, etc. I can do it in PHP, Perl and/or Java, whichever you would prefer. If you get this and are interested, please leave a reply

  3. #3
    Join Date
    Jan 2005
    Location
    England
    Posts
    69
    Hello m4trix, i believe that you need 10 posts to use the PM system on WHT.

    Here is some information

    Hello, thank you for your reply.

    The information that i will need to crawl is academic which students will use to search through.

    An example of some of the database sites include:

    http://www.sciencedirect.com/
    http://scitation.aip.org/
    http://www.britannica.com/

    Basically someone will come on my website type in a search like 'sociology' and it will search the database with all the files with sociology on it. The searches will then be displayed and then the user can click on the search and it will take them to the website with the article/etc on.

    Sorry if this sounds confusing, but i am in abit of a rush.

    Hope to hear from you

    Aaron Luckie

  4. #4
    Join Date
    Dec 2006
    Location
    Halifax, NS, Canada
    Posts
    1
    I got your PM (apparently mine is working fine now), anyway unfortunately I could not reply: "Aaron Luckie has exceeded their stored private messages quota and can not accept further messages until they clear some space."

    So I sent my reply as an email instead. Hopefully you received it

  5. #5
    Join Date
    Aug 2006
    Location
    usa
    Posts
    19
    It wont let me PM you, so my thought is this, i might be willing to chip in on this bot tool, because I am looking for a tool to rip articles and content from sites, so they can be read offline.

  6. #6
    Join Date
    Jan 2005
    Location
    England
    Posts
    69
    I have replyed to your email m4trix

  7. #7
    Join Date
    Jan 2005
    Location
    England
    Posts
    69
    I am looking for some more quotes and interested programmers.

    Thank you

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •