Web Hosting Talk







View Full Version : Which language/technology for this task?


Steveoak
02-01-2008, 01:48 PM
First post here by the way. If I'm looking to have my site pull a string of numbers from another site and graph the results on a weekly basis, can you suggest what language/technology is easiest to do this in or with?

Codebird
02-01-2008, 06:56 PM
depends on where from on the other site?

case
02-01-2008, 07:55 PM
Site scrapping... Perl, should be simple with LWP::UserAgent and or WWW::Mechanize. Plenty of articles online that document the process too!

Steveoak
02-01-2008, 08:52 PM
Site scrapping... Perl, should be simple with LWP::UserAgent and or WWW::Mechanize. Plenty of articles online that document the process too!

Great. Thanks for giving me some leads to go with. Appreciate it. I'm sure I'll be back with more questions once I brief up on the articles.

Adam-AEC
02-02-2008, 08:03 PM
Another option would be Ruby, hpricot, and Gruff Graphs.

Renard Fin
02-04-2008, 11:21 AM
PHP with JpGraph (http://www.aditus.nu/jpgraph/) is good too, or Artichow (http://www.artichow.org/).

HTTPbit
02-04-2008, 01:32 PM
PHP with JpGraph (http://www.aditus.nu/jpgraph/) is good too, or Artichow (http://www.artichow.org/).

I also recommend PHP. :)

juangake
02-06-2008, 10:52 AM
See
http://en.wikipedia.org/wiki/Screen_scraping

Tim Greer
02-06-2008, 04:36 PM
You can use any language out there to accomplish this and many other tasks. It's really about preference and what one's you know best. You can use Perl, PHP, Python, Ruby, C, C++, shell scripts (sh, ksh, etc.), and so on.

jobarjo
02-09-2008, 05:21 PM
PYTHON POWER!!!
Very powerful, simple, productive, etc...
you can use matplotlib to make amazing graphs, and several other libs to make web slurping...

As said, most languages do the jobs

wdr1
02-11-2008, 03:44 AM
It should be easy to do in Perl, with LWP::Simple & HTML::TreeBuilder.

Then again, is the data you want to pull in a table? The Windows version of Excel has a pretty nice feature that let's your grab external web data. From there you can use whatever other features you want (e.g., pivot tables, charts, etc.).

-Bill

QiSoftware
02-11-2008, 02:01 PM
I often develop tools that use server side Java to pull data [including xml] from other sites. It is fast, however you must have a web host that supports server side Java.

Q...

vpsville
02-13-2008, 05:09 PM
PHP (or a C++ cgi) using the CURL library will turn any web page into a file you can parse and do whatever with.

PHP has some built in graphing functions as well.

That said, you can use just about any language to do this. If your roots are C/C++ PHP is probably easiest, but thats just an opinion which is worth the paper its written on ;)

arkin
02-14-2008, 04:41 PM
I also recommend PHP. :)

I also recommend PHP. :)

Tim Greer
02-14-2008, 04:49 PM
I also recommend PHP. :)

I also recommend Perl. :)

Or PHP

Or a dozen other languages.