Steveoak
02-01-2008, 01:48 PM
First post here by the way. If I'm looking to have my site pull a string of numbers from another site and graph the results on a weekly basis, can you suggest what language/technology is easiest to do this in or with?
![]() | View Full Version : Which language/technology for this task? Steveoak 02-01-2008, 01:48 PM First post here by the way. If I'm looking to have my site pull a string of numbers from another site and graph the results on a weekly basis, can you suggest what language/technology is easiest to do this in or with? Codebird 02-01-2008, 06:56 PM depends on where from on the other site? case 02-01-2008, 07:55 PM Site scrapping... Perl, should be simple with LWP::UserAgent and or WWW::Mechanize. Plenty of articles online that document the process too! Steveoak 02-01-2008, 08:52 PM Site scrapping... Perl, should be simple with LWP::UserAgent and or WWW::Mechanize. Plenty of articles online that document the process too! Great. Thanks for giving me some leads to go with. Appreciate it. I'm sure I'll be back with more questions once I brief up on the articles. Adam-AEC 02-02-2008, 08:03 PM Another option would be Ruby, hpricot, and Gruff Graphs. Renard Fin 02-04-2008, 11:21 AM PHP with JpGraph (http://www.aditus.nu/jpgraph/) is good too, or Artichow (http://www.artichow.org/). HTTPbit 02-04-2008, 01:32 PM PHP with JpGraph (http://www.aditus.nu/jpgraph/) is good too, or Artichow (http://www.artichow.org/). I also recommend PHP. :) juangake 02-06-2008, 10:52 AM See http://en.wikipedia.org/wiki/Screen_scraping Tim Greer 02-06-2008, 04:36 PM You can use any language out there to accomplish this and many other tasks. It's really about preference and what one's you know best. You can use Perl, PHP, Python, Ruby, C, C++, shell scripts (sh, ksh, etc.), and so on. jobarjo 02-09-2008, 05:21 PM PYTHON POWER!!! Very powerful, simple, productive, etc... you can use matplotlib to make amazing graphs, and several other libs to make web slurping... As said, most languages do the jobs wdr1 02-11-2008, 03:44 AM It should be easy to do in Perl, with LWP::Simple & HTML::TreeBuilder. Then again, is the data you want to pull in a table? The Windows version of Excel has a pretty nice feature that let's your grab external web data. From there you can use whatever other features you want (e.g., pivot tables, charts, etc.). -Bill QiSoftware 02-11-2008, 02:01 PM I often develop tools that use server side Java to pull data [including xml] from other sites. It is fast, however you must have a web host that supports server side Java. Q... vpsville 02-13-2008, 05:09 PM PHP (or a C++ cgi) using the CURL library will turn any web page into a file you can parse and do whatever with. PHP has some built in graphing functions as well. That said, you can use just about any language to do this. If your roots are C/C++ PHP is probably easiest, but thats just an opinion which is worth the paper its written on ;) arkin 02-14-2008, 04:41 PM I also recommend PHP. :) I also recommend PHP. :) Tim Greer 02-14-2008, 04:49 PM I also recommend PHP. :) I also recommend Perl. :) Or PHP Or a dozen other languages. |