hosted by liquidweb


Go Back   Web Hosting Talk : Web Hosting Main Forums : Web Hosting : Web Host posting false benchmarks - hostcritiq - simplehelix
Closed Thread

Forum Jump

Web Host posting false benchmarks - hostcritiq - simplehelix

Closed Thread Post New Thread In Web Hosting Subscription
 
Send news tip View All Posts Thread Tools Search this Thread Display Modes
  #1  
Old
Away
 
Join Date: Jun 2002
Posts: 5,278

Web Host posting false benchmarks - hostcritiq - simplehelix


So i came across this article the other day:

http://www.hostcritiq.com/2008/01/04...y-december-07/
also
http://www.hostcritiq.com/2008/01/11/speed-wars/

I found it quite interesting that simplehelix beat medialayer considering their reputation for outperforming all other hosts. So I decided to do a bit of research and noticed that both simplehelix/hostcritiq are hosted right next to each other:

traceroute www.hostcritiq.com
traceroute to www.hostcritiq.com (64.69.46.188), 30 hops max, 46 byte packets
2 v13.dsr1.lga6.us.voxel.net (208.122.5.45) 0.570 ms 0.276 ms *
3 0.te6-3.tsr1.lga3.us.voxel.net (208.122.5.229) 0.580 ms 0.274 ms 1.265 ms
4 tsic-1.lga3.us.voxel.net (213.248.95.45) 0.284 ms 0.271 ms *
5 nyk-bb1-pos7-2-0.telia.net (213.248.82.13) 0.659 ms 0.301 ms 0.285 ms
6 las-bb1-link.telia.net (80.91.254.17) 79.062 ms 79.039 ms 78.984 ms
7 vl341ge1-7.cr01.lax02.mzima.net (213.248.94.34) 75.966 ms 76.676 ms 76.182 ms
8 xe2-1.cr01.lax02.mzima.net (216.193.255.185) 76.456 ms 80.821 ms 76.078 ms
9 ge0-calpop.cust.lax02.mzima.net (72.37.172.90) 141.125 ms 92.617 ms 107.474 ms

# traceroute www.simplehelix.com
traceroute to www.simplehelix.com (64.69.44.249), 30 hops max, 46 byte packets
2 v13.dsr1.lga6.us.voxel.net (208.122.5.45) 5.382 ms 12.353 ms 18.321 ms
3 * 0.te6-3.tsr1.lga3.us.voxel.net (208.122.5.229) 0.948 ms 1.429 ms
4 tsic-1.lga3.us.voxel.net (213.248.95.45) 0.514 ms 0.475 ms 0.753 ms
5 * nyk-bb1-link.telia.net (213.248.83.225) 2.001 ms nyk-bb1-link.telia.net (80.91.250.162) 0.694 ms
6 las-bb1-link.telia.net (80.91.254.17) 79.015 ms 79.475 ms 79.064 ms
7 vl341ge1-7.cr01.lax02.mzima.net (213.248.94.34) 81.059 ms 83.871 ms 76.591 ms
8 xe2-1.cr01.lax02.mzima.net (216.193.255.185) 85.158 ms 88.276 ms 76.417 ms
9 ge0-calpop.cust.lax02.mzima.net (72.37.172.90) 76.066 ms 75.796 ms 76.048 ms

But that isn't enough proof so I started doing a google and noticed that the person Jae Lae went under the psydunom lkbryant and jv0704:

Here is a jv0704 claiming hostcritiq:
http://www.spicypage.com/search.cfm?...rofile_id=7309
and here is lkbryant showing that he is actually jv0704
http://www.directadmin.com/forum/arc...p/t-19678.html

Notice this page:
http://phpa-bender.phparch.com/discu...1f0419ae2c2e/\
His name is Jae, do a search on simplhelix.com and:
Admin Name........... Jae Lee
Admin Address........ 432 s. gramercy dr.
Admin Address........
Admin Address........ Los Angeles
Admin Address........ 90019
Admin Address........ CA
Admin Address........ UNITED STATES
Admin Email.......... simpletechmedia@yahoo.com
Admin Phone.......... +1.3237332598

Even better:
http://www.cost.com/forum/index.php?...=profile;u=212
Look at the email, simplehelix@gmail.com

More proof:
http://www.digg.com/tech_news/Hostin...r_vs_Dreamhost
http://www.webhostingtalk.com/showthread.php?p=4883458

Anyway, I just wanted to give warning so that no one trusted hostcritiq or simplehelix.


Last edited by RossH; 01-12-2008 at 03:46 AM.


Sponsored Links
  #2  
Old
Away
 
Join Date: Jun 2002
Posts: 5,278
Just a further post for a little bit more proof:

whois magentohost.com
Registrant:
JVMedia
933 s. gramercy dr
Los Angeles, California 90019
United States

Registered through: GoDaddy.com, Inc. (http://www.godaddy.com)
Domain Name: MAGENTOHOST.COM
Created on: 18-Aug-07
Expires on: 18-Aug-08
Last Updated on: 09-Nov-07

Administrative Contact:
Lee, Jae jv0704@hotmail.com
JVMedia
933 s. gramercy dr
Los Angeles, California 90019
United States
(818) 242-2500 Fax --

Technical Contact:
Lee, Jae jv0704@hotmail.com
JVMedia
933 s. gramercy dr
Los Angeles, California 90019
United States
(818) 242-2500 Fax --

Domain servers in listed order:
NS43.DOMAINCONTROL.COM
NS44.DOMAINCONTROL.COM

  #3  
Old
Performance Specialist
 
Join Date: Dec 2004
Location: New York, NY
Posts: 10,508
And they've got their own "response" to this already:

http://www.hostcritiq.com/2008/01/12...is-hostcritiq/

What I'm really interested in knowing is how these benchmarks are being performed. If it's their own server where they're "hosting" these ab (Apache Benchmark) tests, then clearly their own server is going to be much less latent in responding to requests. For servers far away, latency is going to be a huge factor.

It is clear that there is some kind of agenda behind these benchmarks, given that Jae Lee posted here recommending simplehelix for Magento hosting (in a thread that was discussing PHP 5 hosting) - this was the user's (jv0704) first post and it appears it has been removed by the mods.

__________________
MediaLayer, LLC - www.medialayer.com Lightning fast web hosting since 2005.
The pioneers of optimized web hosting, featuring LiteSpeed Web Server & SSD Storage
Learn how we can make your website load faster, translating to better conversion rates for your business!


Last edited by layer0; 01-12-2008 at 11:39 AM.
Sponsored Links
  #4  
Old
Newbie
 
Join Date: Jan 2008
Posts: 12
Hello,

Nice to meet you all. =)

I just have one complaint.

Could you guys please know the facts before saying something?

If you guys didn't know(such as how many servers the test been run on, where the test is being performed, etc..), all you had to do was ask before posting something like this?

  #5  
Old
Performance Specialist
 
Join Date: Dec 2004
Location: New York, NY
Posts: 10,508
Quote:
Originally Posted by hostcritiq View Post
Hello,

Nice to meet you all. =)

I just have one complaint.

Could you guys please know the facts before saying something?

If you guys didn't know(such as how many servers the test been run on, where the test is being performed, etc..), all you had to do was ask before posting something like this?
It doesn't matter. It's near impossible for this to be accurate, due to the nature of the test. Past even that point, do you honestly expect someone to believe your results, given that you're using them to portray your own company as superior, and originally did this under disguise?

Perhaps you could answer why you had disguised HostCritiq as an independent party originally? Or, maybe you could answer why you signed up as jv0704 and promoted your own company?

It may do you good to read the rules:

http://www.webhostingtalk.com/rules.php

By the way, you've already broken the rules by signing up for a second account.

__________________
MediaLayer, LLC - www.medialayer.com Lightning fast web hosting since 2005.
The pioneers of optimized web hosting, featuring LiteSpeed Web Server & SSD Storage
Learn how we can make your website load faster, translating to better conversion rates for your business!


Last edited by layer0; 01-12-2008 at 04:41 PM.
  #6  
Old
Aspiring Evangelist
 
Join Date: Aug 2003
Posts: 373
Well, at least he didn't make a blog post benchmarking the honesty of hosts. My guess is that simple helix wouldn't have faired too well in that test

  #7  
Old
Performance Specialist
 
Join Date: Dec 2004
Location: New York, NY
Posts: 10,508
Jae Lee/hostcritiq,

One thing you conveniently didn't notice is that in your latest benchmark your own instance of Magento is showing 92 failed requests while the benchmark against the instance hosted by us is showing 0 failed requests.

Perhaps there's greater issues than speed you should be worrying about?

Attached screenshots.

Basically, yes, your tests are inaccurate. End of.
Attached Thumbnails
medialayer-completed-requests.gif   simplehelix-failed-requests.gif  

__________________
MediaLayer, LLC - www.medialayer.com Lightning fast web hosting since 2005.
The pioneers of optimized web hosting, featuring LiteSpeed Web Server & SSD Storage
Learn how we can make your website load faster, translating to better conversion rates for your business!

  #8  
Old
-=*/E=-
 
Join Date: Sep 2005
Location: In canada
Posts: 3,211
Sorry what is this again and who actually reads such blogs ? Who has the time ?

  #9  
Old
Performance Specialist
 
Join Date: Dec 2004
Location: New York, NY
Posts: 10,508
Quote:
Originally Posted by Energizer Bunny View Post
Sorry what is this again and who actually reads such blogs ? Who has the time ?
Perhaps if it associated your company with negative implication (based on invalid tests) you'd be worried about it as well.

__________________
MediaLayer, LLC - www.medialayer.com Lightning fast web hosting since 2005.
The pioneers of optimized web hosting, featuring LiteSpeed Web Server & SSD Storage
Learn how we can make your website load faster, translating to better conversion rates for your business!

  #10  
Old
Community Liaison
 
Join Date: May 2006
Location: EU & USA
Posts: 3,678
Quote:
Originally Posted by layer0 View Post
Jae Lee/hostcritiq,

One thing you conveniently didn't notice is that in your latest benchmark your own instance of Magento is showing 92 failed requests while the benchmark against the instance hosted by us is showing 0 failed requests.

Perhaps there's greater issues than speed you should be worrying about?

Attached screenshots.

Basically, yes, your tests are inaccurate. End of.
Auch..

Layer0 i wouldn't worry to much about this everyone knows that you run a good operation, and like everyone have their good and bad times, but how you handle it is what makes the difference.

__________________
cPanel Servers in Europe (Strasbourg, Amsterdam & London), USA (Dallas, St.Louis), Asia (Singapore) | Follow us at Twitter: @040hosting
| Shared | Reseller | (managed) Dedicated Hosting | 040Hosting (Registered company #17093425 KVK Eindhoven, The Netherlands)


  #11  
Old
Performance Specialist
 
Join Date: Dec 2004
Location: New York, NY
Posts: 10,508
Quote:
Originally Posted by 040Hosting View Post
Auch..

Layer0 i wouldn't worry to much about this everyone knows that you run a good operation, and like everyone have their good and bad times, but how you handle it is what makes the difference.
Thank you for your comments.

What I'm more concerned about is the fact that Jae Lee is providing misleading information to hosting consumers regarding not only us but many other providers. We're not alone in this by any means and there were companies who faired far worse.

__________________
MediaLayer, LLC - www.medialayer.com Lightning fast web hosting since 2005.
The pioneers of optimized web hosting, featuring LiteSpeed Web Server & SSD Storage
Learn how we can make your website load faster, translating to better conversion rates for your business!

  #12  
Old
-=*/E=-
 
Join Date: Sep 2005
Location: In canada
Posts: 3,211
Quote:
Originally Posted by layer0 View Post
Perhaps if it associated your company with negative implication (based on invalid tests) you'd be worried about it as well.
Yes but how many potential customers you think actually will spend time reading such blogs ? From what i know most just read few reviews and signup and some do not even know about reviews but still signup, and reading and trying to understand benchmarking i feel is out of most customers league, unless they are web hosting owners looking for servers. Cause i remember when i started doing websites, i would just signup with most cost effective place and not bother reading reviews.
I am sure most wanabee webmasters will not actually spend hours reading about benchmarks when customer reviews for that company already exists.

Oh and if someone provides misleading information does not matter if they are writing good or bad, its still a form of fraud i would consider.

  #13  
Old
Community Liaison
 
Join Date: May 2006
Location: EU & USA
Posts: 3,678
Quote:
Originally Posted by layer0 View Post
Thank you for your comments.

What I'm more concerned about is the fact that Jae Lee is providing misleading information to hosting consumers regarding not only us but many other providers. We're not alone in this by any means and there were companies who faired far worse.
Yes I understand that, i would not be happy either, but this post would wake some people up, at least they are warned.

Keep up the good work.

__________________
cPanel Servers in Europe (Strasbourg, Amsterdam & London), USA (Dallas, St.Louis), Asia (Singapore) | Follow us at Twitter: @040hosting
| Shared | Reseller | (managed) Dedicated Hosting | 040Hosting (Registered company #17093425 KVK Eindhoven, The Netherlands)


  #14  
Old
Performance Specialist
 
Join Date: Dec 2004
Location: New York, NY
Posts: 10,508
Quote:
Originally Posted by Energizer Bunny View Post
Yes but how many potential customers you think actually will spend time reading such blogs ? From what i know most just read few reviews and signup and some do not even know about reviews but still signup, and reading and trying to understand benchmarking i feel is out of most customers league, unless they are web hosting owners looking for servers. Cause i remember when i started doing websites, i would just signup with most cost effective place and not bother reading reviews.
I am sure most wanabee webmasters will not actually spend hours reading about benchmarks when customer reviews for that company already exists.

Oh and if someone provides misleading information does not matter if they are writing good or bad, its still a form of fraud i would consider.
In the end, it really boils down to there being many different types of consumers, those who read and understand these benchmarks, those who don't care, and some who are in between.

That said, what Jae Lee is doing here is quite wrong. Besides the results being invalid he originally did this in a disguised manner to promote his own company (acting as if he is an independent party).

__________________
MediaLayer, LLC - www.medialayer.com Lightning fast web hosting since 2005.
The pioneers of optimized web hosting, featuring LiteSpeed Web Server & SSD Storage
Learn how we can make your website load faster, translating to better conversion rates for your business!

  #15  
Old
Web Hosting Master
 
Join Date: Apr 2006
Location: Phoenix, AZ, USA
Posts: 714
As Layer0 has pointed out, he's not the only company being unfairly benchmarked. Crucial is included in these benchmarks with some very unbecoming comments and results.

The benchmark results are worthless.

From how to benchmark a web server,

First, benchmarking a web server is not an easy thing. To benchmark a web server the time it will take to give a page is not important: you don’t care if a user can have his page in 0.1 ms or in 0.05 ms as nobody can have such delays on the Internet.

What is important is the average time it will take when you have a maximum number of users on your site simultaneously. Another important thing is how much more time it will take when there are 2 times more users: a server that take 2 times more for 2 times more users is better than another that take 4 times more for the same amount of users.

Here are few tips to carry out procedure along with an example:

Procedures
  • You need to use same hardware configuration and kernel (OS) for all tests
  • You need to use same network configuration. For example, use 100Mbps port for all tests
  • First record server load using top or uptime command
  • Take at least 3-5 readings and use the best result
  • After each test reboot the server and carry out test on next configuration (web server)
  • Again record server load using top or uptime command
  • Carry on test using static html/php files and dynamic pages
  • It also important to carry out test using the Non-KeepAlive and KeepAlive (the Keep-Alive extension to provide long-lived HTTP sessions, which allow multiple requests to be sent over the same TCP connection) features
  • Also don’t forget to carry out test using fast-cgi and/or perl tests
It's clear that you can run ab testing and come up with any results you would like, depending on when you 'decide' to run the test.

Way to many variables here for anyone to really take you seriously.

Good day

__________________
CrucialWebHost.com - Performance Hosting Solutions:
SamsClub.com - Crumbs.com - JoanneHudson.com - Walmart.com - GameStop.com (NEW!)

Check out our Site Showcase for more big brand examples!

Closed Thread

Related posts from TheWhir.com
Title Type Date Posted
Introducing .HOST: The Exciting New gTLD for the Global Hosting Community Webinars 2014-10-03 10:41:09
Shoot For Savings! Find Out How HP.com Handles 300M Hits Per Day With HP Moonshot Webinars 2014-06-13 10:12:06
Mirantis Sets New OpenStack Benchmark with 75,000 Live Virtual Machines Web Hosting News 2014-05-01 08:25:29
Host Alive Listing 2014-10-21 04:45:24
Host Europe Acquires Telefonica Germany Online Services Web Hosting News 2013-09-13 15:27:43


Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes
Postbit Selector

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Forum Jump
Login:
Log in with your username and password
Username:
Password:



Forgot Password?
WHT Host Brief Email:

We respect your privacy. We will never sell, rent, or give away your address to any outside party, ever.

Advertisement:
Web Hosting News:
WHT Membership
WHT Membership



 

X

Welcome to WebHostingTalk.com

Create your username to jump into the discussion!

WebHostingTalk.com is the largest, most influentual web hosting community on the Internet. Join us by filling in the form below.


(4 digit year)

Already a member?