hosted by liquidweb


Go Back   Web Hosting Talk : Web Hosting Main Forums : Dedicated Server : What is my bottleneck for file hosting using this server? HDD or Port
Reply

Forum Jump

What is my bottleneck for file hosting using this server? HDD or Port

Reply Post New Thread In Dedicated Server Subscription
 
Send news tip View All Posts Thread Tools Search this Thread Display Modes
  #61  
Old
unghhh... Baaandwidth....
 
Join Date: Jan 2005
Posts: 9,334
I accidnetally duplicated sda1 and sda2 twice. One should be sda1 / sda2 and another should be sdb1 / sdb2

__________________
IOFLOOD.com -- Phoenix Dedicated Servers
Ask us about 144 GB Ram servers.
Email: sales [at] ioflood.com
Skype: funkywizard

Sponsored Links
  #62  
Old
Aspiring Evangelist
 
Join Date: Mar 2003
Posts: 352
Sorry for jumping in, assuming i am only serving a few numbers of files, and the total size of all files (100MB) fits well within the system Memory capacity (512MB).

Then could i assume that all file will be served from cache / Ram?
And therefore speed of Disk does not come into the equation?

Would CPU speed ever become a bottleneck? Let say i am only running on a Single Core Atom?

  #63  
Old
New Member
 
Join Date: Jul 2004
Posts: 4
Quote:
Originally Posted by ayksolutions View Post
I don't really have anything else to contribute to this thread since it has been so meticulously dissected by the posters. I just wanted to praise the people, especially Gabe, who contributed to this thread. It's truly helpful, not only for the OP, but for anyone else who reads this in the future. I hope more threads like this pop up on WHT instead of the usual bashing.
I concur; reading this thread was very informative. Thanks everyone for your contribution here.

Sponsored Links
  #64  
Old
Web Hosting Guru
 
Join Date: Dec 2007
Posts: 262
Hello, I am back here to get some of your expertise regarding a RAID 10 setup.

It was pointed out that stripe size of 2MB is recommended for a software RAID 10 and for Hardware RAID10 we should go with the maximum stripe size allowed by the controller.

I have an issue where I paid $$ for a HW raid controller which only support a max stripe size of 256K

What should I do in this case to get the best performance?
Should I cancel the Hardware RAID controller and go with software raid?

Thanks in advance.

  #65  
Old
unghhh... Baaandwidth....
 
Join Date: Jan 2005
Posts: 9,334
Quote:
Originally Posted by p2prockz View Post
Hello, I am back here to get some of your expertise regarding a RAID 10 setup.

It was pointed out that stripe size of 2MB is recommended for a software RAID 10 and for Hardware RAID10 we should go with the maximum stripe size allowed by the controller.

I have an issue where I paid $$ for a HW raid controller which only support a max stripe size of 256K

What should I do in this case to get the best performance?
Should I cancel the Hardware RAID controller and go with software raid?

Thanks in advance.
If you're primarily working with large files with sequential access, then definitely yes. For large numbers of simultaneous reads of large files, a 2MB stripe and a 512k readahead will provide at least 4x the performance of a 256k stripe.

__________________
IOFLOOD.com -- Phoenix Dedicated Servers
Ask us about 144 GB Ram servers.
Email: sales [at] ioflood.com
Skype: funkywizard

  #66  
Old
Web Hosting Guru
 
Join Date: Dec 2007
Posts: 262
Thanks a lot for the reply. Wish they had a thanks button for profiles.

  #67  
Old
unghhh... Baaandwidth....
 
Join Date: Jan 2005
Posts: 9,334
Glad to help : )

__________________
IOFLOOD.com -- Phoenix Dedicated Servers
Ask us about 144 GB Ram servers.
Email: sales [at] ioflood.com
Skype: funkywizard

  #68  
Old
Newbie
 
Join Date: Jul 2012
Location: Europe
Posts: 18
Wow, It depends on many things.. Its very hard for me to answer right away, I might get back to this one..

  #69  
Old
Web Hosting Guru
 
Join Date: Dec 2007
Posts: 262
RAID 10 resync

Hi All, Had setup software raid10 and I see the partition is re-syncing. Is resyncing done in the case of repairing the partition? or is it normal for it to run after the raid10 installation for the first time?



Code:
[root@server ~]# cat /proc/mdstat
Personalities : [raid10] [raid1]
md0 : active raid1 sda1[0] sdc1[2] sdd1[3] sdb1[1]
      487360 blocks [4/4] [UUUU]

md2 : active raid10 sdc3[2] sda3[0] sdb3[1] sdd3[3]
      5843927040 blocks super 1.2 2048K chunks 2 near-copies [4/4] [UUUU]
      [===>.................]  resync = 15.3% (896459072/5843927040) finish=74870.8min speed=1100K/sec

md1 : active raid10 sdc2[2] sda2[0] sdb2[1] sdd2[3]
      15621120 blocks super 1.1 512K chunks 2 near-copies [4/4] [UUUU]

unused devices: <none>
What kind of commands can I use to get the status related to RAID10? Can I get information directly from the HW controller? I am very new to RAID so any reading material would be helpful.

Thanks.

  #70  
Old
Web Hosting Guru
 
Join Date: Dec 2007
Posts: 262
Quote:
Originally Posted by funkywizard View Post
Maybe, but there really isn't a whole lot to it:

1) If using software raid 10, make sure the raid stripe is 2MB
2) If using hardware raid 10, make sure the raid stripe is as large as the raid controller will allow
3) Set the linux readahead to 1/4 of the raid stripe (if using raid 10), or to 512k (if using raid 1 or no raid at all)
4) Disable "atimes" in /etc/fstab
5) All else being equal, more ram, more hard drives, or faster rpm drives, are better than less ram, fewer hard drives, or slower rpm drives

Hello again,

Just wondering would it be beneficial to set a stripe size even larger than 2MB? For example, since we have files larger than 100Mb can we set the strip size to let's say 4MB or 8MB?

Thanks.

  #71  
Old
unghhh... Baaandwidth....
 
Join Date: Jan 2005
Posts: 9,334
Quote:
Originally Posted by p2prockz View Post
Hello again,

Just wondering would it be beneficial to set a stripe size even larger than 2MB? For example, since we have files larger than 100Mb can we set the strip size to let's say 4MB or 8MB?

Thanks.
There is no additional performance benefit when you use a readahead larger than 512KB, and in fact you can lose performance in some cases because you'll have to read the same data more than once if your readaheads are taking up too much ram. With a 2MB stripe and a 512k readahead, approximately 25% of your read requests will cross a stripe boundary, so 75% of the time, one read request causes one disk i/o on one drive, and 25% of the time you'll get one disk i/o on each of two drives. A 4mb stripe should drop this to 12.5%. So for 10 reads, instead of 12.5 i/o requests, you'd have 11.25 i/o requests. So potentially a 4MB stripe might be a little faster in this use pattern than a 2MB stripe, but it's a pretty small difference and there might be negative performance from having the stripe be too large, so I'd say 2MB is a safe bet. You could use 4MB if you want, I would expect that to be fine too, but I haven't tested that. Anything above 4MB when you have a 512k readahead won't do much for you. A readahead above 512k won't do much for you either.

__________________
IOFLOOD.com -- Phoenix Dedicated Servers
Ask us about 144 GB Ram servers.
Email: sales [at] ioflood.com
Skype: funkywizard

  #72  
Old
Web Hosting Guru
 
Join Date: Dec 2007
Posts: 262
Thank you again!

Reply

Similar Threads
Thread Thread Starter Forum Replies Last Post
Cant change ftp port, chkserv.d/ftpd file always back using original file basketmen Hosting Security and Technology 2 02-24-2012 12:04 AM
Need a Dedicated Server: 2x Quad Core, 12-16GB RAM, 3TB+ HDD, 1Gbps Port, 20TB+ BW aliitp Dedicated Server 21 08-27-2010 07:36 PM
Managed Server 10mbits-port,20mbits-port,50mbits-port,100mbits-port Unmetered Servainet Dedicated Hosting Offers 0 11-22-2008 07:38 AM
Dual 1GHZ P3 1GB Memory 40GB HDD CentOS/Ubuntu Server 100MBIT Port seasideintl Dedicated Hosting Offers 3 04-04-2008 05:08 PM
Server suddenly Bottleneck spikeyspy Dedicated Server 2 12-29-2004 01:53 PM

Related posts from TheWhir.com
Title Type Date Posted
Spammers Prompt Users to Download Malware Disguised as Heartbleed Bug Removal Tool Web Hosting News 2014-06-03 12:01:37
Dropbox Suffers Temporary Outage Impacting File Sharing and Synchronizing Web Hosting News 2014-03-14 12:11:46
AeroFS Launches Private File Sharing Software Web Hosting News 2013-11-22 17:00:53
Egnyte Launches Program to PRISM-Proof Enterprise Cloud File-sharing Web Hosting News 2013-09-27 13:45:48
Gladinet Launches Cloud Enterprise Service to Access SAN as a Private Cloud Web Hosting News 2013-03-28 14:19:44


Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes
Postbit Selector

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Forum Jump
Login:
Log in with your username and password
Username:
Password:



Forgot Password?
WHT Host Brief Email:

We respect your privacy. We will never sell, rent, or give away your address to any outside party, ever.

Advertisement:
Web Hosting News:
WHT Membership
WHT Membership



 

X

Welcome to WebHostingTalk.com

Create your username to jump into the discussion!

WebHostingTalk.com is the largest, most influentual web hosting community on the Internet. Join us by filling in the form below.


(4 digit year)

Already a member?