Results 1 to 22 of 22
Thread: raid for file hosting business
-
10-13-2008, 10:29 AM #1Junior Guru Wannabe
- Join Date
- May 2008
- Posts
- 54
raid for file hosting business
Can any one please suggest which raid level is best for a file hosting site?
And please give some suggestions for this kind of site?
Thanks in advance.
-
10-13-2008, 10:31 AM #2Junior Guru Wannabe
- Join Date
- Mar 2004
- Location
- Belgium
- Posts
- 81
RAID 1 or 10 is probably the best in terms of performance and what I consider recoverability. How much data are you looking at and how many disks?
-
10-13-2008, 10:32 AM #3Junior Guru Wannabe
- Join Date
- May 2008
- Posts
- 54
3 drives and around 1 tb
-
10-13-2008, 10:33 AM #4Web Hosting Evangelist
- Join Date
- Mar 2003
- Location
- Kansas City, Missouri
- Posts
- 462
Hello,
It greatly depends on your load. Just because it is a file hosting site does not mean that you are experiencing great load. RAID-10 would probably be best but it depends on the nature of the I/O. What kind of files? Any additional processing of the files?
Thanks!=> • Admo.net Managed Hosting •
=> Managed Hosting • Dedicated Servers • Colocation
=> Dark Fiber Access to 1102 Grand, Multiple Public Providers
=> Over •Sixteen• Years of Service
-
10-13-2008, 10:39 AM #5Junior Guru Wannabe
- Join Date
- May 2008
- Posts
- 54
No additional process,Just normal file host like rapidshare.First i want start with some high end spec server with less space and after that i will be addding drives and some more servers to it.Is my idea bad?
-
10-13-2008, 10:42 AM #6Web Hosting Evangelist
- Join Date
- Mar 2003
- Location
- Kansas City, Missouri
- Posts
- 462
That's not a bad idea. I would plan for capacity too. I would start out with a 4 disk RAID-10 set with SATA disks. Usually for simple read/writes you will not need much speed ... RAID-10 will help for speed on SATA disks and provide fault tolerance. Remember that RAID-10 is N-2 capacity so if you have 4-1TB disks you will have 2TB unformatted space.
Thanks!=> • Admo.net Managed Hosting •
=> Managed Hosting • Dedicated Servers • Colocation
=> Dark Fiber Access to 1102 Grand, Multiple Public Providers
=> Over •Sixteen• Years of Service
-
10-13-2008, 10:48 AM #7Junior Guru Wannabe
- Join Date
- May 2008
- Posts
- 54
thanks admonet,can u please suggest server specs to start with.I am expecting big growth.coz,i have some good and different business plan.
-
10-13-2008, 10:55 AM #8Junior Guru Wannabe
- Join Date
- Mar 2004
- Location
- Belgium
- Posts
- 81
I already suggested a hardware setup in a previous post about fileservers, so I'm going to copy paste here:
If you're going to use 3.5" disks, use this system:
Chassis: http://www.supermicro.com/products/c...26TQ-R800U.cfm (Redundant PSU, space for 12 SAS 3.5" disks, Supermicro UIO)
Motherboard: http://www.supermicro.com/products/m...5100/X7DCU.cfm
You'll need an UIO SAS controller for that, for example: http://www.supermicro.com/products/a...-USAS-H8iR.cfm
You'll need 2 of those, as they only have 8 SAS connectors each.
If you're going to use 2.5" disks (better performance, uses less energy, but way more expensive), get this chassis instead:
http://www.supermicro.com/products/c...213A-R900U.cfm
Make sure you also purchase the matching UIO riser card.
Why did I choose the X7DCU board with only 1333 Mhz FSB? Because that uses regular DDR2 memory instead of FB-DIMM: cheaper, less heat and less power usage.
I'd recommend a RAID 10 setup. I'd prefer using linux software RAID but the supermicro controllers I suggested above are hardware RAID controllers (with battery backed cache). Here's a controller without RAID: http://www.supermicro.com/products/a...C-USAS-L8i.cfm. Be generous with RAM, even ECC memory is very cheap these days, so you can take full advantage of linux's caching algorithms.Last edited by RedShift; 10-13-2008 at 11:01 AM. Reason: Corrected links
-
10-13-2008, 11:00 AM #9Junior Guru Wannabe
- Join Date
- May 2008
- Posts
- 54
thanx redshift,
The links are not working.
-
10-13-2008, 11:02 AM #10Junior Guru Wannabe
- Join Date
- Mar 2004
- Location
- Belgium
- Posts
- 81
-
10-13-2008, 11:26 AM #11Retired Moderator
- Join Date
- May 2004
- Location
- Toronto, Canada
- Posts
- 5,105
I believe that Raid 5 is more than sufficient. It affords the ability to lose a drive and have the array still functioning. Fileshare sites do not need the type of reads that a DB server needs. The quick answer to any Raid question is Raid 10 because you can never be "wrong" given its redundancy and performance but in terms of cost I really think that raid 5 is a perfectly good choice.
In other words, if you can afford it, go for Raid 10. IMHO it isn't needed but why not if you can afford it.CloudNexus Technology Services
Managed Services
-
10-13-2008, 12:23 PM #12Junior Guru Wannabe
- Join Date
- May 2008
- Posts
- 54
Thanks coolraul,How many drives enough for raid 5?can u explain about raid 5.
-
10-13-2008, 12:52 PM #13Junior Guru Wannabe
- Join Date
- Mar 2004
- Location
- Belgium
- Posts
- 81
RAID 5 is striping using parity. You need at least 3 disks for RAID 5 to work and when using 3 disks it can survive the failure of 1 disk. You can find more information on the different forms of RAID on wikipedia, http://en.wikipedia.org/wiki/RAID.
-
10-13-2008, 03:53 PM #14Junior Guru Wannabe
- Join Date
- May 2008
- Posts
- 54
If i have 3 500gb diks,how much i can use for storage? And how much for recovery(i mean for raid 5 implementation)
-
10-13-2008, 03:54 PM #15Web Hosting Evangelist
- Join Date
- Mar 2003
- Location
- Kansas City, Missouri
- Posts
- 462
Pvakr,
RAID-5 is N-1 usable storage. So 3-500GB disks would yield 1TB unformatted space.
Adam=> • Admo.net Managed Hosting •
=> Managed Hosting • Dedicated Servers • Colocation
=> Dark Fiber Access to 1102 Grand, Multiple Public Providers
=> Over •Sixteen• Years of Service
-
10-13-2008, 04:01 PM #16Junior Guru Wannabe
- Join Date
- May 2008
- Posts
- 54
That means i can store only 500gb on it, right?
-
10-13-2008, 04:03 PM #17Junior Guru Wannabe
- Join Date
- May 2008
- Posts
- 54
That mean i can store only 500gb on it, right?
-
10-13-2008, 04:04 PM #18Web Hosting Master
- Join Date
- Feb 2006
- Location
- Kusadasi, Turkey
- Posts
- 3,379
Raid-5 is the best for 3-5 disks in a file hosting server. You can recover files even if you lose one harddisk. Usable space is one less harddisk of the total. So if you have 4x 1TB disks, your usable space is 3x 1TB = 3 TB. If you have 3x500GB disks, you can use 2x500GB = 1TB space.
If you have more than 5 disks, RAID-6 becomes safer. In RAID-6 you can lose 2 disks and you can still recover files. Usable space is 2 disks less than total, so if you have 8x 1TB drives, you get 6x 1TB = 6TB space.
RAID-10 is an overkill for a file hosting website, especially when you start to have more than 4 disks.█ Fraud Record - Stop Fraud Clients, Report Abusive Customers.
█ Combine your efforts to fight misbehaving clients.
█ HarzemDesign - Highest quality, well designed and carefully coded hosting designs. Not cheap though.
█ Large and awesome portfolio, just visit and see!
-
10-13-2008, 04:08 PM #19Junior Guru Wannabe
- Join Date
- May 2008
- Posts
- 54
thanx harzem
-
10-13-2008, 04:17 PM #20WHT Addict
- Join Date
- Nov 2006
- Posts
- 126
In my opinion, if you are looking for drive upgrades. Then, the best is to consider a 3ware RAID 1 configuration with battery backup
-
10-13-2008, 05:51 PM #21WHT Addict
- Join Date
- Jan 2008
- Location
- United States
- Posts
- 140
raid5 and 6 would be best choice for file server. raid10 for db server.
-
10-14-2008, 08:37 AM #22Web Hosting Master
- Join Date
- May 2008
- Posts
- 858
Look on NewEgg for an Areca SATA raid card, it's hardware and by some people better than 3ware. They start from $299 for a raid5 card and a good one which can use 8 regular sata2 drives in a raid 10 for example is about $499.
I'm not sure, but you could probably go the other way and build a server with 16 or 32GB of RAM (there is for example a 4x4GB package on NewEgg) and use several instances of MemCache to keep in memory the most used files and serve them from memory. This way you could prevent or minimize disk trashing.
You could also use something like Gigabyte iRam if you find them but you'd probably be better just buying additional main memory nowadays.