hosted by liquidweb


Go Back   Web Hosting Talk : Web Hosting Main Forums : Colocation and Data Centers : ZFS backup storage server
Reply

Forum Jump

ZFS backup storage server

Reply Post New Thread In Colocation and Data Centers Subscription
 
Send news tip View All Posts Thread Tools Search this Thread Display Modes
  #1  
Old 12-10-2012, 11:22 AM
ServerZoo ServerZoo is offline
Web Hosting Master
 
Join Date: Oct 2004
Posts: 621

ZFS backup storage server


We are looking for good value central backup server for all of our cpanel servers, I googled and found that RAID-Z2 (similar to RAID-6) seems a good option and we want to setup it on software based without any raid card

my question are :

* to how many HDs that we will hit performance bottleneck? so we could evaluate cost/performance

* and any budget and smart method to boost performance up?

thanks!



Sponsored Links
  #2  
Old 12-10-2012, 11:34 AM
relichost relichost is offline
Temporarily Suspended
 
Join Date: Feb 2004
Location: UK
Posts: 1,429
Hi

Have you looked at this ?

http://nexentastor.org/ <- will do 16TB for free

so 4 x 4tb
or
8 x 2tb
16 x 1tb

From experience the more spindles the better the performance, but the higher the running costs (ie more disks)

Thanks

  #3  
Old 12-10-2012, 11:40 AM
ovais ovais is offline
Web Hosting Guru
 
Join Date: May 2007
Location: India
Posts: 316
8 x 2TB should be sufficient for a medium size deployment, enable compression to save storage and add a ZIL SSD for better write performance.

__________________
LoopByte - Fastest growing Indian dedicated servers provider
India Based Managed Dedicated Servers, VPS & Hosting Services

Sponsored Links
  #4  
Old 12-10-2012, 11:50 AM
ocosa ocosa is offline
Aspiring Evangelist
 
Join Date: Dec 2011
Location: Tulsa, OK
Posts: 353
+1 for nexenta.

__________________
OCOSA Communications | Since 2003
http://www.ocosa.com
Hosting, Connectivity, Professional Services

  #5  
Old 12-10-2012, 11:58 AM
bqinternet bqinternet is offline
Backup Guru
 
Join Date: Feb 2002
Location: New York, NY
Posts: 4,467
Make sure that you test it well before using ZFS. We used ZFS (with RAID-Z2) on some backup servers a few years ago, and had a terrible experience, on both Solaris and FreeBSD.

Assuming that you have lots of RAM, and that they have fixed the stability issues, you should get decent performance in the beginning. The problem is that it gets extremely fragmented over time. Within months, the servers were becoming barely usable, which made it all the more difficult to get rid of ZFS.

As far as I know, there's still no online defragmentation feature, which is what is needed to make ZFS usable as a central backup server. It might work well enough for you, but keep a close eye on it.

__________________
Scott Burns, President
BQ Internet Corporation
Remote Rsync and FTP backup solutions
*** http://www.bqbackup.com/ ***

  #6  
Old 12-10-2012, 12:08 PM
Rens Rens is offline
Web Hosting Evangelist
 
Join Date: Mar 2009
Location: NL
Posts: 538
Quote:
Originally Posted by bqinternet View Post
Make sure that you test it well before using ZFS. We used ZFS (with RAID-Z2) on some backup servers a few years ago, and had a terrible experience, on both Solaris and FreeBSD.

Assuming that you have lots of RAM, and that they have fixed the stability issues, you should get decent performance in the beginning. The problem is that it gets extremely fragmented over time. Within months, the servers were becoming barely usable, which made it all the more difficult to get rid of ZFS.

As far as I know, there's still no online defragmentation feature, which is what is needed to make ZFS usable as a central backup server. It might work well enough for you, but keep a close eye on it.
There are no stability issues. We have about 10 servers running Opensolaris / Nexenta Core with an uptime > 1 year (one > 2 years). Zero crashes or issues on all of them. Different clients using them and all kinds of disks (mostly nearline SAS though). All Supermicro servers.

__________________
YISP - High Bandwidth dedicated servers and colocation in YISP-AS(Amsterdam)!

Website: http://www.yisp.com
Contact: info "(AT)" yisp.com

  #7  
Old 12-10-2012, 12:18 PM
ovais ovais is offline
Web Hosting Guru
 
Join Date: May 2007
Location: India
Posts: 316
We also have few Nexenta/OpenIndiana boxes running pretty well.

__________________
LoopByte - Fastest growing Indian dedicated servers provider
India Based Managed Dedicated Servers, VPS & Hosting Services

  #8  
Old 12-10-2012, 03:00 PM
hafthorr hafthorr is online now
Junior Guru
 
Join Date: Jan 2012
Location: Zagreb/Boston
Posts: 224
word of warning, nexenta license says you cannot use it in commercial or business use.

have no heard anyone getting sued or contacted about it, but you never know.

http://www.nexentastor.org/projects/...mmunityEdition

Quote:
Production use is not allowed with Community edition. It is designed and intended to help people become familiar with the product or for hobbiest use.
and from EULA

Quote:
2.2 If You have acquired a Community Edition license, the total amount of RAW Storage Space is limited as specified on the Site and is subject to change without notice. The Community Edition may ONLY be used for educational, academic and other non-commercial purposes expressly excluding any commercial usage. The Trial Edition licenses may ONLY be used for the sole purposes of evaluating the suitability of the Product for licensing of the Enterprise Edition for a fee. If You have obtained the Product under discounted educational pricing, You are only permitted to use the Product for educational and academic purposes only and expressly excluding any commercial purposes.
alternative would be :

http://www.napp-it.org

on any supported solarwinds based distribution

  #9  
Old 12-10-2012, 03:08 PM
silasmoeckel silasmoeckel is offline
Web Hosting Evangelist
 
Join Date: Apr 2010
Posts: 481
Quote:
Originally Posted by PeterPP View Post
We are looking for good value central backup server for all of our cpanel servers, I googled and found that RAID-Z2 (similar to RAID-6) seems a good option and we want to setup it on software based without any raid card

my question are :

* to how many HDs that we will hit performance bottleneck? so we could evaluate cost/performance

* and any budget and smart method to boost performance up?

thanks!
ZFS likes ram and likes it even more as you use more and more features.

As to performance a single 7200 rpm sata drive can take more than a single ge can feed it. Even running a pair of 20gbs infiniband connections full out were not pushing our 48 drive backup heads (144TB in 4ru 192TB if we bought more expensive per GB drives). That said look hard at what your using to back up all backup apps are not created equal some can really stress out the servers and/or the backup heads. We do treat backup drives like tape so no raid the backup system makes redundant copies on multiple backup heads and no random io trashing performance.

  #10  
Old 12-10-2012, 10:00 PM
pjkenned pjkenned is offline
Junior Guru
 
Join Date: Apr 2012
Posts: 212
+1 for napp-it.org. The main force behind that is active on our fourms.

The big thing with ZFS software RAID is that you use compatible hardware and test beforehand. Great solution though. Performance wise for backup no issue. You could also use RAID-Z3 for a larger set of disks if you wanted.

__________________
My site dedicated to server and workstation hardware: http://www.servethehome.com

  #11  
Old 12-11-2012, 03:16 AM
cyberhouse cyberhouse is offline
Web Hosting Master
 
Join Date: Mar 2003
Location: chicago
Posts: 1,385
all the zfs issues i have seen has been a lack of zfs knowledge not zfs

  #12  
Old 12-11-2012, 07:59 AM
ServerZoo ServerZoo is offline
Web Hosting Master
 
Join Date: Oct 2004
Posts: 621
http://www.nexentastor.org/ does looks good! thanks!

  #13  
Old 12-11-2012, 09:59 AM
relichost relichost is offline
Temporarily Suspended
 
Join Date: Feb 2004
Location: UK
Posts: 1,429
Quote:
Originally Posted by PeterPP View Post
http://www.nexentastor.org/ does looks good! thanks!
Yep .. it is, but can get a little expensive if you need more than the 18TB or raw storage.

  #14  
Old 12-11-2012, 11:02 AM
ServerZoo ServerZoo is offline
Web Hosting Master
 
Join Date: Oct 2004
Posts: 621
just want to share this nice article
http://www.solarisinternals.com/wiki...ractices_Guide

then I have a question after reading, article says

**For better performance, a mirrored configuration is strongly favored over a RAIDZ configuration particularly for large, uncacheable, random read loads.**

is it a better than raidZ for backup purpose?

also, if I go with 2TBx6 with raidz2 for beginning, is it easy to add more disks to raidz2 in the future when needed?

  #15  
Old 12-11-2012, 11:33 AM
ServerZoo ServerZoo is offline
Web Hosting Master
 
Join Date: Oct 2004
Posts: 621
and what about
http://www.freenas.org/
http://www.nas4free.org/

should be no 16TB limitations?

Reply

Similar Threads
Thread Thread Starter Forum Replies Last Post
Storage server for backup host-master VPS Hosting 12 12-31-2011 09:27 AM
Opinions of NexentaStor or other ZFS storage for production systems? eger Hosting Software and Control Panels 1 01-25-2011 11:33 PM
Centralized Storage iSCSI/Fibre... what are you guys using? Anyone using ZFS? hostbox VPS Hosting 27 06-20-2010 03:12 AM
NetDepot's Backup Storage Server IGXHost Managed Hosting and Services 6 11-26-2009 04:08 PM
server for online backup storage PostiniWholesaler Dedicated Server 1 09-02-2005 02:13 AM

Related posts from TheWhir.com
Title Type Date Posted
ElephantDrive and WD Partner on Cloud Backup for NAS Web Hosting News 2013-12-23 13:35:44
Barracuda Network Releases Version 5.4 of Cloud Backup Solution Web Hosting News 2013-08-26 12:18:47
Carbonite Launches Enhanced Server Backup for Small Businesses Web Hosting News 2013-07-26 16:31:57
Sterling Data Storage Launches Three Cloud Backup Services Web Hosting News 2013-01-14 13:39:31
CloudBerry Launches Version 2.9 of Cloud Backup for Amazon S3, Azure Web Hosting News 2012-06-25 16:38:04


Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes
Postbit Selector

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Forum Jump
Login:
Log in with your username and password
Username:
Password:



Forgot Password?
Advertisement:
Web Hosting News:



 

X

Welcome to WebHostingTalk.com

Create your username to jump into the discussion!

WebHostingTalk.com is the largest, most influentual web hosting community on the Internet. Join us by filling in the form below.


(4 digit year)

Already a member?