The Wiert Corner – irregular stream of stuff

Jeroen W. Pluimers on .NET, C#, Delphi, databases, and personal interests

  • My work

  • My badges

  • Twitter Updates

  • My Flickr Stream

  • Pages

  • All categories

  • Enter your email address to subscribe to this blog and receive notifications of new posts by email.

    Join 1,842 other followers

My ZFS question on G+: investigation for using a XW6600 based system with ZFS.

Posted by jpluimers on 2014/12/20

My ZFS question on G+:

Hi everyone. I’m a geek. Learned most of the stuff by doing, and keeping tracks of what I did on my tech-blog http://wiert.me

I want to start with ZFS on a pair of HP XW6600 machines having 32gigabyte of RAM.
Any help on that is much appreciated.

The idea is to have one of these here in a closet and the other remotely, and perform replication between them (I’ve a 50megabit fiber-to-the-home uplink which can grow to 100megabit plus, internally my network is gigabit).

My current data is on a Windows 2003 x64 server with dual RAID5 configurations that are synced every night (not optimal for various reasons) with about 12gigabyte of files having mostly read-only access patterns and these kinds of sizes:
– small files between 4kilobyte and a few megabytes
– photos between 5 and 20 megabytes
– ISO backups and 7zip archives of projects (operating system installers, etc) between 100megabytes-6gigabytes
plus an ESXi machine having about 4gigabyte of data (mostly sizes between 20 and 200 gigabyte).

New storage should initially be at least 16gigabyte with room for growth.

I’m having active experience with OpenSuSE, ESXi and Windows. Solaris experience is from a long time ago. Learning by doing is my way of quickly gaining knowledge.

My schedule is doing research until the end of January (partially overlapping with a holiday) then building and testing until the end of Q1, going live early Q2.

Current plan is to put a lot of Samsung M9T 2terabyte SATA drives (they are only 9.5millimeter high) into the XW6600 rigs.
Earlier this year I did some research on controllers and hard drives, and I wonder how much of it is still current: https://wiert.me/2014/03/12/lots-of-2-5-3-5-and-5-25-conversion-brackets-and-hot-swap-bays/
(A quick calculation shows I should be able to get at least 14 externally accessible M9T drives into this machine, plus room for internal SSDs, etc).

So: where should I get started?

Initial questions I have:
– how about rebuild time when drives are lost? (how does the process of cold/hot spares work, can this be automated, how fast is it?)
– I’m not happy about the RAID5 rebuild times, so are 2TB drives indeed the sizes to go for?
– how about configuring things like ZFS equivalents of stripe size, buffer sizes, etc?
– what SATA controllers to use (is mainboard OK, what in addition to the mainboard SATA?)
– how can ZFS be used as an iSCSI target? how well does that work? (That would be really nice to connect to it from ESXi, Windows and many Linuxes/Linii)
– what about compression and block-deduplication?
– what about ZIP and L2ARC? how to estimate their size?
– which ZFS implementation to use? ZoL? OpenSolaris? Nexenta? Others?
– can a ZFS volume grow by adding extra drives?
(14 drives would get ~20terrabyte based on Z-3: http://www.servethehome.com/raid-calculator/ or http://wintelguy.com/raidcalc.pl but I want to have room for growth)

–jeroen

via: Hi everyone. I’m a geek. Learned most of the stuff by doing, and keeping tracks….

2 Responses to “My ZFS question on G+: investigation for using a XW6600 based system with ZFS.”

  1. Rick said

    I would have to say forget rotational media for anything but permanent archiving. Go with chips for (of course) RAM and storage. Then switch to “live objects” instead of “create and save” for your future development.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

 
%d bloggers like this: