I was fortunate enough to get some free drives from someone at work. They live in Austin, and offered up a big heavy box of hard drives to anyone who would pay for shipping. I’ve had a very simple ZFS pool for around 5 years now, composed of 3 2TB drives in a raidz1 with a cold spare.
There have been no issues, I scrub them monthly, however ever since I placed my /home volume onto the ZFS pool, I noticed some large delays when working with a git repo. Read More...
If you have google’d for smb.conf settings to max your 1Gb (or 10Gb) ethernet based network and you still cannot seem to get beyond 30MB/sec, make sure you have this option:
socket options = SO_RCVBUF=8192 SO_SNDBUF=8192 Either commented it out, or set the buffer size to 128K (131072). Or larger.
I was helping a friend of mine troubleshoot his ZFS + Samba environment.
He was running FreeBSD 9.0 and Samba 3. Read More...
I’ve been using ZFS on FreeBSD since it was first made available in 7.0, and it was not until FreeBSD 8.2 when NFSv4 ACL’s were implemented.
At $oldJob, I had a list of “To do’s”, really cool things like:
“Integrate Puppet into CMDB”, “Rewrite the Bacula addClient script”, “Build a MooseFS Cluster”… At the top though, I had:
Implement ACL’s on ZFS/Samba fileserver Anyway my $newJob always has a high demand for storage and sharing data. Read More...
Software As mentioned many times, this is a FreeBSD based environment. Some good sysinfo output below:
HAHAHUGOSHORTCODE-0xc0009c4a00-1-HBHB
Bootloader settings for the Director/Database node:
The /boot/loader.conf has the following contents: HAHAHUGOSHORTCODE-0xc0009c4a00-2-HBHB
All of the storage nodes and the director are running a GENERIC kernel with very few system tweaking. One of the storage nodes has a Chelsio 10Gb controller, but that hasn’t had a high enough load to crack the 1Gb/sec barrier. Read More...
I’ve been using Bacula, the open source backup software, for over a year now. Things have been going well, and I would like to dedicate a post or two to the environment I built.
Background Over a year ago, I took it upon myself to replace a single Legato Networker server with Bacula. One of our collaborators had decided to ship us (for no reason at all really, I think they were cleaning out their data center) a Sun X4200 AMD server, and two StorageTek/Sun NAS servers. Read More...
I didn’t find any blog posts of discussions on FreeBSD and multipath (for storage) that wasn’t a man page.
That means it is up to me to write about it :)
Hardware CPU Machine class: amd64 CPU Model: Intel(R) Xeon(R) CPU E5530 @ 2.40GHz No. of Cores: 16 Memory Total real memory available: 65511 MB Logically used memory: 3945 MB Logically available memory: 61565 MB Storage The storage is a large ~90TB Enterprise class Fibre Channel array, a Data Direct Networks S2A9900. Read More...
I need to share this. When I google for “Samba performance”, I never see real numbers, real configuration files, or real hardware environments. All I read are anecdotal recollections, and that is not good enough. I like numbers, and I’ll let the numbers speak for themselves:
> netstat -I em0 -w 1 input (em0) output packets errs bytes packets errs bytes colls 90166 0 98762637 95363 0 5332847 0 18131 0 24713156 20042 0 1123684 0 4 0 310 1 0 178 0 8 0 518 1 0 178 0 10153 0 10952920 10696 0 598129 0 92990 0 102837002 98476 0 5514994 0 92025 0 102680574 97277 0 5439496 0 92080 0 101799874 97403 0 5448637 0 75348 0 90861608 80972 0 4537737 0 90895 0 100323946 95781 0 5360948 0 89313 0 97371154 94364 0 5278618 0 81363 0 89229738 85861 0 4803589 0 2 0 126 3 0 286 0 I was so shocked that I had to use gstat and zpool iostat to verify the information: Read More...
FreeBSD 7.x has been using version 6 of ZFS, and originally only 8.0 was going to have the newly updated ZFS version: 13.
Last week the core team MFC’d (Merge From Current) the ZFS updates to 7.2, so I cvsup’d and re-build my server’s kernel and world ( with a simple “make buildworld && make buildkernel && make installworld && make installkernel ), rebooted, and now I have the latest ZFS version running: Read More...
A friend of mine got my the coolest birthday present I think I’ve ever recieved, and that was a bunch of new and super kick ass hardware. This will soon replace my current server, which is in such bad shape it cannot compile java code, or perl from source. Before I replace it, I wanted to play around with ZFS that comes with FreeBSD 7.0.
Here is a quick rundown of it all: Read More...