atom feed18 messages in org.freebsd.freebsd-fsRe: ZFS and disk usage
FromSent OnAttachments
Mark SchoutenApr 13, 2012 5:20 am 
Volodymyr KostyrkoApr 13, 2012 6:10 am 
Mark SchoutenApr 13, 2012 6:28 am 
Peter MaloneyApr 13, 2012 6:32 am 
Johannes TotzApr 13, 2012 8:26 am 
Tom EvansApr 13, 2012 8:44 am 
Freddie CashApr 13, 2012 8:45 am 
Freddie CashApr 13, 2012 8:49 am 
Volodymyr KostyrkoApr 13, 2012 9:32 am 
Ronald KlopApr 15, 2012 4:14 am 
Mark SchoutenApr 16, 2012 1:35 am 
Volodymyr KostyrkoApr 16, 2012 11:32 pm 
Mark SchoutenApr 17, 2012 1:37 am 
Volodymyr KostyrkoApr 17, 2012 2:54 am 
Mark SchoutenApr 17, 2012 3:02 am 
Volodymyr KostyrkoApr 17, 2012 3:10 am 
Mark SchoutenApr 17, 2012 3:22 am 
Mark SchoutenMay 3, 2012 2:28 am 
Subject:Re: ZFS and disk usage
From:Volodymyr Kostyrko (c.kw@gmail.com)
Date:Apr 16, 2012 11:32:10 pm
List:org.freebsd.freebsd-fs

Mark Schouten wrote:

Just curious, what `ls -la /storage/' and `ls -la /storage/.zfs/s*` show?

It's plain weird.

[root@storage ~]# zfs list -o
name,used,referenced,usedbychildren,usedbydataset,usedbysnapshots,available,mountpoint,quota,reserv,refquota,refreserv
"$@" | sed -r "s/none/ -/g" NAME USED REFER USEDCHILD USEDDS USEDSNAP
AVAIL MOUNTPOINT QUOTA RESERV REFQUOTA REFRESERV storage 1.60T 431G 1.18T 431G 0
138G /storage - - - - storage/av.https-ict.nl..OS 20G 16K 0 16K
0 158G - - - - 20G storage/bestandonline.https-ict.nl.OS 20G 16K 0 16K 0
158G - - - - 20G

Let's take this one for example. It's not mounted! It shouldn't be listed in next command output.

storage/crm.fastbenelux.DATA 100G 16K 0 16K 0
238G - - - - 100G storage/crm.fastbenelux.OS 20G 16K 0 16K 0
158G - - - - 20G storage/default.do.not.remove 1G 16K 0 16K 0
139G - - - - 1G storage/mail.https-ict.nl.DATA 400G 16K 0 16K 0
538G - - - - 400G storage/mail.https-ict.nl.OS 20G 16K 0 16K 0
158G - - - - 20G storage/webserver.https-ict.nl.DATA 400G 16K 0 16K 0
538G - - - - 400G storage/webserver.https-ict.nl.OS 20G 16K 0 16K 0
158G - - - - 20G storage/webserver2.https-ict.nl.DATA 20G 16K 0 16K 0
158G - - - - 20G storage/webserver2.https-ict.nl.OS 20G 16K 0 16K 0
158G - - - - 20G storage/xlmail.xladsl.nl.DATA 150G 16K 0 16K 0
288G - - - - 150G storage/xlmail.xladsl.nl.os 20G 16K 0 16K 0
158G - - - - 20G

[root@storage /storage]# ls -al total 452101743 drwxr-xr-x 2 root wheel 18 Mar 24 17:42 . drwxr-xr-x 20 root wheel 512 May 10 2011 .. -rw-r--r-- 1 root wheel 21474836480 Apr 16 12:40 av.https-ict.nl.OS -rw-r--r-- 1 root wheel 155692564480 Mar 24 17:42
bestandonline.https-ict.nl.DATA -rw-r--r-- 1 root wheel 21474836480 Apr 5 12:19
bestandonline.https-ict.nl.OS

This is not a zfs dataset. This is a file. It has no relevance to named dataset. And it drains space from /storage.

-rw-r--r-- 1 root wheel 107374182400 Apr 16 12:40 crm.fastbenelux.DATA -rw-r--r-- 1 root wheel 21474836480 Apr 16 12:39 crm.fastbenelux.OS -rw-r--r-- 1 root wheel 1073741824 Apr 5 12:19 default.do.not.remove -rw-r--r-- 1 root wheel 10737418240 May 12 2011
documentatievm.https-ict.nl -rw-r--r-- 1 root wheel 429496729600 Apr 15 02:07 mail.https-ict.nl.DATA -rw-r--r-- 1 root wheel 21474836480 Apr 16 12:40 mail.https-ict.nl.OS -rw-r--r-- 1 root wheel 16106127360 May 16 2011 testvm1.https-ict.nl -rw-r--r-- 1 root wheel 429496729600 Apr 16 12:40
webserver.https-ict.nl.DATA -rw-r--r-- 1 root wheel 21474836480 Apr 16 12:40 webserver..https-ict.nl.OS -rw-r--r-- 1 root wheel 21474836480 Apr 5 12:19
webserver2.https-ict.nl.DATA -rw-r--r-- 1 root wheel 21474836480 Apr 16 12:40 webserver2.https-ict.nl.OS -rw-r--r-- 1 root wheel 161061273600 Apr 16 12:40 xlmail.xladsl.nl.DATA -rw-r--r-- 1 root wheel 21474836480 Apr 16 12:40 xlmail.xladsl.nl.os

[root@storage /storage]# ls -la /storage/.zfs/s* /storage/.zfs/shares: total 2 dr-xr-xr-x 2 root wheel 2 May 10 2011 . dr-xr-xr-x 4 root wheel 4 May 10 2011 ..

/storage/.zfs/snapshot: total 0 dr-xr-xr-x 2 root wheel 2 May 10 2011 . dr-xr-xr-x 4 root wheel 4 May 10 2011 ..

There's also another discrepancies in your output like: * "av.https-ict.nl..OS" != "av.https-ict.nl.OS", seems like copy-and-paste error(?); * "bestandonline.https-ict.nl.DATA" and "documentatievm.https-ict.nl" doesn't exist in datasets, it looks like correspondent datasets were already removed, but not files.

It definitly looks like the reserved space for the zvols is counted in /storage,
but the written data is counted for /storage as well, instead of the zvols..

Will an upgrade fix this?