OpenSolaris/Solaris 11 Express/ESXi : BYO Home NAS for Media and backup images etc

Discussion in 'Storage & Backup' started by davros123, Dec 14, 2009.

  1. downforce

    downforce Member

    Joined:
    Jun 11, 2007
    Messages:
    1,202
    Location:
    Thornlie, WA
    Got a question that's been stumping me for ages and despite Google'ing a bit today, I couldn't find an answer.

    Code:
    peter@nassgl:~$ zfs list tank
    NAME   USED  AVAIL  REFER  MOUNTPOINT
    tank  4.83T   361G   349K  /tank
    peter@nassgl:~$ zpool list tank
    NAME   SIZE  ALLOC  FREE  CAP  DEDUP  HEALTH  ALTROOT
    tank  7.25T  6.65T  613G  91%  1.00x  ONLINE  -
    How come my zpool list free is 613G, but on zfs list, it's saying 361GB is avail?
     
  2. Rezin

    Rezin Member

    Joined:
    Oct 27, 2002
    Messages:
    9,488
    Do you have any snapshots?
     
  3. NSanity

    NSanity Member

    Joined:
    Mar 11, 2002
    Messages:
    17,644
    Location:
    Canberra
    Son. you need to make some space or you're in for a bad time.

    Also. metadata.
     
  4. downforce

    downforce Member

    Joined:
    Jun 11, 2007
    Messages:
    1,202
    Location:
    Thornlie, WA
    Nope no snapshots..

    And yes, I'm rebuilding in my ESX box and going to add 2x3TB in a mirrored vdev and create a new pool. Eventually I'll move over to all mirrored vdevs and retire the 4 disk raidz1. I've also been deleting crap like a madman. So many movies I'll never watch or watch again, I mean linux isos.
     
  5. gea

    gea Member

    Joined:
    May 22, 2011
    Messages:
    176
    Update for OmniOS 151014LTS: NFS exhausts memory under high write loads

    double posting
     
    Last edited: Oct 29, 2015
  6. gea

    gea Member

    Joined:
    May 22, 2011
    Messages:
    176
    Oracle Solaris 11.3 final

    double posting
     
    Last edited: Oct 29, 2015
  7. gea

    gea Member

    Joined:
    May 22, 2011
    Messages:
    176
  8. gea

    gea Member

    Joined:
    May 22, 2011
    Messages:
    176
  9. sreg0r

    sreg0r Member

    Joined:
    Jul 9, 2001
    Messages:
    1,146
    Location:
    Melbourne
    so what is the consensus on the best host OS for a ZFS based, mostly NAS but also running a few VMs home server. My current system (AMD + 10x2tb drives) is in need of an upgrade and has been running opensolaris/solaris11 fairly painlessly for the past 6 years.

    The biggest issue i have with Solaris (which is only minor) is that it's harder to fix things that i break/change because there just aren't that many users. Simple things like setting up services to keep the system clock in sync is way more complicated than it should be too.

    It looks like Ubuntu+ZFS is a lot more stable than when I last checked https://clusterhq.com/2014/09/11/state-zfs-on-linux/ so might give that a shot. Planning for a 6x6tb raidz2 so i can avoid having to use any expansion cards.
     
  10. NSanity

    NSanity Member

    Joined:
    Mar 11, 2002
    Messages:
    17,644
    Location:
    Canberra
    FreeNAS by far....
     
  11. Dropbear

    Dropbear Member

    Joined:
    Jun 27, 2001
    Messages:
    9,720
    Location:
    Brisbane
    are there official oracle solaris packages for mounting NTFS drives read/write..

    I want to test some USB hard drives on my solaris zfs box
     
  12. downforce

    downforce Member

    Joined:
    Jun 11, 2007
    Messages:
    1,202
    Location:
    Thornlie, WA
    Would that still be applicable if running it as a ESXi guest?

    I'm in the same boat and running it on Solaris doesn't bother me technically, but having a 'nicer' UI is a bonus.
     
  13. NSanity

    NSanity Member

    Joined:
    Mar 11, 2002
    Messages:
    17,644
    Location:
    Canberra
    I mean you shouldn't if you care about your data....

    But plenty of people do...
     
  14. downforce

    downforce Member

    Joined:
    Jun 11, 2007
    Messages:
    1,202
    Location:
    Thornlie, WA
    In terms of virtualising my NAS, that's a risk I'm willing to take (and see as low risk), I'm referring to using FreeNAS vs Solaris.
     
  15. NSanity

    NSanity Member

    Joined:
    Mar 11, 2002
    Messages:
    17,644
    Location:
    Canberra
    I understand what you mean.

    Still the FreeNAS guys *strongly* recommend against it. Then again i'm sure davros will be in here momentarily to tell them how that despite them being the vendor, and supporting paid installs day in day out - they are wrong.

    I guess the level of data security/reliability/redundancy they want is higher than most people care.
     
  16. downforce

    downforce Member

    Joined:
    Jun 11, 2007
    Messages:
    1,202
    Location:
    Thornlie, WA
    Interestingly NAPP-IT provide an .OVA to install on ESXi. They obviously don't think it too high risk!
     
  17. NSanity

    NSanity Member

    Joined:
    Mar 11, 2002
    Messages:
    17,644
    Location:
    Canberra
    For production, supported use?

    At any rate - replacing our Nexenta Install w/ FreeNAS today....

    Code:
    [root@zeus] ~# zpool status pool0
      pool: pool0
     state: ONLINE
      scan: none requested
    config:
    
            NAME                                            STATE     READ WRITE CKSUM
            pool0                                           ONLINE       0     0     0
              mirror-0                                      ONLINE       0     0     0
                gptid/ce71418a-8c24-11e5-ad0d-002590e833b8  ONLINE       0     0     0
                gptid/cf140f6f-8c24-11e5-ad0d-002590e833b8  ONLINE       0     0     0
              mirror-1                                      ONLINE       0     0     0
                gptid/ffe4f297-8c24-11e5-ad0d-002590e833b8  ONLINE       0     0     0
                gptid/00928d02-8c25-11e5-ad0d-002590e833b8  ONLINE       0     0     0
              mirror-2                                      ONLINE       0     0     0
                gptid/55a258f0-8c25-11e5-ad0d-002590e833b8  ONLINE       0     0     0
                gptid/564c4845-8c25-11e5-ad0d-002590e833b8  ONLINE       0     0     0
              mirror-3                                      ONLINE       0     0     0
                gptid/9ca01914-8c26-11e5-ad0d-002590e833b8  ONLINE       0     0     0
                gptid/9d4a064d-8c26-11e5-ad0d-002590e833b8  ONLINE       0     0     0
              mirror-4                                      ONLINE       0     0     0
                gptid/e99bad38-8c26-11e5-ad0d-002590e833b8  ONLINE       0     0     0
                gptid/ea4964c6-8c26-11e5-ad0d-002590e833b8  ONLINE       0     0     0
              mirror-5                                      ONLINE       0     0     0
                gptid/39e16564-8c27-11e5-ad0d-002590e833b8  ONLINE       0     0     0
                gptid/3a89ddb1-8c27-11e5-ad0d-002590e833b8  ONLINE       0     0     0
              mirror-6                                      ONLINE       0     0     0
                gptid/84408f6f-8c27-11e5-ad0d-002590e833b8  ONLINE       0     0     0
                gptid/84f2cd2a-8c27-11e5-ad0d-002590e833b8  ONLINE       0     0     0
              mirror-7                                      ONLINE       0     0     0
                gptid/d3e78a2f-8c27-11e5-ad0d-002590e833b8  ONLINE       0     0     0
                gptid/d4972a7f-8c27-11e5-ad0d-002590e833b8  ONLINE       0     0     0
              mirror-8                                      ONLINE       0     0     0
                gptid/2429c0a7-8c28-11e5-ad0d-002590e833b8  ONLINE       0     0     0
                gptid/24d8bf9d-8c28-11e5-ad0d-002590e833b8  ONLINE       0     0     0
              mirror-9                                      ONLINE       0     0     0
                gptid/92416ea7-8c28-11e5-ad0d-002590e833b8  ONLINE       0     0     0
                gptid/92f87223-8c28-11e5-ad0d-002590e833b8  ONLINE       0     0     0
              mirror-10                                     ONLINE       0     0     0
                gptid/dffdb5f8-8c28-11e5-ad0d-002590e833b8  ONLINE       0     0     0
                gptid/e0babd30-8c28-11e5-ad0d-002590e833b8  ONLINE       0     0     0
              mirror-11                                     ONLINE       0     0     0
                gptid/2a9e10f0-8c29-11e5-ad0d-002590e833b8  ONLINE       0     0     0
                gptid/2b508bc6-8c29-11e5-ad0d-002590e833b8  ONLINE       0     0     0
              mirror-12                                     ONLINE       0     0     0
                gptid/75dc4b78-8c29-11e5-ad0d-002590e833b8  ONLINE       0     0     0
                gptid/768a0718-8c29-11e5-ad0d-002590e833b8  ONLINE       0     0     0
              mirror-13                                     ONLINE       0     0     0
                gptid/bf438a98-8c29-11e5-ad0d-002590e833b8  ONLINE       0     0     0
                gptid/bffcbf17-8c29-11e5-ad0d-002590e833b8  ONLINE       0     0     0
              mirror-14                                     ONLINE       0     0     0
                gptid/17cac009-8c2a-11e5-ad0d-002590e833b8  ONLINE       0     0     0
                gptid/187d0f21-8c2a-11e5-ad0d-002590e833b8  ONLINE       0     0     0
              mirror-15                                     ONLINE       0     0     0
                gptid/63bcc0cc-8c2a-11e5-ad0d-002590e833b8  ONLINE       0     0     0
                gptid/6468179d-8c2a-11e5-ad0d-002590e833b8  ONLINE       0     0     0
              mirror-16                                     ONLINE       0     0     0
                gptid/cd097e79-8c2a-11e5-ad0d-002590e833b8  ONLINE       0     0     0
                gptid/cdbbada2-8c2a-11e5-ad0d-002590e833b8  ONLINE       0     0     0
            logs
              mirror-17                                     ONLINE       0     0     0
                gptid/9804ca12-8c2b-11e5-ad0d-002590e833b8  ONLINE       0     0     0
                gptid/984fc0bf-8c2b-11e5-ad0d-002590e833b8  ONLINE       0     0     0
            cache
              gptid/2e4623c8-8c2b-11e5-ad0d-002590e833b8    ONLINE       0     0     0
              gptid/2ead0158-8c2b-11e5-ad0d-002590e833b8    ONLINE       0     0     0
    
    errors: No known data errors
    
    wheeeeeeeee.
     
  18. OP
    OP
    davros123

    davros123 Member

    Joined:
    Jun 18, 2008
    Messages:
    2,930
    Nppit OVA is on Illuminos iirc , not freebsd. He also has a great guide on setting up an all in one server/nas/san on esxi. Worth a read.

    Solaris and spinoff's (eg IlluminOS) all run perfectly as a VM (eg

    FreeNAS is nice for nebies and those who want a pretty guyi, but if you want to do anything meaningful , incl. non-trivial permissions based access, you'll still find yourself in the os/command prompt learning freebsd commands. I also found it slower than Solaris....again, you can try and tweak tunables or roll your own but that gets messy real quick.

    What i did was simply migrate my solaris from physical to virtual (post in here on how to do this or google). Took less than an hour iirc to be up and running again under esxi....of course you need hardware that supports it like vt-d and supported nic's.

    NSanity, wrt virtualising freeNAS, months on, no one has been able to in any way substantiate the self proclaimed forum dogs who made that statement.

    Many many people (including myself and friends) run freenas under esxi. That does not make me right any more than it does someone claiming the contrary.

    Hey Nsanity, back to the real topic...run some benchies on that bad boy!!!

    What type of workload is it used for? What are you using for a log and cache?
     
    Last edited: Nov 16, 2015
  19. NSanity

    NSanity Member

    Joined:
    Mar 11, 2002
    Messages:
    17,644
    Location:
    Canberra
    Eh - I have firsthand experience of real servers with real resources on both Nexenta and FreeBSD. There is nothing in it from a storage point of view.

    BSD is nicer to work with than Solaris/Illumnos.

    And I do most of my shit in CLI as well.

    Our Production VM Host.

    Logs are 2x Mirrored 200GB DC S3710's re-partitioned to 16GB
    Cache is 2x 120GB DC S3510 "spanned"

    all members are 2TB SAS 7200pm HGST's.

    I'll probably whack an all SSD array in there at some point as well.

    I have some rather expensive SAS SSD's that we previously used for L2 and LOG. They will probably end up as VMWare Cache Accelerators.
     
    Last edited: Nov 16, 2015
  20. downforce

    downforce Member

    Joined:
    Jun 11, 2007
    Messages:
    1,202
    Location:
    Thornlie, WA
    My ESXi box is already totally VMWare Compatible, just added the NAS to it. I've just re-built a new Solaris VM/guest, using new drives for storage (changing to mirrored vdev from 4 disk raidz1), getting all the permissions etc setup, then I'll add the old drives, import the pool and copy the data across -- so simple (in theory!)
     

Share This Page

Advertisement: