To people with 5TB+ of data...

Discussion in 'Storage & Backup' started by Menthu_Rae, Jul 25, 2010.

  1. Menthu_Rae

    Menthu_Rae Member

    Joined:
    Mar 19, 2002
    Messages:
    6,874
    Location:
    Northern Beaches, Sydney
    How do you manage it all?

    > What kind of folder structuring do you use?
    > Are your files names standardised?
    > Do you use specialised software to help rename/sort/manage files?
    > Do you use file tags and if so how (Vista/Win7/3rd party apps)?

    Just curious because I have quite a lot of data and I find that folder and file based filesystems just aren't cutting it from an efficiency point of view (sorting, finding, categorising etc).
     
  2. Soarer GT

    Soarer GT Member

    Joined:
    Sep 26, 2007
    Messages:
    2,725
    Location:
    Melbourne
    Pretty Basic Actually...

    1. Photo's (Folders are in chronological order - 20100725 - Event Name)
    2. Backups (of other machines)
    3. Essential Software
    4. ISO's
    5. Kids
    5.1 Kids Movies
    5.2 Kids TV Series
    6. Parents (you really dont want your kids watching something like Ninja Assasins or Punisher. This is Password Protected.)
    6.1 Parents Movies 1
    6.2 Parents Movies 2
    6.3 Parents TV Series
    6.3 Parents TV Series 2
    7 Games
    8 New (Where everything goes before it is categorized).
     
  3. Copie

    Copie Member

    Joined:
    Jul 24, 2009
    Messages:
    13,506
    Location:
    Newcastle
    Mine is:
    Backup
    Backgrounds
    Downloads (DC++ dump folder)
    DVD rips
    E-Books
    Games
    HD Movies
    Movies (Non HD)
    Music
    Music Videos
    Porn
    Programs
    Steam (Backup)
    TV
    Unsorted TV

    Everything except for TV and Programs do not have sub folders, however i dont split it by genres etc.
     
  4. m0po

    m0po Member

    Joined:
    Jan 21, 2005
    Messages:
    273
    Location:
    Central Coast [2259]
    i just have everything in a raid5 array (6x2tb) and then everything in folders... most media centre programs will automatically get all relevant info on tv shows and movies, and as for music, itunes is pretty good at sorting it.
     
  5. noobmastery

    noobmastery Member

    Joined:
    Dec 23, 2008
    Messages:
    888
    Location:
    Sydney, 2088
    I use multiple RAID volumes, each volume has a single partition and a single purpose
    Partition names are:
    CRAP
    MOVIES
    GAMES
    HD MOVIES
    TV

    Here, CRAP refers to anything that doesn't belong in the other folders like pron or ebooks
     
  6. TERRA Operative

    TERRA Operative Member

    Joined:
    Jul 8, 2005
    Messages:
    6,925
    Location:
    Niraikanai
    Mine is as follows, per hard drive:

    Balthazar (Anime)
    Melchior (TV Series)
    Casper (Movies)
    Gherin (General Stuff)
    Nerv (ISO's)

    etc.
     
  7. Davo1111

    Davo1111 Member

    Joined:
    Mar 5, 2009
    Messages:
    3,017
    Location:
    Sydney
    Documents
    Personal (iso backups/pictures etc)
    Pictures
    Music
    Video (Doco, Funny etc)
    Movies (folders A-Z)
    Apps (i just have a folder for each program)


    All HDDs are named phonetically. Victor, Wilco, Xray, Yankee etc
     
  8. ravencs

    ravencs Member

    Joined:
    May 5, 2009
    Messages:
    831
    Location:
    Sydney 2089
    Raid called: (you guessed it!) Media

    1. Games
    2. Applications
    3. Movies
    4. TV Shows
    5. Music
    6. Unsorted (torrent dump)

    All my Linux Movies are categorized by the quality - mainly because i hate watching bad quality shit.

    For instance:
    Linux Tutorial 2 - BLU-RAY
    Linux Tutorial 2 - DVD
    Linux Tutorial 2 - DVD (4/3)
    Linux Tutorial 2 - DVD (Thin)
    Linux Tutorial 2 - SCREENER (B/W)
    Linux Tutorial 2 - CAM (Shit)

    Also helps me weed out the multiples copies - i just recently found 5 copies of the same movie in backups etc - argh.
     
  9. Soarer GT

    Soarer GT Member

    Joined:
    Sep 26, 2007
    Messages:
    2,725
    Location:
    Melbourne
    No one with over 5TB+ of gear has kids?
     
  10. lavi

    lavi Member

    Joined:
    Dec 20, 2002
    Messages:
    4,004
    Location:
    Brisbane
    i use spotlight lol and dump everything on the nas ... works ok for me
     
  11. Dezza Bot

    Dezza Bot Member

    Joined:
    Aug 16, 2004
    Messages:
    4,609
    Location:
    Central Coast, NSW
    It seems like the user "Soarer GT" might ;)
     
  12. FatBoyNotSoSlim

    FatBoyNotSoSlim Member

    Joined:
    Sep 9, 2002
    Messages:
    14,066
    Location:
    Melbourne - 3174
    I keep it pretty simple:
    Backup
    Movies
    Music
    Software
    TV
    YET TO SORT
    Videos

    Pretty much sums up the directory layout. Movies/TV have specific naming conventions, whilst make it very easy to find what you need, and allow for very easy computer matching, if I was to put a HTPC frontend like XBMC over it. Music is a crapshoot, it's all dumped in there, same with software. But I have one folder for install files and another for ISOs. Videos is just random videos that aren't in a TV series, so its a lot of random files.
    Yet to Sort is just that, it's basically where I dump everything until I watch it, then it gets moved.

    Anyone have ideas for adult entertainment? :Paranoid: That area needs sorting, badly.
    Fuck no.... Kids would dwindle all the money that allows for 5TB+ machines away...
     
  13. HUMMER

    HUMMER Member

    Joined:
    Dec 1, 2002
    Messages:
    8,786
    Location:
    sydney
    my 5TB+ of gear are my babies. :lol:
     
  14. OP
    OP
    Menthu_Rae

    Menthu_Rae Member

    Joined:
    Mar 19, 2002
    Messages:
    6,874
    Location:
    Northern Beaches, Sydney
    LOL yeah from this thread either nobody has my issue (except maybe you FatBoy :p) or just isn't saying it due to the nature of the forum.

    Movies, Music, etc are fine... it's various "other" things that are nigh on impossible to categorise neatly :lol:
     
  15. MetalPhreak

    MetalPhreak Member

    Joined:
    Apr 8, 2007
    Messages:
    1,763
    Location:
    Perth
    Milo -> 720p
    1080p
    XVID
    DVD-R

    Otis -> Apps
    Games
    Other
    More Folders For Stuff
     
  16. plasticbastard

    plasticbastard Member

    Joined:
    Jul 30, 2003
    Messages:
    4,004
    Location:
    Sector ZZ9 Plural Z Alpha
    I've always used the following:

    TV Shows
    -Series
    --Season

    Movies
    -Genre
    --FilmName

    Music
    -AlbumArt
    -Genre
    --Artist
    ---Album
    ----CD1 (if necessary)
    ----CD2 (if necessary)

    Miscellaneous
    -Work
    -Wallpaper

    Photos
    -Film
    --Location+Date
    -Digital
    --Date
    ---Modified
    ---Stock
    ----CameraFolderName


    I try and keep my backups on a drive that uses the same heirarchy.
    But at the end of the day, I don't have a large number of small files & folders, my data is generally small folders & large size files (eg, 100's of MB's, to several GB in size), so I've never had to look through a lot of stuff.

    Photos also were browsed through with Picasa, but I stopped that when I switched to Mac & back to film as I don't like Picasa for Mac.
     
  17. FatBoyNotSoSlim

    FatBoyNotSoSlim Member

    Joined:
    Sep 9, 2002
    Messages:
    14,066
    Location:
    Melbourne - 3174
    And it'd not like theres 5TB of it... :Paranoid: It's just that it's hard to sort.

    I was thinking over the weekend that a nice database would be the way to go, to catergorise it all properly. :Paranoid:
     
  18. raX

    raX Member

    Joined:
    Dec 26, 2004
    Messages:
    735
    ~38TB of crap, alot of it is dupe (rar's extracted, left in folder, very small portion sorted)

    all on one network share, due to windows home server & it's hdd management.


    F3 is the most used key on my machine. by far.
     
  19. HUMMER

    HUMMER Member

    Joined:
    Dec 1, 2002
    Messages:
    8,786
    Location:
    sydney
    i bet you are not even close to half that storage if you cleaned out all the rar files and the duplicates.
     
  20. raX

    raX Member

    Joined:
    Dec 26, 2004
    Messages:
    735


    you volunteering?

    I try, i get through about 500gig and rage.

    then when i try again, theres another 500gig or so that took the previous week - 2 weeks place!
     

Share This Page

Advertisement: