Overclockers Australia Forums
OCAU News - Wiki - QuickLinks - Pix - Sponsors  

Go Back   Overclockers Australia Forums > Specific Hardware Topics > Modding > Modding Worklogs

Notices


Sign up for a free OCAU account and this ad will go away!
Search our forums with Google:
Reply
 
Thread Tools
Old 2nd July 2013, 1:13 PM   #1
cokeeffekt Thread Starter
Member
 
Join Date: May 2006
Posts: 292
Default Worklog: Micro Server v2

So its about time for the latest ideas for my new file server. Currently im facing performance and storage issues.

Current Server
- Intel ITX Mobo Atom CPU 4 gb ram
- 5x 3tb, 1x 2tb, and 64gb ssd for OS no raids.
- in a Lian Li PC-Q08B case

Nothing overly special.

OS: Debian Squeeze
Current server Roles
- Webserver
- usenet client
- media storage
- samba for home sharing(RPI xmbc etc.) other misc jobs
- backups/mutiple disks and remote for important stuff.

The proposed new server
- ITX mother board socket 1155 cpu (i5 or i7)
- 16gb ram
- 10x 3tb drives + ssd for OS

Debian OS again, and i will be doing something fairly unique for the filesystem. More to come on that one.

I will be building the new server completely separate, as i can't afford any downtime.

Proposed Roles will be much the same, but more storage/more grunt.

Now the hard part, i have been tinkering in my head and hunting down solutions, but i have come to the conclusion i will be sticking to the same case (Lian Li PC-Q08B, the size is just perfect), and will be cramming 10 drives, stock they wont take 10 but we can get around that.

Lian Li PC-Q08B


The case stock has a 140mm fan that is upright on the front of the case, the plan is to lay it back and mount 2 cages either side of it. each cage will hold 5 drives, mounted on there sides.



I will be 3d printing the cages. I have designed the cages to be ridged enough to hold the weight of the drives. The existing hdd/cdrom cages will be removed from the case, to allow the cage to fit in there place.

The case has arrived and i have a mockup cage printed, so will get onto some actual photos tonight.

Last edited by cokeeffekt; 2nd July 2013 at 11:29 PM.
cokeeffekt is offline   Reply With Quote

Join OCAU to remove this ad!
Old 2nd July 2013, 1:31 PM   #2
Bion1c
Member
 
Bion1c's Avatar
 
Join Date: Jul 2001
Location: Melbourne
Posts: 1,056
Default

subbed ..

interested to see these printed drive cages - good idea
Bion1c is offline   Reply With Quote
Old 2nd July 2013, 1:35 PM   #3
Acesi7
Member
 
Acesi7's Avatar
 
Join Date: May 2009
Location: Melbourne, 3810
Posts: 1,906
Default

Also subbed to see how the tray turn out.
Acesi7 is online now   Reply With Quote
Old 2nd July 2013, 2:47 PM   #4
TheBradl3s
Member
 
TheBradl3s's Avatar
 
Join Date: Sep 2011
Location: Adelaide, Australia
Posts: 86
Default

I do love seeing powerful servers with crazy amounts of storage shoved into small cases, keen on this! Subbed!
__________________
i5 2500k @ 4.4ghz AsRock Extreme3 Gen 3 PowerColor 7950 3gb 8gb G.Skill RipjawsX 1333mhz
Corsair Force 3 120gb Corsair H80 Push/Pull Setup SilverStone Strider 750w

G19 Keyboard G9x Lazer Mouse G13 Gamepad
TheBradl3s is offline   Reply With Quote
Old 2nd July 2013, 11:15 PM   #5
cokeeffekt Thread Starter
Member
 
Join Date: May 2006
Posts: 292
Default

Couple of updates after a few hours of printing and some tinkering with some hardware that showed up today.

This thread is about to get picture heavy... and excuse the dirty fingernails, im rebuilding a carby at the moment, tried to scrub them clean before my photo shoot to no avail.

SSD mount simple and works well.


Cheap 2 port sata card (support port multipliers)


Some tape to make the panel match the nice black case


2 x Port multipliers 1:5


3d printed Bracket for Port Multipliers


Port multipliers all put together ready for me to find them a home in the case.


Ok so now to some photos of the HDD Cage, this is only a quick print mock up but already im very happy with how it turned out, very strong, good air flow through the cage, and fits into the place i had planned for it. Although im still working on how it will be fixed to the case.




HDDs slide in and out nicely and anchor firmly by a notch in the base. More then happy with the mockup, almost happy enough to leave them as they are.
cokeeffekt is offline   Reply With Quote
Old 5th July 2013, 11:27 AM   #6
TheBradl3s
Member
 
TheBradl3s's Avatar
 
Join Date: Sep 2011
Location: Adelaide, Australia
Posts: 86
Default

That's not a half bad idea with the SSD!

Keen to see more!
__________________
i5 2500k @ 4.4ghz AsRock Extreme3 Gen 3 PowerColor 7950 3gb 8gb G.Skill RipjawsX 1333mhz
Corsair Force 3 120gb Corsair H80 Push/Pull Setup SilverStone Strider 750w

G19 Keyboard G9x Lazer Mouse G13 Gamepad
TheBradl3s is offline   Reply With Quote
Old 5th July 2013, 12:17 PM   #7
cokeeffekt Thread Starter
Member
 
Join Date: May 2006
Posts: 292
Default

Some more hardware arrived today, will post more pics tonight.

I have been working on a method for my storage that isn't really a raid solution.

Requirements
- spaning storage easy to add another drive to the pool
- customisable redundancy on folders (select level of redundancy per folder)
- multiple size disks
- light weight and simple config
- easy way to replace drives with out loosing data or rebuilding a raid
- catch deleted files from storage paths
- if non redundant data dies then i want to know exactly what i lost.

Solution
- written in php
- certain folders can have custom levels of redundancy ie one folder can recover from a single drive failure, where as another more important folder can recover from 3 drive failures.
- stores files in storage points on each drive as a round robin style (highest percentage free gets priority)
- runs as a daemon on the server so can be stopped if required
- allows more storage to be added to the storage path regardless of filesystem
- drives can go missing and come back with no inconvenience
- keeps live updates on data and logs issues, missing files/paths
- scalable, any size drive or file system, even usb disks can be used.

I have written the following program that will handle all my requirements, keep in mind this is just for storing data, all though modifying and updating the data is more than possible in the current arrangement, its main purpose is storing media.

To put it simply, you put the files in the put-path and it breaks them out into locations on the store-paths, leaving behind a link simple right? and when it hits a redundant folder it puts copies of the files onto other disks (based on its level of redundancy)

I have been running tests on this software in VMs for some time and i am finally confident enough to put it into a live environment.

Paste Bin of Code

Any thoughts?, i know this is probably the wrong section to post this is just as much part of the build as anything else, and id like the work log to reflect it
cokeeffekt is offline   Reply With Quote
Old 5th July 2013, 12:40 PM   #8
GumbyNoTalent
Member
 
GumbyNoTalent's Avatar
 
Join Date: Jan 2003
Location: Briz Vegas
Posts: 3,106
Default

You might want to investigate greyhole.

http://www.greyhole.net/
GumbyNoTalent is offline   Reply With Quote
Old 5th July 2013, 12:51 PM   #9
cokeeffekt Thread Starter
Member
 
Join Date: May 2006
Posts: 292
Default

Quote:
Originally Posted by GumbyNoTalent View Post
You might want to investigate greyhole.

http://www.greyhole.net/
interesting, i wish i found this earlier. it pretty much does what mine does....
cokeeffekt is offline   Reply With Quote
Old 5th July 2013, 1:03 PM   #10
Bion1c
Member
 
Bion1c's Avatar
 
Join Date: Jul 2001
Location: Melbourne
Posts: 1,056
Default

no offence but i think it's pretty crazy writing your own solution to this, especially in php

i mean, the whole idea of a server with redundancy is to keep the data safe, so running your own software layer on top of it (esp controlling redundancy) would be the weakest link in the chain. Bugs could have very bad consequences.

personally if i had that (rather nice!) hardware I'd just create a single ZFS RAIDZ2 pool on it rather than fiddling with different levels.. although there are lot of packaged solutions out there that give you more customisation; like greyhole, nexenta, freenas etc
Bion1c is offline   Reply With Quote
Old 5th July 2013, 1:15 PM   #11
cokeeffekt Thread Starter
Member
 
Join Date: May 2006
Posts: 292
Default

Quote:
Originally Posted by Bion1c View Post
no offence but i think it's pretty crazy writing your own solution to this, especially in php

i mean, the whole idea of a server with redundancy is to keep the data safe, so running your own software layer on top of it (esp controlling redundancy) would be the weakest link in the chain. Bugs could have very bad consequences.

personally if i had that (rather nice!) hardware I'd just create a single ZFS RAIDZ2 pool on it rather than fiddling with different levels.. although there are lot of packaged solutions out there that give you more customisation; like greyhole, nexenta, freenas etc
yeh i understand a little crazy, tbh there is nothing wrong with it being written in php a lot of people see it being a web only language and cant seem to get past that i've been writing in it for a long time as well as python and pearl and php still comes back as my language of choice.

The way i see it for home servers is there is data and then there is "cry" data. data which originated on the internet is easily replaceable so i see no need for wasting raid space on it. Then the "cry" data is the data that originated from my life photos, videos, code and other stuff. Im VERY stringent with this data and use crashplan to cover my ass, ive never lost anything so far (fingers crossed).

If it doesn't work i can alway role over onto something else, looking a greyhole it essentially does the exact thing my program does, the only thing it has over mine is it has been tested a lot more.
cokeeffekt is offline   Reply With Quote
Old 11th July 2013, 7:40 AM   #12
cokeeffekt Thread Starter
Member
 
Join Date: May 2006
Posts: 292
Default

Sorry for the lapse in updates, been busy.

So i have mocked up a stand off for the hdd cage, will print this weekend. This will lift the cage of the cage off the floor of the case, allow the air to flow through and out the base of the case from the stock vent holes.


I still need to do the same for the top and mounting bracket to hold it in from the top.


This is the cage sitting on the base of the case. Its obvious why it needs to be lifted up from the floor of the case.


Hardware has showed up.
Motherboard - Asrock H61M-ITX
CPU - i5-3570K (i was aiming for an i7 but price couldn't justify it.)
Ram - 2x 8G Single 1600 Patriot-S (one showed up and failed memtest will need to take one back under warranty )
PSU - Antec EarthWatts- Platinum 650

Ill get the gear in over the next few days and get some pics of the setup.
cokeeffekt is offline   Reply With Quote
Old 11th July 2013, 7:56 AM   #13
Bion1c
Member
 
Bion1c's Avatar
 
Join Date: Jul 2001
Location: Melbourne
Posts: 1,056
Default

looking good- you have the drives yet or waiting on delivery?

do you have a 3d printer at home? you're inspiring me to maybe get one

printing drive cages is awesome. was it hard to do up the 3d models for it?
Bion1c is offline   Reply With Quote
Old 11th July 2013, 9:46 AM   #14
cokeeffekt Thread Starter
Member
 
Join Date: May 2006
Posts: 292
Default

Quote:
Originally Posted by Bion1c View Post
looking good- you have the drives yet or waiting on delivery?

do you have a 3d printer at home? you're inspiring me to maybe get one

printing drive cages is awesome. was it hard to do up the 3d models for it?
yeh i have a rep-rap prusa (ebay electronics/printed parts)

I model in sketch up so very easy.

Drives, are umm, im going to put what drives i have currently not being used in there first, and a couple i bought a second hand. i want to give my JPI program a good run before adopting it. Im not going to use greyhole, i dont like the idea of running everything through samba.

Last edited by cokeeffekt; 11th July 2013 at 11:32 AM.
cokeeffekt is offline   Reply With Quote
Old 13th July 2013, 2:53 PM   #15
cokeeffekt Thread Starter
Member
 
Join Date: May 2006
Posts: 292
Default

A couple of updates.

Printed lower raiser bracket



Fitted to cage




Hardware test fit install



Drives are stable in cage, im more than happy with the strength of the cage. I spun up the fan to check air flow the gap between the drives seems to provide a nice rush of air from the 140mm fan

More to come..
cokeeffekt is offline   Reply With Quote
Reply

Bookmarks

Sign up for a free OCAU account and this ad will go away!

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +10. The time now is 3:22 PM.


Powered by vBulletin® Version 3.8.4
Copyright ©2000 - 2014, Jelsoft Enterprises Ltd. -
OCAU is not responsible for the content of individual messages posted by others.
Other content copyright Overclockers Australia.
OCAU is hosted by Internode!