Dedicated PLEX media server - Need Plex Gurus

[ENTERPRISE]

The board I am using is hard to find because of the number of PCI-e slots (and dual PLX chips). I will share some pics hopefully soon. Thanks guys

 

 

https://www.asus.com/us/Motherboards/P9X79E_WS/

 

(Estimated)

SLOT 1 (and covers 2) = GPU

SLOT 3 (and covers 4) = LSI 9271-8i

SLOT 5 = Intel X550 10GB

SLOT 6 = SAS expander

SLOT 7 = 2nd LSI 9271-8i

 

 

 

That is a nice board, I can certainly see why it is a rarer find !

[Laithan]

If you find yourself needing mare RAM, shoot me a message.

I have a bunch of 8GB ECC RDIMMS. https://www.samsung.com/semiconductor/dram/module/M393B1K70DH0-YH9/

 

The sticks are 1333 rated dimms, but I ran them at 1866Mhz with a bump in voltage, on my old 2P ASRock server.

 

Thanks, will let you know but I am most likely limited to low profile DIMMs due to the size of the drive encosures. Once I get the motherboard I can test fit everything and I'll know (may not even fit with the low profile DIMMs). I actually have 32GB of ram now so I should be good but never know if it will like this board.

 

[J7SC_Orion]

 

That is a nice board, I can certainly see why it is a rarer find !

 

 

I've had the Asus X79-E WS board in use since late 2013...in fact, I'm writing this post on it as I just updated it (re. storage and OS) for some development server duty, along with an X99-E WS.

 

IMO the X79-E WS mobo has superb build quality, a very strong VRM, dual Intel 1GB and of course a pile of x16 PCIe. I'm using 32GB of TridentZ 2400 on it w/o any issues. If you can find a good used one (w/o bent pins etc) it might be worth it.

 

 

 

[ENTERPRISE]

Nice, almost want to get one for the sake of having one, but do not need any extra builds right now lol

[J7SC_Orion]

Nice, almost want to get one for the sake of having one, but do not need any extra builds right now lol

 

...I just kept this one since new, even after adding other more modern systems. The Gigabyte Z170 SOC Force and Asus X99-E WS are in that same 'special reserve'...when the X399 Creation workstation will be updated, there's a seat on that table for it, too ...unlike later Intel gens, the X79-E WS was as fast if not faster than its Rampage Extr counterparts, especially on m-GPU.The only limitations are:

 

a.) Asus has still not gotten around (at last check) to update the bios re. side-channel stuff even though they did for a lesser version of this board, and

b.) the bios does not do memory settings over 2400 MHz (unlike the Rampage), even if the CPU does, yet will go much higher via FSB tuning. It also takes decent amounts of memory tightening on secondary timings

 

 

[ENTERPRISE]

 

...I just kept this one since new, even after adding other more modern systems. The Gigabyte Z170 SOC Force and Asus X99-E WS are in that same 'special reserve'...when the X399 Creation workstation will be updated, there's a seat on that table for it, too ...unlike later Intel gens, the X79-E WS was as fast if not faster than its Rampage Extr counterparts, especially on m-GPU.The only limitations are:

 

a.) Asus has still not gotten around (at last check) to update the bios re. side-channel stuff even though they did for a lesser version of this board, and

b.) the bios does not do memory settings over 2400 MHz (unlike the Rampage), even if the CPU does, yet will go much higher via FSB tuning. It also takes decent amounts of memory tightening on secondary timings

 

 

Nice, though isnt it always annoying when a brilliant board is hampered by lack of BIOS updates, that kills me sometimes. That is why I love these BIOS modders out there who can tweak and include updates into a BIOS file for re-flashing. Have you maybe checked this out ?

[J7SC_Orion]

...Tx for the tip on bios modders / will seek that out...there's one bios update from 2015 I have downloaded but not installed yet (below). I should ask have that modded if possible. As mentioned, there' a slightly less-featured (non-E) WS version which does have an updated Bios for Spectre & Co... that might be helpful input for bios modders for the 'E' model...

 

[ENTERPRISE]

...Tx for the tip on bios modders / will seek that out...there's one bios update from 2015 I have downloaded but not installed yet (below). I should ask have that modded if possible. As mentioned, there' a slightly less-featured (non-E) WS version which does have an updated Bios for Spectre & Co... that might be helpful input for bios modders for the 'E' model...

 

No BIOS modders here yet BUT you may be able to find some help over here: https://www.bios-mods.com/forum/

 

Fairly dedicated to what BIOS Modding, so you may be able to get someone to help you out

[J7SC_Orion]

 

No BIOS modders here yet BUT you may be able to find some help over here: https://www.bios-mods.com/forum/

 

Fairly dedicated to what BIOS Modding, so you may be able to get someone to help you out

 

..tx for the link, will check it out

[Laithan]

 

...I just kept this one since new, even after adding other more modern systems. The Gigabyte Z170 SOC Force and Asus X99-E WS are in that same 'special reserve'...when the X399 Creation workstation will be updated, there's a seat on that table for it, too ...unlike later Intel gens, the X79-E WS was as fast if not faster than its Rampage Extr counterparts, especially on m-GPU.The only limitations are:

 

a.) Asus has still not gotten around (at last check) to update the bios re. side-channel stuff even though they did for a lesser version of this board, and

b.) the bios does not do memory settings over 2400 MHz (unlike the Rampage), even if the CPU does, yet will go much higher via FSB tuning. It also takes decent amounts of memory tightening on secondary timings

 

 

This one also belongs in that club

https://www.asus.com/us/Motherboards/Z9PED8_WS/

 

 

 

I downloaded this BIOS, it looks like it has the updated microcode also. The ZIP itself has been updated.

https://www.win-raid.com/t4040f44-OF...-Bios-MOD.html

[J7SC_Orion]

...very nice board indeed, but we never had that type back in the day so it has to sit at another table than the one of my old heroes...for multi-socket server stuff, it's usually those ugly green Supermicro mobos in the even uglier cream-yellow cases (the ones that fade over time into the 'hospital wall colour'). I should get some more Rustoleum paint...

[ENTERPRISE]

...very nice board indeed, but we never had that type back in the day so it has to sit at another table than the one of my old heroes...for multi-socket server stuff, it's usually those ugly green Supermicro mobos in the even uglier cream-yellow cases (the ones that fade over time into the 'hospital wall colour'). I should get some more Rustoleum paint...

 

Ha ! I don't think you are the only person to think that of Supermicro boards. That being said, they do get the job done, I will give them that.

[Laithan]

Intel has been making motherboards for years but I never actually used one for personal use until just a few years ago (my first ESXi build). I suspect all the thoughts of the SuperMicro boards also apply to these . It does get the job done indeed and is stable... but features are pretty much minimal/stripped.

 

[ENTERPRISE]

Intel has been making motherboards for years but I never actually used one for personal use until just a few years ago (my first ESXi build). I suspect all the thoughts of the SuperMicro boards also apply to these . It does get the job done indeed and is stable... but features are pretty much minimal/stripped.

 

 

Haha yeah SuperMicro was never known for having any bells and whistles but dam...they did get the work done. Possible the lack of bells and whistles allows them to focus on the core important things more, leading to a super stable product.

[Laithan]

The motherboard has finally arrived and passed initial testing! I am noticing a similar issue where the BIOS loses partial settings after a power off but I just flashed it with the lastest 1704 BIOS + latest 42E microcode and I'll see if it resolves the issue. I can confirm that the latest microcode 42E has been included in the MOD BIOS link I posted a few posts ago at the bottom. I am using BIOS flashback. I immediately noticed about 5C lower idle CPU temps after flashing the new BIOS but it could be specific to this Xeon E5-1680v2 (since it is a very special CPU).

 

 

Tomorrow we see if things fit... <this is going to be a nail biter!>

[ENTERPRISE]

Nice, glad it arrived ! I would recommend changing out the CMOS battery for a new one as well due to the age of the board. Plus it means if you have setting retaining issues you can remove the CMOS battery as a factor.

[axipher]

Woohoo, looking forward to a good board this time around

[Laithan]

Nice, glad it arrived ! I would recommend changing out the CMOS battery for a new one as well due to the age of the board. Plus it means if you have setting retaining issues you can remove the CMOS battery as a factor.

 

Agree, good advice. It actually didn't even come with a battery, I guess maybe an oversees shipping thing.. So I put a brand new battery in before I fired it up as I have a bunch in stock. The issue is odd, I will set "Advanced mode" in the BIOS and then I find that "Ez mode" is enabled again...usually after power was disconnected. The time and date settings stuck and fan settings stuck but many other settings were reset. I would see a CSM error every time I booted but there were no boot devices attached. Once I attached a drive I didn't see the error so I think it may just be due to not having a boot device to select. It may just be a quirk that will be resolved once I get things assembled and select the boot device. I loaded BIOS defaults etc. also.

 

I also noticed that my U9DX-i4 came with NF-B9 fans (discontinued, replaced with redux) so I am upgrading them to NF-A9 PWM as they are the successor and have a higher RPM (1600 vs 2000). I really didn't feel like the stock fans were pushing enough air. I like the Noctua fans but sometimes they are just too weak. I suspect the cooler would do pretty well for a moderate overclock but not without the better fans. I'm hoping to have it hit 4.0Ghz on all cores (this Xeon is unlocked).

[Laithan]

Good news! It looks like the drive bays will fit over the motherboard. It was another really tight fit. I need to install the BluRay drive and reverse the fans but wanted to get a quick test fit.

 

 

[Laithan]

I've got more drives than I need but it is good to have spares on hand.. I think I'll go with (10) 4TB 7,200 RPM Spinners and (4) of the SSD's. That would give me around 36TB of usable storage. I was thinking of (1) SSD for the cachecade and the other (3) for a RAID 5 O/S & apps drive. I ran into some issues with the LSI 9271-8i card it may be defective so I ordered another... <sigh>

Edited July 25, 2020 by Laithan

[ENTERPRISE]

Wow, nice update. I love these big server builds with lots of storage, ohh the possibilities ! You were not lying about a tight fit were you lol, jeez there really is not much in it, but good that it fits in otherwise that would have been a facepalm moment. At least you have plenty of room for the GPU though.

 

Fingers crossed that you can give it a moderate OC and the cooler will hold up, as you say though, replacing the fans will help you on that front and there are plenty to choose from. If noise is not an issue then you have it made and you could get some really powerful units on that heatsink.

[axipher]

So much storage, love it.

 

 

I love my current Plex Server in a Rosewill RSV4000 with up to 12 3.5" bays and M.2 as Cache drives, but I think my next build I might actually want to paly with the idea of networked storage via a 10 or 25 gigabit link then just have a separate box of purely drives and redundant power supply.

 

That way I don't need to take my main array down if I am upgrading storage and the big network storage block would be for the less important bigger things like backups, all the media, etc. and reserve the main array for files, web server, VM's, etc.

[Laithan]

You were not lying about a tight fit were you lol, jeez there really is not much in it, but good that it fits in otherwise that would have been a facepalm moment. At least you have plenty of room for the GPU though.

 

Fingers crossed that you can give it a moderate OC and the cooler will hold up, as you say though, replacing the fans will help you on that front and there are plenty to choose from. If noise is not an issue then you have it made and you could get some really powerful units on that heatsink.

 

 

Come to find out, things are getting even tighter, you'll see in the next update. I was glad that I got that Zotac GPU because just about any other GPU would not have fit. The drive cage fans are massive about double the thickness of a standard fan so I have only a little bit past the PCIe slots.

 

Usually I will run my O/C at full boost all the time (all cores) and temps are managed based upon workload but this motherboard has an EPU feature that I'm going to look into and also see if I get the CPU stable with speedstep and power management enabled since it will be running 24x7. It makes the O/C a bit more challenging but I think I'll be fine since I'm targeting a modest 4Ghz.

 

https://www.asus.com/support/FAQ/1036401

 

 

So much storage, love it.

 

 

I love my current Plex Server in a Rosewill RSV4000 with up to 12 3.5" bays and M.2 as Cache drives, but I think my next build I might actually want to paly with the idea of networked storage via a 10 or 25 gigabit link then just have a separate box of purely drives and redundant power supply.

 

That way I don't need to take my main array down if I am upgrading storage and the big network storage block would be for the less important bigger things like backups, all the media, etc. and reserve the main array for files, web server, VM's, etc.

 

I really like that case also and I had considered it. It reminds me a lot of a dell rack mount chassis and has a nice clean look to it. Rosewill is hit or miss but usually when they hit, they knock it out of the park.

 

I haven't really experienced storage over 10GB+ in my home lab, only 1GB (NFS) where it honestly wasn't very impressive. I am curious how well it would actually perform with benchmarks like ATTO over the wire. A lot of the used equipment like the EMC NS-120s are dog slow but tick all the checkboxes on paper. Good 10GB NICs are still $150.. We seem to be waaaay overdue for an industry standard bump to 10GB, it's still treated like it was just invented yesterday..

 

 

EDIT: I looked it up, the standard for 10GB ethernet was defined in 2002... 18 years ago... and only now are motherboards starting to ship with them standard. That's kind of interesting how network performance stayed stagnent for so long.

Edited July 26, 2020 by Laithan

[axipher]

So for my home network, I'm using some Mellanox Connect-X3 cards with SFP+ ports and picked up a pair of them alongside some 15 feet Direct Attach Copper Cables for only $170 on eBay.

[J7SC_Orion]

Good news! It looks like the drive bays will fit over the motherboard. It was another really tight fit. I need to install the BluRay drive and reverse the fans but wanted to get a quick test fit.

 

 

 

 

Very nice build-up layout (& motherboard )! ...I am looking forward to the rest of the build-log.

 

Per other threads @ EHW, I plan to try out that win-raid modded bios you had linked for the X79-E WS (NVME; bifurcation) and then see if the MSI Aero card below works. It's PCIe 3, but afaik, PCIe 4 M.2s drives should work, just at PCIe 3 speeds (thinking about future upgrades for these drives into a PCIe 4 environment) ?