cfp ExtremeHW Community Folding Project 2.0

[Bastiaan_NL]

Good to hear about the M40's!

 

It's the same over here with the PSU's, I should have bought a big one a few months ago instead of waiting. 

[Avacado]

Looking good E. Without the fans I sent you I was getting Thermal throttled on the Tesla's, hitting 85c+, even with high flow fans forcing air in the passive heatsink. Let me know what you are getting.

[ENTERPRISE]

4 hours ago, Avacado said:

Looking good E. Without the fans I sent you I was getting Thermal throttled on the Tesla's, hitting 85c+, even with high flow fans forcing air in the passive heatsink. Let me know what you are getting.

 

Yeah it will be interesting to see how hot they will get under load. May need to get another fan controller for those little fans you sent me haha.

[Avacado]

3 hours ago, ENTERPRISE said:

 

Yeah it will be interesting to see how hot they will get under load. May need to get another fan controller for those little fans you sent me haha.

They don't pull much wattage, and I sent 2x 3 way splitters for ease of use 

[ENTERPRISE]

4 hours ago, Avacado said:

They don't pull much wattage, and I sent 2x 3 way splitters for ease of use 

Thanks bud I did notice the splitters

 

My reasoning is that my 120mm fans are on the fan controller right now and I run them at full speed for the moment something I may not want for the smaller chaps. Will test first and see how it works out.

[Avacado]

4 hours ago, ENTERPRISE said:

Thanks bud I did notice the splitters

 

My reasoning is that my 120mm fans are on the fan controller right now and I run them at full speed for the moment something I may not want for the smaller chaps. Will test first and see how it works out.

Gotcha, yes, they are QUITE loud full speed. I think they can hit 12k rpm.

[BWG]

52 minutes ago, Avacado said:

Gotcha, yes, they are QUITE loud full speed. I think they can hit 12k rpm.

 

Wow! 12k dang! How much are those little fans new?

[Avacado]

1 hour ago, BWG said:

 

Wow! 12k dang! How much are those little fans new?

Practically nothing, they are no name chinese 40x20mm. I bought 5 noctuas of the same size and they did not move enough air to cool the monsters. 

[ENTERPRISE]

8 hours ago, Avacado said:

Gotcha, yes, they are QUITE loud full speed. I think they can hit 12k rpm.

 

Blimey...yeah those will scream lol.

 

Another couple of images, the fans and the received replacement thermal pads. Fortunately already have Thermal Grizzly ready. 

 

[ENTERPRISE]

Well I have been stripping the cards and rebuilding them over last couple of days, just one more now.

 

Keeping the shrouds off as I feel like testing the case through and through airflow will be fairly good. Plus the shrouds are plastic and only serves to hold heat in.

[ENTERPRISE]

So I did some more work today now that I received the second PSU from Silverstone. A nice 1500Watt 80+ Titanium.

 

Installed the last of the fans with their grilles to avoid cables slipping into them. Dust filters fitted to the intakes and the GPU power cable converters hooked up to the PSU. 

 

Had to relocate the fan controller due to a clearance mistake I made, but no biggie.

 

All that. Is left to do is replace SATA cable with a longer one, pop in an additional PCI-E power cable and pop in the riser cables and we are go for full testing. 

 

On phone so excuse upside down PSU haha.

 

 

 

 

 

 

 

 

 

 

[Avacado]

23 minutes ago, ENTERPRISE said:

So I did some more work today now that I received the second PSU from Silverstone. A nice 1500Watt 80+ Titanium.

 

Installed the last of the fans with their grilles to avoid cables slipping into them. Dust filters fitted to the intakes and the GPU power cable converters hooked up to the PSU. 

 

Had to relocate the fan controller due to a clearance mistake I made, but no biggie.

 

All that. Is left to do is replace SATA cable with a longer one, pop in an additional PCI-E power cable and pop in the riser cables and we are go for full testing. 

 

On phone so excuse upside down PSU haha.

 

w00t, so stoked for this!

[Bastiaan_NL]

Nice updates E, the system is coming together quickly now

[ENTERPRISE]

Uh oh. So I got it all setup ! But the GPU' run too hot as they will down clock to like 600/500Mhz core...not viable lol. 

 

We are around 85c and hotspot is 100c.

 

At this point im not 100% sure what to do. I can try hooking up the smaller fans to them I got from @Avacado and see. I didn't realise how quick these things heat up! 

 

[Avacado]

1 hour ago, ENTERPRISE said:

Uh oh. So I got it all setup ! But the GPU' run too hot as they will down clock to like 600/500Mhz core...not viable lol. 

 

We are around 85c and hotspot is 100c.

 

At this point im not 100% sure what to do. I can try hooking up the smaller fans to them I got from @Avacado and see. I didn't realise how quick these things heat up! 

 

Yea, I didn't think case CFM alone would be good enough. Those fans will help a lot, but they are noisy! 

Edited May 2, 2021 by Avacado

[ENTERPRISE]

So a new problem. Upon testing, I required a CMOS reset, unfortunately after that point I cannot get the system to boot. Looking at the boot diagnostic light, it points to VGA. By default the system will use the first slot, which is why I have the GT710 there as my dedicated display card.

 

So I thought it could be an issue with that, but upon remove the M40 GPU'S, the system will boot. Putting them back on yeilds no boot, a little frustrating that be honest. 

 

Also tried using another M40 on a different riser and slot...but no boot. 

 

Also checked the D4 code that comes up and it relates to 

 

Quote

PCI resource allocation error. Out of Resources

 

 

[Avacado]

16 minutes ago, ENTERPRISE said:

So a new problem. Upon testing, I required a CMOS reset, unfortunately after that point I cannot get the system to boot. Looking at the boot diagnostic light, it points to VGA. By default the system will use the first slot, which is why I have the GT710 there as my dedicated display card.

 

So I thought it could be an issue with that, but upon remove the M40 GPU'S, the system will boot. Putting them back on yeilds no boot, a little frustrating that be honest. 

 

Also tried using another M40 on a different riser and slot...but no boot. 

 

Also checked the D4 code that comes up and it relates to 

 

 

 

Make sure above 4G decoding is on, IIRC it defaults to off after CMOS reset. Not quite sure why it worked the first time and not after. You are starting to run through the many headaches I had in the beginning. I feel bad 

Edited May 2, 2021 by Avacado

[Bastiaan_NL]

Not sure if it could cause this issue, but do you have the PCIe slots set to gen 3? That might reset too after a clear CMOS. 

 

And the system looks good with all those cards in there

Edited May 2, 2021 by Bastiaan_NL

[ENTERPRISE]

17 minutes ago, Avacado said:

Make sure above 4G decoding is on, IIRC it defaults to off after CMOS reset. Not quite sure why it worked the first time and not after. You are starting to run through the many headaches I had in the beginning. I feel bad 

 

10 minutes ago, Bastiaan_NL said:

Not sure if it could cause this issue, but do you have the PCIe slots set to gen 3? That might reset too after a clear CMOS. 

 

And the system looks good with all those cards in there

Great suggestions, im tired so not thinking, will give that a go. That being said...what a ball ache if the CMOS resets or if there is a power outage causing a reset, then I have to remove all the GPU's set up the BIOS again and then put the GPU's back...sigh.

[Cerberus]

1 minute ago, ENTERPRISE said:

 

Great suggestions, im tired so not thinking, will give that a go. That being said...what a ball ache if the CMOS resets or if there is a power outage causing a reset, then I have to remove all the GPU's set up the BIOS again and then put the GPU's back...sigh.

it plauges miners too, just because it has the pci-e slots, doesn't mean it can take more than 4 cards(natively). lol

[tictoc]

Make sure you have Above 4G encoding enabled in the BIOS.

53 minutes ago, ENTERPRISE said:

 

Great suggestions, im tired so not thinking, will give that a go. That being said...what a ball ache if the CMOS resets or if there is a power outage causing a reset, then I have to remove all the GPU's set up the BIOS again and then put the GPU's back...sigh.

 

That board should allow you to save BIOS profiles to a USB stick.  Then It's just a matter of loading the profile from the USB if you have to clear the CMOS.

[ENTERPRISE]

1 minute ago, tictoc said:

Make sure you have Above 4G encoding enabled in the BIOS.

 

That board should allow you to save BIOS profiles to a USB stick.  Then It's just a matter of loading the profile from the USB if you have to clear the CMOS.

 

Yeah, that would be fine. The issue is that when the CMOS resets, it sits there like a dumb brick, as in nothing on the monitor as it will not boot any further and will not allow you into the BIOS to load in a profile

[Sgt_Swanny]

[tictoc]

1 hour ago, ENTERPRISE said:

 

Yeah, that would be fine. The issue is that when the CMOS resets, it sits there like a dumb brick, as in nothing on the monitor as it will not boot any further and will not allow you into the BIOS to load in a profile

 

Without a BMC, initial setup will probably be a bit painful, with a whole bunch of connecting and disconnecting.  Once you have everything set up definitely save the profile, and then never update the BIOS.

 

As far as cooling goes, I would swap the out the AIO for a something like a NH-C14S if you have the clearance.  If not, you could punch some holes in the side of the case and mount the AIO in the bottom of the chasis.  With the AIO out of the way you will have proper front to back airflow, and with 3-4k+ RPM fans you can probably keep the GPUs from throttling.  It's not going to be quiet, but it can be done.  If that's not an option, then I would hunt around on ebay for some 980ti/titan heat-sinks. https://www.ebay.com/itm/154408987068    

[Avacado]

4 hours ago, tictoc said:

As far as cooling goes, I would swap the out the AIO for a something like a NH-C14S if you have the clearance.  If not, you could punch some holes in the side of the case and mount the AIO in the bottom of the chasis.  With the AIO out of the way you will have proper front to back airflow, and with 3-4k+ RPM fans you can probably keep the GPUs from throttling.  It's not going to be quiet, but it can be done.  If that's not an option, then I would hunt around on ebay for some 980ti/titan heat-sinks. https://www.ebay.com/itm/154408987068    

Unfortunately the above isn't possible. I tried 3k RPM fans with very little obstruction. No matter the CFM, not enough air gets directed over the passive heatsinks. The tiny fans I sent E will keep the GPU's below 70c guaranteed. The amount of Db's he is willing to endure is another story.