cfp ExtremeHW Community Folding Project

[ENTERPRISE]

@Avacado Never played with the Tesla cards, but assuming proper cooling, can you put these under OC ?

[Avacado]

58 minutes ago, ENTERPRISE said:

@Avacado Never played with the Tesla cards, but assuming proper cooling, can you put these under OC ?

You absolutely can. They register in afterburner. Though I have been so busy getting them running I haven't really played with them. Though at close to 1mil ppd stock, I don't know how far I would want to push them.

[ENTERPRISE]

2 hours ago, Avacado said:

You absolutely can. They register in afterburner. Though I have been so busy getting them running I haven't really played with them. Though at close to 1mil ppd stock, I don't know how far I would want to push them.

 

Nice I was hoping you were going to say that. Hmmm well the thing is you would have to make profiles for 6 cards as obviously they will not all clock the same, so that is another pain. Will see how I get on first at stock etc and possibly consider OC somewhere down the line.

[BWG]

If, and only if, you're not going to continue folding, expand this:

 

Spoiler

Please remember to click finish and complete the work assigned to you so you do no ruin your Quick Return Bonus for future events.

 

 

Edited February 25, 2021 by BWG

[ENTERPRISE]

Oh jeez

[BWG]

8 minutes ago, ENTERPRISE said:

Oh jeez

 

Got some fittings, temp probes, and plugs coming tomorrow for both loops. Going down for prep. 

[ENTERPRISE]

12 hours ago, BWG said:

 

Got some fittings, temp probes, and plugs coming tomorrow for both loops. Going down for prep. 

 

Make Frankenstein live !

[Avacado]

Alright, so need the help of some Ryzen/Threadripper experts here. The open air Tesla rigs had been folding beautifully until 2 days ago. They just lock up, leaving the image on screen, but being unresponsive, no BSOD (I don't think it's the cards). I have set 3500MHz on both TR's and am running RAM well below rated specs, so temps aren't the issue. I don't think it is power, because the 5 cards only draw about 200w each and I have more than enough PSU/ Wall amperage capacity. Anyone have any inclining?

 

Besides doing a fresh windows install and new FAH client to alleviate possible corrupt drivers/software, I can't figure out where to start here. 

 

- Will do clean installs. If does not work will,

 

- Drop both down to 4 cards each. If does not work will,

 

- Rip my effing hair out. At this point, could be the risers. The bifurcation card did NOT work on the ROG-e. 

 

I can't wrap my head around it working during the FaT flawlessly, to locking up with no settings modifications. Any thoughts? Anyone have solid AIR settings for Threadrippers I can use? I really think it is CPU/BIOS settings or PCI-e lane allocation. 

 

I did pick up a Gigabyte Designaire which i'll try I suppose (It has 5x 16x Slots). The more I play with these boards, the more I regret not going the X99 route with a 2xxx Intel chip. 

 

*Edit I have ordered new RAM, which is verified on the QVL list here:

 

https://dlcdnets.asus.com/pub/ASUS/mb/socketTR4/ROG_STRIX_X399-E_GAMING/ROG_Strix_X399-E_memory_QVL_For2ndGenRyzenThreadripperCPU.pdf

 

Gskill. 

 

https://www.newegg.com/g-skill-32gb-288-pin-ddr4-sdram/p/N82E16820232482?Item=N82E16820232482

 

I am thinking the RAM I originally bought does not work with my TR's. 

 

https://www.newegg.com/g-skill-64gb-288-pin-ddr4-sdram/p/N82E16820232327?Item=N82E16820232327

 

Sucks because that was 400$ and I can't return them. 

 

 

Edited March 6, 2021 by Avacado

[ENTERPRISE]

1 hour ago, Avacado said:

Alright, so need the help of some Ryzen/Threadripper experts here. The open air Tesla rigs had been folding beautifully until 2 days ago. They just lock up, leaving the image on screen, but being unresponsive, no BSOD (I don't think it's the cards). I have set 3500MHz on both TR's and am running RAM well below rated specs, so temps aren't the issue. I don't think it is power, because the 5 cards only draw about 200w each and I have more than enough PSU/ Wall amperage capacity. Anyone have any inclining?

 

Besides doing a fresh windows install and new FAH client to alleviate possible corrupt drivers/software, I can't figure out where to start here. 

 

- Will do clean installs. If does not work will,

 

- Drop both down to 4 cards each. If does not work will,

 

- Rip my effing hair out. At this point, could be the risers. The bifurcation card did NOT work on the ROG-e. 

 

I can't wrap my head around it working during the FaT flawlessly, to locking up with no settings modifications. Any thoughts? Anyone have solid AIR settings for Threadrippers I can use? I really think it is CPU/BIOS settings or PCI-e lane allocation. 

 

I did pick up a Gigabyte Designaire which i'll try I suppose (It has 5x 16x Slots). The more I play with these boards, the more I regret not going the X99 route with a 2xxx Intel chip. 

 

*Edit I have ordered new RAM, which is verified on the QVL list here:

 

https://dlcdnets.asus.com/pub/ASUS/mb/socketTR4/ROG_STRIX_X399-E_GAMING/ROG_Strix_X399-E_memory_QVL_For2ndGenRyzenThreadripperCPU.pdf

 

Gskill. 

 

https://www.newegg.com/g-skill-32gb-288-pin-ddr4-sdram/p/N82E16820232482?Item=N82E16820232482

 

I am thinking the RAM I originally bought does not work with my TR's. 

 

https://www.newegg.com/g-skill-64gb-288-pin-ddr4-sdram/p/N82E16820232327?Item=N82E16820232327

 

Sucks because that was 400$ and I can't return them. 

 

 

 

Have you tried running the system fully stock. No OC ? I know it seems like the obvious thing but whenever I diagnose these issues I drop all Overclocks to remove that as a factor immediately and see if the behaviour continues. Have you also locked your CPU base clock to 100Mhz? Sometime any variation in that can cause PCIe instability. I have noticed some systems (Mainly Ryzen) adjust the base clock if set to auto, not sure if it is something to do with the behaviour of PBO. Worth possibly manually setting this to 100 so the BIOS/PBO do not get any ideas. 

 

I can also vouch for that G.SKILL RAM as that was my prior very well serving kit on my Ryzen systems (Including TR) prior to upgrading to 64GB. Not that I would encourage it while you are diagnosing issues, but you can get that kit up to 3600/3800.

 

Lastly, do you have the latest BIOS with latest AGESA for your motherboard ?

[Avacado]

1 hour ago, ENTERPRISE said:

 

Have you tried running the system fully stock. No OC ? I know it seems like the obvious thing but whenever I diagnose these issues I drop all Overclocks to remove that as a factor immediately and see if the behaviour continues. Have you also locked your CPU base clock to 100Mhz? Sometime any variation in that can cause PCIe instability. I have noticed some systems (Mainly Ryzen) adjust the base clock if set to auto, not sure if it is something to do with the behaviour of PBO. Worth possibly manually setting this to 100 so the BIOS/PBO do not get any ideas. 

 

I can also vouch for that G.SKILL RAM as that was my prior very well serving kit on my Ryzen systems (Including TR) prior to upgrading to 64GB. Not that I would encourage it while you are diagnosing issues, but you can get that kit up to 3600/3800.

 

Lastly, do you have the latest BIOS with latest AGESA for your motherboard ?

Yes. No OC at all, actually a manual underclock or manual base clock. FCLK is locked at 100MHz. I am really hoping it is just the RAM causing instability, as I have now spent 800$ on RAM in the past 2 months. 

 

Pretty sure I have the latest BIOS, but will double check. 

[ENTERPRISE]

29 minutes ago, Avacado said:

Yes. No OC at all, actually a manual underclock or manual base clock. FCLK is locked at 100MHz. I am really hoping it is just the RAM causing instability, as I have now spent 800$ on RAM in the past 2 months. 

 

Pretty sure I have the latest BIOS, but will double check. 

 

Personally I am thinking it is not a RAM issue, just a gut on this one. I would imagine it is something to do with the BIOS and bifurcation. That being said, when you get your RAM, be sure to run a full pass of MemtestX86 on it. I do this when diagnosing and for new RAM. I also especially use it for validating overclocks. 

[Avacado]

Alright, so here it is. the Srtix-e DID need a BIOS update and I have done that. It does seem to be more responsive after. I have done a fresh FAH install and the below is after 10 minutes. Temps good, CPU locked in at 3800. I swear to god if this thing locks up, i'm going to fight an elderly person.

 

[ENTERPRISE]

16 minutes ago, Avacado said:

Alright, so here it is. the Srtix-e DID need a BIOS update and I have done that. It does seem to be more responsive after. I have done a fresh FAH install and the below is after 10 minutes. Temps good, CPU locked in at 3800. I swear to god if this thing locks up, i'm going to fight an elderly person.

 

 

Will keep the fingers crossed, let's just hope that a BIOS update has left you with a stable system. I am not sure what the release notes were with your BIOS but I am sure they tweak with more items than what they put in the release notes, so sometimes trying a new BIOS even if your problem is not explicitly states, is worth a shot.

[Bastiaan_NL]

2 hours ago, Avacado said:

Alright, so here it is. the Srtix-e DID need a BIOS update and I have done that. It does seem to be more responsive after. I have done a fresh FAH install and the below is after 10 minutes. Temps good, CPU locked in at 3800. I swear to god if this thing locks up, i'm going to fight an elderly person.

Fingers crossed for you, I hope everything works like it should! (also for the sake of that elderly person...)

 

2 hours ago, ENTERPRISE said:

"I am sure they tweak with more items than what they put in the release notes"

Exactly my thoughts.

[ENTERPRISE]

Small update to the CFP V2.0 

 

So the motherboard fits in the Xcase Mining Case. However the PSU I had will no longer fit due to the motherboards CEB form factor. So I will be purchasing a smaller PSU to fit. Which means after testing I will sell the EVGA G2 1300Watt PSU.

 

Corsair will also kindly be providing a 1000Watt PSU as the secondary power supply, kudos to them for that.

 

Furthermore I have purchased a GeForce 710 that will act as the systems interface card as the Tesla M40's have no output ports, so that is covered. Though I am going to mod this case to allow the ports to show out of the case as you would have normally, just makes life easier for management. Also purchased a WD Blue 500GB SSD for the OS.

 

Due to space limitations between CPU IHS and the bottom of the folding GPU's, a decent air cooler will not be viable, so will be going for a 360mm AIO to satisfy that requirement.

 

Will create a build thread for this soon with all the details. Just a small update for now. 

[Bastiaan_NL]

Nice update E!

Thanks to Corsair for providing the PSU
Good to hear the motherboard fits, but it's a big boy so no wonder some things have to be changed so everything fits.

What are you going to use to switch on the second PSU, an extension cable with the green and black wired to another 24 pin or one of those devices that plug into a 4pin molex?

I'll be using a 360 AIO on the 10900x too, good way to keep it cool and use it as an intake/exhaust at the same time.

I'm looking forward to the build thread, more pics!

[ENTERPRISE]

8 minutes ago, Bastiaan_NL said:

Nice update E!

Thanks to Corsair for providing the PSU
Good to hear the motherboard fits, but it's a big boy so no wonder some things have to be changed so everything fits.

What are you going to use to switch on the second PSU, an extension cable with the green and black wired to another 24 pin or one of those devices that plug into a 4pin molex?

I'll be using a 360 AIO on the 10900x too, good way to keep it cool and use it as an intake/exhaust at the same time.

I'm looking forward to the build thread, more pics!

 

I will be using the standard 24pin ATX cable with a split off to jump the second PSU

 

Yeah the AIO will use a push/pull config in order to help push air from the AIO through the case to the rear. Likely aiming for the EK- Basic AIO 360mm, should do the job nicely and not nuts on cost.

[Avacado]

Think  i'm going to fight that elderly person. I can't figure out why the system is locking up. Going to have to do a wipe and try again. 

[ENTERPRISE]

2 hours ago, Avacado said:

Think  i'm going to fight that elderly person. I can't figure out why the system is locking up. Going to have to do a wipe and try again. 

 

Hmm poor elderly people. Will have to let you know how I get on

[Avacado]

11 hours ago, ENTERPRISE said:

 

Hmm poor elderly people. Will have to let you know how I get on

Please do.