LTT Official Folding Month 2018!!!

[Gorgon]

8 minutes ago, sazrocks said:

I'll try firing up a Ubuntu VM that I have around somewhere and see if it improves things.

unRAID. Full specs are in my sig.

 

I'll try that docker container, thanks.

 

Any Idea what kind of perf uplift I can expect?

    nvidia-smi -i 0 -pm 1 (be persistent or power limit wont stick between runs)
    nvidia-smi -i 0 --power-limit=210 (whatever the max is for your card)
    DISPLAY=:0 XAUTHORITY=/run/user/122/gdm/Xauthority nvidia-settings -a [gpu:0]/GPUFanControlState=1 (manual fan control)
    DISPLAY=:0 XAUTHORITY=/run/user/122/gdm/Xauthority nvidia-settings -a [fan:0]/GPUTargetFanSpeed=70 (or higher)
    DISPLAY=:0 XAUTHORITY=/run/user/122/gdm/Xauthority nvidia-settings -a [gpu:0]/GPUGraphicsClockOffset[3]=182 (start lower - say 75 and bump it up)
    DISPLAY=:0 XAUTHORITY=/run/user/122/gdm/Xauthority nvidia-settings -a [gpu:0]/GPUMemoryTransferRateOffset[3]=800 (this should be a good start)

 

to monitor:

 

nvidia-smi -i 0 -l 1 --format=csv,noheader --query-gpu=temperature.gpu,power.draw,clocks.current.sm,fan.speed

 

 

[Gorgon]

5 minutes ago, King Poet said:

Check your logs... turns out one of my rigs decided to try to submit WUs through a dead Hamachi adapter and hasn't sent it anything in 3 days even through it reports PPD via the app.

 

 

Wonderful.

Ouch - Your still in first place though the competition is heating up.

[Guest]

Just now, Gorgon said:

Ouch - Your still in first place though the competition is heating up.

That Tommerrs dude is doing like 8 Mil PPD, no way that's going to last.

 

[GOTSpectrum]

3 minutes ago, King Poet said:

That Tommerrs dude is doing like 8 Mil PPD, no way that's going to last.

 

Will be interesting to see if it does.

[Guest]

14 minutes ago, Ben Quigley said:

Will be interesting to see if it does.

I hope my lead doesn’t last. More points is good for the team. A few days ago we were 4 months from moving up a team rank. Now it’s 2.5. I’d love to see that turn into 1 month. 

[sazrocks]

7 minutes ago, King Poet said:

I hope my lead doesn’t last. More points is good for the team. A few days ago we were 4 months from moving up a team rank. Now it’s 2.5. I’d love to see that turn into 1 month. 

Based on current numbers (last 24hr of 135mil vs 24hr avg of 98 mil) we should pass Max PC in ~35 days, less if we trend upward more. I want to see LTT hit the top 10.

 

Daily production is 4.5x what it was a month ago, which is crazy. Hopefully we can keep it up there.

 

EDIT I guess my calculations also mean we are on track for a 3,000,000,000 November. Dang.

[GOTSpectrum]

With sign ups closed we are expecting to have the data-entry automated and these issues resolved btw guys. It was hard having an ever growing sheet. With the way google forms inputted the data it was practically impossible to have any decent level of automation we have waited until now! 

 

I'm sill validating data entries, pulled yet another all nighter to get this done, its not perfect but we should be in the ballpark. Also bear in mind that the daily updates are really just to validate who is folding for the 15 day participation requirement. 

[GOTSpectrum]

44 minutes ago, sazrocks said:

Based on current numbers (last 24hr of 135mil vs 24hr avg of 98 mil) we should pass Max PC in ~35 days, less if we trend upward more. I want to see LTT hit the top 10.

 

Daily production is 4.5x what it was a month ago, which is crazy. Hopefully we can keep it up there.

 

EDIT I guess my calculations also mean we are on track for a 3,000,000,000 November. Dang.

The highest we've ever been as far as i know of is 12. An interesting point is LTT has always punched way above its weight class when it comes to number of folders vs points production. We have really been maintained by a smaller number of high producing individuals. 

[GOTSpectrum]

8 hours ago, leadeater said:

Wait so my CPU folding is dong 866k PPD?!? Wow way more than I was expecting, damn should have gotten the other servers going. Probably could have gotten over 2M PPD CPU folding if that figure is correct.

I've been through and validated your data, both totals and productions amounts are correct, according to EOC servers at least. One possible reasoning could be the Stanford servers hiccup they had on days two and three messing up some of the data. Unfortunately, we can only go by what is provided to us. I hope this helps to explain it on some way. 

[Cereal5]

Halp

 

Ok so I've been having some trouble with my GTX 1080 Founders Edition card. I'm OCed to 2000 MHz Core (+85) and 5258 MHz memory (+250). The card is manually limited to 80C so it bounces around from 1850-1950 usually (it's 50F outside and I've had the AC running for the past 7 days LOL). Anyways the problem I'm having is the memory will sometimes randomly downclock by 500MHz and not clock back up until I reset the OC in MSI Afterburner and then re-OC it. It's possible this is a bug in the version I'm using, I think there is an update... However I'm having trouble figuring out the scenario it occurs in, because it's seemingly random, and every time it's happened I haven't been watching to see if anything is interfering. I'm kinda at a loss.

[GOTSpectrum]

1 minute ago, Cereal5 said:

Halp

 

Ok so I've been having some trouble with my GTX 1080 Founders Edition card. I'm OCed to 2000 MHz Core (+85) and 5258 MHz memory (+250). The card is manually limited to 80C so it bounces around from 1850-1950 usually (it's 50F outside and I've had the AC running for the past 7 days LOL). Anyways the problem I'm having is the memory will sometimes randomly downclock by 500MHz and not clock back up until I reset the OC in MSI Afterburner and then re-OC it. It's possible this is a bug in the version I'm using, I think there is an update... However I'm having trouble figuring out the scenario it occurs in, because it's seemingly random, and every time it's happened I haven't been watching to see if anything is interfering. I'm kinda at a loss.

It sounds like your card is changing power states, I liked to the bitcoin forums earlier with a post that gives a way to lock the power state to p2(the highest on pascal). Give that a try and then let me know how you get on. 

[leadeater]

2 minutes ago, Ben Quigley said:

I've been through and validated your data, both totals and productions amounts are correct, according to EOC servers at least. One possible reasoning could be the Stanford servers hiccup they had on days two and three messing up some of the data. Unfortunately, we can only go by what is provided to us. I hope this helps to explain it on some way. 

Thanks, just got suspicious something was up when the numbers were exactly the same which is rather unlikely. I'm still amazed how much PPD I'm getting out of just 3 old (Sandy Bridge-EP) dual socket servers.

 

First is CPU plus my GPUs, last 3 is just those servers.

[sazrocks]

Just now, leadeater said:

Thanks, just got suspicious something was up when the numbers were exactly the same which is rather unlikely. I'm still amazed how much PPD I'm getting out of just 3 old (Sandy Bridge-EP) dual socket servers.

 

First is CPU plus my GPUs, last 3 is just those servers.

Holy crap, how many cores are these servers?

[GOTSpectrum]

me and @Gorgon are just finishing up the validation then I will get onto the blog post for you guys, 

2 minutes ago, leadeater said:

Thanks, just got suspicious something was up when the numbers were exactly the same which is rather unlikely. I'm still amazed how much PPD I'm getting out of just 3 old (Sandy Bridge-EP) dual socket servers.

 

First is CPU plus my GPUs, last 3 is just those servers.

If you can see anything else that seems off to you can you PM it to me so I can before I write the next update? 

[leadeater]

1 minute ago, sazrocks said:

Holy crap, how many cores are these servers?

E5-2667 are lower core count high frequency, only 6 cores per CPU. So total of 36 cores all up. It's possible long term that I could leave 6 or 8 of these going indefinitely, upgrading as servers get decommissioned. Got another 40 ish servers coming out in the next 6 months and most of those are dual E5-2690v3/v4

[Cereal5]

1 minute ago, leadeater said:

E5-2667 are lower core count high frequency, only 6 cores per CPU. So total of 36 cores all up. It's possible long term that I could leave 6 or 8 of these going indefinitely, upgrading as servers get decommissioned. Got another 40 ish servers coming out in the next 6 months and most of those are dual E5-2690v3/v4

I'll take 2 please 

[leadeater]

3 minutes ago, Cereal5 said:

I'll take 2 please 

Not even I'm allowed to take them, your dreamin .

 

If I could I'd probably have a nice side hosting business or something lol.

[Cereal5]

1 minute ago, leadeater said:

Not even I'm allowed to take them, your dreamin .

 

If I could I'd probably have a nice side hosting business or something lol.

Seriously, imagine how many minecraft servers you could run

[GOTSpectrum]

3 minutes ago, leadeater said:

Not even I'm allowed to take them, your dreamin .

 

If I could I'd probably have a nice side hosting business or something lol.

I'm confused, if you can't take them how are you going to be updating then as you go on folding? Have I misread something?

[leadeater]

2 minutes ago, Ben Quigley said:

I'm confused, if you can't take them how are you going to be updating then as you go on folding? Have I misread something?

We have spare racks, just going to leave them running at work. If they need to be used for other dev work then they'll just do that until finished etc. It's not like we're short on servers though and power is basically free.

[Gorgon]

3 minutes ago, leadeater said:

Not even I'm allowed to take them, your dreamin .

 

If I could I'd probably have a nice side hosting business or something lol.

Yeah ours have their HDDs physically destroyed (into pellets) and the chassis get sold at auction for like $0.15/lb. Makes me cry. But then I couldnt afford the power, ups, a/c and other infrastructure or she that must be obeyed complaining about the noise.

When I built my FreeNAS build in a Define R4 I connected the bright blue power light to the HDD/LAN/Sys Error connector on the SuperMicro Mobo 'cause it was too bright.

When her majesty walked by it one day and noticed it she asked me when I was going to throw that old computer away and was surprised when I informed her that was where her friend Mr. Plex lived.

[Gorgon]

5 minutes ago, Ben Quigley said:

I'm confused, if you can't take them how are you going to be updating then as you go on folding? Have I misread something?

OK Ben I've cleaned up the mess I made - stop chatting and get to work!

 

My lab is giving me those sad eyes and wants to try to hog the couch with me.

[leadeater]

2 minutes ago, Gorgon said:

When her majesty walked by it one day and noticed it she asked me when I was going to throw that old computer away and was surprised when I informed her that was where her friend Mr. Plex lived.

Watch out, she's standing right behind you reading what you write!

 

[Gorgon]

Just now, leadeater said:

Watch out, she's standing right behind you reading what you write!

 

Nah,

 

we've been married almost 20 years. She goes to bed at like 8pm and even so we're honest with each other. Earlier on in our marriage she raised her eyebrow at a new camera bag I bought for a trip to Greece. I just looked at her and said  "but dear, how many purses do you have?" That made her think. She came back from one Black Friday road trip to NYC with her sister once and proudly showed me a Coach purse and stated "Wow, I can't believe I only paid $400US for this" The camera bag in question was only $250 and I still use it.

 

Different priorities. I buy big toys a couple of times a year and she buys lots of little ones.

[GOTSpectrum]

Just now, Gorgon said:

Nah,

 

we've been married almost 20 years. She goes to bed at like 8pm and even so we're honest with each other. Earlier on in our marriage she raised her eyebrow at a new camera bag I bought for a trip to Greece. I just looked at her and said  "but dear, how many purses do you have?" That made her think. She came back from one Black Friday road trip to NYC with her sister once and proudly showed me a Coach purse and stated "Wow, I can't believe I only paid $400US for this" The camera bag in question was only $250 and I still use it.

 

Different priorities. I buy big toys a couple of times a year and she buys lots of little ones.

And toys are always a good think