LTT Folding Team's Emergency Response to Covid-19

[LAR_Systems]

6 minutes ago, ConceptOW said:

Sad to see this event ending. When will we see final results?

Once @GOTSpectrum has had a chance to settle in and figure out what drink to make.

[RedCom]

48 minutes ago, Metallus97 said:

So how much points did that produce and for which instances and GPUs did you go?

Overall, it was worth around 26M points. Around 870K PPD per card.

 

3 instances of 4 vCPUs and 5GB of RAM with Tesla T4s. I wanted one vCPU per GPU, in hindsight I'm not sure if that was even necessary. I didn't really test it out with less CPUs. Although on the 4 card instances, CPU usage is around 80%, so perhaps it was a good call.

 

Could have gone to 12 cards, as each instance maxes out at 4, but I calculated that 10 GPUs over 3 VMs would use up the credit pretty close to the end of the event. I wasn't far off.

 

 

[Dutch_Master]

22 minutes ago, GalaxyNetworks said:

The web interface should look like this: (GPU 7 has finished and is paused)

 

 

20 minutes ago, Gorgon said:

I have 6 linux boxes and they're all headless so I normally just used teh Advanced Control app on my Windows Daily Driver to control all the slots.

 

Normally I run a cron job on the systems to set the GPU slots to finish about 2 1/2 hours before my electricity rate doubles and then use:

/usr/bin/FAHClient --send-unpause

to restart the slots when the electricity rate drops down.

 

You can also telnet into the host on 36330 and access the command server directly but you have to enable remote access (see link in sig) first.

Thanks guys! I now see what I missed earlier: the spinning circle on a working system is green, but after I ordered it to finish it turned yellow: I'd missed that previously So I should be good for these boxes to finish their WUs and stop. After which they'll be decommissioned until such time their services are called upon again. Which for one could be fairly soon as it has 2 network ports and I'm interested in experimenting with PFSense. But that's not for this thread

[Metallus97]

8 minutes ago, RedCom said:

Overall, it was worth around 26M points. Around 870K PPD per card.

 

3 instances of 4 vCPUs and 5GB of RAM with Tesla T4s. I wanted one vCPU per GPU, in hindsight I'm not sure if that was even necessary. I didn't really test it out with less CPUs. Although on the 4 card instances, CPU usage is around 80%, so perhaps it was a good call.

 

Could have gone to 12 cards, as each instance maxes out at 4, but I calculated that 10 GPUs over 3 VMs would use up the credit pretty close to the end of the event. I wasn't far off.

 

 

THATS some power, but I guess a bit more CPU could have helped push them a bit more. I saw 950 on those cards some times.

 

I had even less time because I opted for V100... close to 1,8m PPD but not so nice price to performance 

[ObeliskAG]

15 minutes ago, Inkertus said:

Your power meter have a stroke there or...?

My daughter made soup from scratch for lunch.

 

It is cool/creepy seeing the little dips in power consumption as GPUs finish and start WUs.

[ffbr]

4 minutes ago, Metallus97 said:

THATS some power, but I guess a bit more CPU could have helped push them a bit more. I saw 950 on those cards some times.

 

I had even less time because I opted for V100... close to 1,8m PPD but not so nice price to performance 

I had one V100 that was golden, it consistently pulled 3m PPD during the whole week. No idea why it was outperforming so much the others but that was nice

[RedCom]

12 minutes ago, Metallus97 said:

THATS some power, but I guess a bit more CPU could have helped push them a bit more. I saw 950 on those cards some times.

 

I had even less time because I opted for V100... close to 1,8m PPD but not so nice price to performance 

Yep, I noticed that the $/hr cost went up quite steeply for the V100.

 

The Tesla T4 performance is quite good considering it's a low-profile low-TDP card. Think it's only rated at 75W.

[Gustavehomme01]

For the love of all that is good can i stop getting project 14541 on my main rig.

poor little RX590 has no luck with it the past 2 days.

0 for 4 

[Zberg]

So if midnight is the end, thats midnight for Spec right?  So 20:00 eastern US time?

[jctappel67]

Just cracked the top 8000 overall, which is good, because I have to turn off about 75% of my production at the end of this event.

[HaRdLy007]

Do idle GC instances incur cost?

[jctappel67]

1 minute ago, HaRdLy007 said:

Do idle GC instances incur cost?

Paused or downloading?

 

[HaRdLy007]

Just now, jctappel67 said:

Paused or downloading?

 

Paused I guess. Just sitting idle, not doing anything.

[Gustavehomme01]

5 minutes ago, Gustavehomme01 said:

For the love of all that is good can i stop getting project 14541 on my main rig.

poor little RX590 has no luck with it the past 2 days.

0 for 4 

REALLY????

And what do i get right after the failed WU another 14541.  It really what's me to try and try again until it works..

[LAR_Systems]

1 minute ago, HaRdLy007 said:

Paused I guess. Just sitting idle, not doing anything.

If the server / virtual machine is running... you are being billed.

[Inkertus]

21 minutes ago, ObeliskAG said:

My daughter made soup from scratch for lunch.

 

It is cool/creepy seeing the little dips in power consumption as GPUs finish and start WUs.

Guessing electric stove then.  Crazy how power hungry those are.

[jctappel67]

Unless you or google stopped the instance. Then you are paying.

 

To stop paying you need to hit pause here:

[Alex Atkin UK]

5 hours ago, Kyouki_IE said:

That probably would have been easier than logging into my two computers with teamviewer at regular intervals

That's literally what FAHControl is for, although it doesn't summarise everything as nicely.

[Shlouski]

2 hours ago, LFreeman said:

To anyone just behind me in points, ya'll might just get lucky. I may have to shut off the main in about an hour. Trying to install a few new outlets and circuit. Never done this before so wish me luck. 

Was right behind you on day 11, but I had power cuts the next day which halved my points. Today and yesterday have been really good so I will be interesting to see if I was able to pass you, I should end up with almost 70mil by the end.

 

Wouldn't mind passing GOTSpectrum also

 

[NetoriusNick]

unless they are something wierd I'm getting WU acks in the future

[Gustavehomme01]

Well I shouldn't complain about getting 14541 it is for COVID-19 i just don't get it, I haven't changed anything and since yesterday it seem to fail on every 14541 WU...

 

Anybody know what they do with the collected date from failed WU? hopefully there is something that's useful. It be a shame if it's all for not. Not even mad about the point as I've got some cloud instances going on for points, plus I need a heater right now the temps just dived and it's snowing.. 

[jctappel67]

Unfortunately my 2070S won't be here in time to help in the event... but I'll let it fold overnight anyways!

[cbigfoot]

4 minutes ago, jctappel67 said:

Just cracked the top 8000 overall, which is good, because I have to turn off about 75% of my production at the end of this event.

- ditto my 7775 is set to finish its folds then its retired,

- my r7-350 is doing its last fold...ever...

- bender will get its rx580 removed after the next unit as Flexo needs it  But not till the next event...

- all my laptops are set to finish.  my gaming ring will be set to finish at 7PM CST...

 

Flexo is a Dell studio xps 7100 chassis

a Gigabyte GA-A75M-UD2H

A AMD A8-3850 APU

8GB DDR3-1600

128 GB Samsung 840 EVO (man all the folds i can store...

and 1 120MM exaust Fractal design fan and 1 Delta 120 MM intake...Professionally installed (1 screw for the rear as its a 90mm slot but its angled to use the io shield opening and 2 zip ties for the delta.)

a dell 420 Watt PSU

 

Sorry @Zberg its your fault i started watching futurama again...

[walderston]

17 minutes ago, Zberg said:

So if midnight is the end, thats midnight for Spec right?  So 20:00 eastern US time?

The below says 19:00

 

Note the UK is now on BST (UTC +1)

 

https://www.timeanddate.com/worldclock/converter.html?iso=20200409T225900&p1=136&p2=tz_et

[chaozbandit]

16 minutes ago, Gustavehomme01 said:

REALLY????

And what do i get right after the failed WU another 14541.  It really what's me to try and try again until it works..

 

 

I feel you. One of my 290s finished a 14541 properly, the other one got halfway through 3 and kept getting assigned 14541 all day. RIP.