LTT Folding Team's Emergency Response to Covid-19

[Zonker]

9 hours ago, mattheginger said:

 

What sort of GPU temps do you get with that configuration? Those are 2.7 slot cards right? 

I believe they are, you'd have to look it up. Both have been foding away happily for awhile now and the average temp/fan speeds are:

#0 78C/92%

#1 83C/100%

[Arrogath]

anyone miss any days due to upload issues and lack of WU? Closest I came was a 1 WU day near the start so far

[Zonker]

1 to 1.5 exoFLOPS? That's like 10x faster than the IBM Summit! The human beings working on this project must have way more data than they can possibly sift through alone. This amount of computing power is astounding. I've done some research and listed all 'supercomputers' since 1943 and here are the last (and fastest) 5:

2012    16.32 PFLOPS    IBM Sequoia California, USA

2012    17.59 PFLOPS    Cray Titan Tennessee, USA

2013    33.86 PFLOPS    NUDT Tianhe-2 Guangzhou, China

2016    93.01 PFLOPS    Sunway TaihuLight Wuxi, China

2018    143.5 PFLOPS    IBM Summit Tennessee, USA

 

https://www.extremetech.com/computing/308332-foldinghome-crushes-exascale-barrier-now-faster-than-dozens-of-supercomputers

 

[jctappel67]

Finally got a big boi WU for my GPU

Lets go!!!

[StroopFX]

1 hour ago, Bitter said:

My Vega56 and RX 580 are also doing this, I think it's probably normal and may be the task pausing for a moment to save state or do some kind of redundancy check?

 

50 minutes ago, hydrochloric said:

I'm like 98% sure that's F@H doing its "checkpoint" saves.  It should be every 15 minutes by default.

 

Thanks!  That's a releif.

 

 

[Ayren]

4 minutes ago, jctappel67 said:

Finally got a big boi WU for my GPU

Lets go!!!

14543 is a neat one. nice and stable while giving good points 

[nukiuchi]

I was struggling for WUs until yesterday as well, I managed to get 2-3 usually. Yesterday it finally turned around and I was able to fold almost all day.  Rose back to top-1000 which is nice, first 4 days were spent in falling behind.

 

I also noticed that I started getting WUs not related to the malware now, and they're worth a lot more (maybe twice the processing needed, but around three times the points). Too bad corona is not selectable or enforceable for this session, though not sure if that's even the point.

[RankUpGamers]

 

Current Status

[Dylanc1500]

13 minutes ago, jctappel67 said:

Finally got a big boi WU for my GPU

Lets go!!!

Wait till you get one that is 80,000 base. What was the download size of that WU?

[jctappel67]

6 minutes ago, Dylanc1500 said:

Wait till you get one that is 80,000 base. What was the download size of that WU?

It was only 38.41 MiB. I want an 80,000 base project so bad. Little need to check on my client for 4+ hours sounds nice.

[madprofessor207]

We shifted the scale...again.

 

Spoiler

 

[GOTSpectrum]

1 minute ago, madprofessor207 said:

We shifted the scale...again.

 

 

The folding months look like wee babies!

[Dylanc1500]

2 minutes ago, jctappel67 said:

It was only 38.41 MiB. I want and 80,000 base project so bad. Little need to check on my client for 4+ hours sounds nice.

Well you can set it to big work units. The last one I downloaded was 189MiB.

[Ayren]

7 minutes ago, jctappel67 said:

It was only 38.41 MiB. I want an 80,000 base project so bad. Little need to check on my client for 4+ hours sounds nice.

the 80k workloads ive had were 181MB and took me a bit more than 5h to finish with fairly balanced ppd. The ram usage though is qute something: 2.5 GB per GPU

[SirPhantom]

10 hours ago, Daniel_SC said:

AAARRGHHH!! This is a little bit infuriating. Folding all day, numerous GPU WU's, many CPU WU's but most of didn't register any points.No upload errors in log...

  Reveal hidden contents

Me too buddy... Me too...

 

One of my WU's hit my stats last night, the two earlier ones are still not showing, one has been done for over 26 hours now 

[nukiuchi]

 

We're also the largest team now by daily production.  And weekly too!

[Daniel_SC]

1 minute ago, SirPhantom said:

 

One of my WU's hit my stats last night, the two earlier ones are still not showing, one has been done for over 26 hours now 

I am doing a bit of an investigation in my logs atm, since this bothers me more than it should... I think I've found som issues...

[GrockleTD]

10 minutes ago, GOTSpectrum said:

The folding months look like wee babies!

Huzzah!

[GOTSpectrum]

4 minutes ago, GrockleTD said:

Huzzah!

Well... Let's just hope folding month 2020 is a good un! 

 

Will be the first chance for us vets to level up our event badges too! (not you though)

[leadeater]

Just now, GOTSpectrum said:

Well... Let's just hope folding month 2020 is a good un! 

 

Will be the first chance for us vets to level up our event badges too! (not you though)

Somehow I'm stuck at level 0, so odd.

[GOTSpectrum]

1 minute ago, leadeater said:

Somehow I'm stuck at level 0, so odd.

CAUSE YOU DONT LIKE THE BLING!

[GrockleTD]

4 minutes ago, GOTSpectrum said:

Well... Let's just hope folding month 2020 is a good un! 

 

Will be the first chance for us vets to level up our event badges too! (not you though)

meanie!

[GOTSpectrum]

1 minute ago, GrockleTD said:

meanie!

I know without looking you weren't in the first one! You. Need. To. Earn. It!!!!!

[GrockleTD]

1 minute ago, GOTSpectrum said:

I know without looking you weren't in the first one! You. Need. To. Earn. It!!!!!

Bah! these server issues are still kicking my ass atm. hoping to make myself extra super broke and buy a 780 i found for relatively cheap, cuz i find myself frankly lacking in terms of compute

[Daniel_SC]

tldr. Log is acting weird, but WU's seem to get done and accepted. Points aren't being awarded properly, but is an issue w. F@H servers.

 

So I've dug in my log a little bit, since the missing points updating was bothering me a little bit, and I needed a sanity check. I left my main rig folding for 24 hours at full tilt, with an occasional gaming break once in a while. I then extracted the log, and found all the lines with "Final Credit estimate".

 

Spoiler

07:15:36:WU04:FS01:Final credit estimate, 53176.00 points
07:39:04:WU01:FS05:Final credit estimate, 3133.00 points
07:15:36:WU04:FS01:Final credit estimate, 53176.00 points
07:39:04:WU01:FS05:Final credit estimate, 3133.00 points
09:26:42:WU03:FS01:Final credit estimate, 7608.00 points
07:15:36:WU04:FS01:Final credit estimate, 53176.00 points
07:39:04:WU01:FS05:Final credit estimate, 3133.00 points
09:26:42:WU03:FS01:Final credit estimate, 7608.00 points
07:15:36:WU04:FS01:Final credit estimate, 53176.00 points
07:39:04:WU01:FS05:Final credit estimate, 3133.00 points
09:26:42:WU03:FS01:Final credit estimate, 7608.00 points
10:52:35:WU01:FS01:Final credit estimate, 92891.00 points
11:57:02:WU00:FS03:Final credit estimate, 10579.00 points
14:02:37:WU03:FS01:Final credit estimate, 7685.00 points
14:36:00:WU01:FS03:Final credit estimate, 6890.00 points
10:52:35:WU01:FS01:Final credit estimate, 92891.00 points
11:57:02:WU00:FS03:Final credit estimate, 10579.00 points
14:02:37:WU03:FS01:Final credit estimate, 7685.00 points
14:36:00:WU01:FS03:Final credit estimate, 6890.00 points
15:00:59:WU04:FS05:Final credit estimate, 3098.00 points
16:10:23:WU01:FS05:Final credit estimate, 3215.00 points
17:23:52:WU04:FS05:Final credit estimate, 3828.00 points
20:13:02:WU00:FS01:Final credit estimate, 126789.00 points
21:08:07:WU03:FS03:Final credit estimate, 15092.00 points
22:52:13:WU04:FS01:Final credit estimate, 127757.00 points
23:18:04:WU00:FS03:Final credit estimate, 5624.00 points
00:01:19:WU03:FS01:Final credit estimate, 80467.00 points
01:08:24:WU01:FS05:Final credit estimate, 3829.00 points
01:14:05:WU02:FS02:Final credit estimate, 3447.00 points
02:09:48:WU00:FS01:Final credit estimate, 78604.00 points
02:44:16:WU03:FS05:Final credit estimate, 3902.00 points
04:33:53:WU01:FS02:Final credit estimate, 6137.00 points
05:13:43:WU00:FS05:Final credit estimate, 7089.00 points
02:09:48:WU00:FS01:Final credit estimate, 78604.00 points
02:44:16:WU03:FS05:Final credit estimate, 3902.00 points
04:33:53:WU01:FS02:Final credit estimate, 6137.00 points
05:13:43:WU00:FS05:Final credit estimate, 7089.00 points
06:00:48:WU03:FS02:Final credit estimate, 2614.00 points

I found out that several of the lines with final credit estimate was present multiple times. I don't know if this is an issue, but I am not too concerned since the timestamps are identical, so I assume its just en error in the log generation. However if I remove all the duplicates, and add the points together I should have made 653454.00, plus whatever my server with a 6 core CPU slot crunch out (a rough estimate would be 10-20,000)over the last 24 hours. So in total ~670k points. Not overly impressive I know, but still a fair bit.

 

In the meantime EOC has registered a total of 288,167 points in total. So in actuality less than half of whats expected.

Spoiler

I can only assume that I am not the only one with issues of points updating. And I can see on the F@H forums, it is something they are aware of. Apparently the points won't get awarded until the work from the collection server has been send along to another server. Since the servers stall all the time, alot of completed and unawarded WU's get stuck, until they get it fixed. So they should turn up eventually, with full QRB.

 

My point is (no pun intended), that I'll of course keep folding, even though admittedly it takes some of the fun out, to be honest. But the real prize at the end of the road is of course not the points, but the incredible contribution to science, we all are helping with.

To all the newbies like myself, you're not crazy, the points sometimes don't update. It can take some time before you'll get them, but eventually you'll get em. See it as a staggered RPG attack, with burn/poison damage over time

To the veterans, is there something else I could check for in the log, to make sure nothing is wrong in my end? As I said I'm not too concerned with the multiple identical entries in my log. But could it actually point to some issue with my F@H installation?