LTT Folding Team's Emergency Response to Covid-19

[TVwazhere]

9 minutes ago, ThermicWaffle5 said:

Anyone know if they are adding a "COVID-19" disease for the on I am fighting for?

Not specifically. Right now the "Any disease" prioritizes COVID-19 projects, which you can find a list of on their site

https://foldingathome.org/2020/03/30/covid-19-free-energy-calculations/

[Bitter]

37 minutes ago, HaRdLy007 said:

$90 US?

Yes, 90 Bald Eagle feathers. Includes shipping.

[ThermicWaffle]

2 minutes ago, TVwazhere said:

Not specifically. Right now the "Any disease" prioritizes COVID-19 projects, which you can find a list of on their site

https://foldingathome.org/2020/03/30/covid-19-free-energy-calculations/

Ok cool, then I'm doing it right. Thanks!

 

[ConceptOW]

56 minutes ago, HaRdLy007 said:

I have now tried GCP and AWS. No luck with either.

What is the issue with AWS? I don't have any problems with them.

[TVwazhere]

2 minutes ago, Bitter said:

90 Bald Eagle feathers

Ah shit I only have 67 Bacon strips and 23 9mm ammo, is that enough?

[ConceptOW]

1 hour ago, j0hn0b said:

sorry to repost this, but is anyone else still missing a fair amount of points from late last week? I'm getting updates now, but there's a day or so where the WUs never hit the stats page. The log didn't show issues

Yeah. i've been missing points for about the last 24 hrs. So far I got 156k points and 2 WU since.

[kingofchaos3]

Anyone else but hurt like me that they are not able to help more with this? I have 2 servers running but am getting like 1 or 2 WUs a day still. 

[Kilrah]

No becasue when that happens we set the advanced client flag.

[WaldorfMan]

27 minutes ago, Favebook said:

And it's out for us plebs:

Spoiler

 

 

Sooooooooo - how do we go about grabbing jobs from this server explicitly?

 

And AWESOME job on the video guys!   Loved it.

[Inkertus]

Just now, WaldorfMan said:

Sooooooooo - how do we go about grabbing jobs from this server explicitly?

 

And AWESOME job on the video guys!   Loved it.

You don't. It's random draw.  

[Xoggy]

3 hours ago, Macaw2000 said:

I had a half hour to kill so I took @GOTSpectrum spreadsheets and dumped them into flourish.studio. @Den-Fi @n0xlf @ZombieStew @Xoggy et al

 

 

THAT IS SO COOL!

Thank you so much for taking the time!

[WaldorfMan]

Just now, Inkertus said:

You don't. It's random draw.  

Boo 

[WaldorfMan]

2 minutes ago, WaldorfMan said:

Boo 

Oh well.  Bought me a shirt though!  

[marknd59]

Go you really want to connect to a server that linus built  ?

[WaldorfMan]

4 minutes ago, marknd59 said:

Go you really want to connect to a server that linus built  ?

Well, from the video, it sure looks like he knows what he's doing. 

[HaRdLy007]

Just bought 2 shirts!

[Zberg]

16 minutes ago, TVwazhere said:

Ah shit I only have 67 Bacon strips and 23 9mm ammo, is that enough?

Somehow you accidentally have the formula for bald eagle feathers; They are roughly 75% bacon and 25% ammo; and ofc 100% f'n murica

[WaldorfMan]

1 minute ago, Zberg said:

Somehow you accidentally have the formula for bald eagle feathers; They are roughly 75% bacon and 25% ammo; and ofc 100% f'n murica

[HaRdLy007]

22 minutes ago, Bitter said:

Yes, 90 Bald Eagle feathers. Includes shipping.

Very tempting, have to see if I have enough Loon's to cover it.

[danielocdh]

10 hours ago, BlueSpartan said:

What IP's need to be added? I tried my local host IP and got "telnet closed/timed out" ETC.

Like Fulminatrix said, if you are running FAH client only in the same machine as the babysitter your "hosts" would look like this:

hosts = [ #quoted strings, hosts or IPs separated by comma
  'localhost',
]

if you are running FAH client  on 192.168.1.20 and the same machine as the babysitter it would look like this

hosts = [ #quoted strings, hosts or IPs separated by comma
  'localhost',
  '192.168.1.20',
]

You can use network hosts with no issues(I do) as long as the babysitter machine is able to ping them/see them when sharing files

[Zberg]

9 minutes ago, WaldorfMan said:

I cant see this without hearing voodoo child 

[Rowza245]

Ahh shoot, just realized i can't qualify now bc my windows installation was screwed up for a few days and I'll be a day short of ten . Oh well, more than happy to keep going and contributing to the team and humanity 

[QuintLeo]

On 4/5/2020 at 4:35 AM, efka112 said:

yep points are lagging behind. i think even F@H stats are a bit lagging behind

F@H stat server might be getting overloaded.

Wouldn't be the first time stats lagged, but this time they have more reason for it.

 

The Overclocking stats site relies on the actual F@H stats servers for IT'S data, on an every 3'd hour stats file pull.

 

Problem MIGHT have cleared up, there was a big "bump" on everyone early this morning.

[Koppa315]

21 hours ago, danielocdh said:

babysitter python script

It will automatically scan all the slots and pause+unpause slots that are "Waiting On: WS Assignment" and have too high "Next Attempt"

Need to set host(s) and password(only if you use a password)

  Reveal hidden contents

 

################################################################################
##                                  options                                   ##
################################################################################
hosts = [ #quoted strings, hosts or IPs separated by comma
  'localhost',
  '192.168.0.123',
]
hostsPassword = '' #quoted string, if the host(s) don't use a password just leave it as: ''

restartLimit = 10 * 60 #in seconds, pause+unpause if next attempt to get WU is this or more
checkEvery = 2 * 60 #in seconds, do a check for all hosts every this seconds

tConTimeout = 15 #in seconds, connection timeout
tReadTimeout = 10 #in seconds, read timeout
testMode = False # if set to True: checkEvery=6 and restartLimit=0 but won't actually pause+unpause slots

################################################################################
##                                    code                                    ##
################################################################################
import json
import re
import telnetlib
import time
import datetime

if testMode:
    restartLimit = 0
    checkEvery = 6
countEvery = 1 #seconds, have to be a factor of checkEvery, default: 1
countEveryDec = max(0, str(countEvery)[::-1].find('.'))
countEveryDecStr = f'{{:.{countEveryDec}f}}'
def remSeconds(seconds):
    if seconds > 0:
        if (seconds * 10000) % (countEvery * 10000) == 0:
            secondsP = countEveryDecStr.format(seconds)
            pr(f'Next check in {secondsP} seconds', same=True)
        time.sleep(countEvery)
        seconds = round((seconds - countEvery) * 10000) / 10000
        remSeconds(seconds)

prLastLen = 0
prLastSame = False
def pr(t, indent=0, same=False, overPrev=False):
    global prLastLen, prLastSame
    if not overPrev and not same and prLastSame:
        prLastLen = 0
        print('')
    t = str(t)
    toPrint = ('  ' * indent) + t
    tLen = len(toPrint)
    print(toPrint + (' ' * max(0, prLastLen - tLen)), end='\r')
    prLastSame = same
    prLastLen = tLen
    if not same:
        print('')
        prLastLen = 0

def checkKeep():
    while (True):
        checkAll()
        remSeconds(checkEvery)

def checkAll():
    for host in hosts: check(host)
    now = datetime.datetime.now().strftime('%Y-%m-%d %H:%M:%S')
    pr(f'check complete at {now}', 0, False, True)


tEnd = ['\n> '.encode('utf-8'), '\n---\n'.encode('utf-8')]
def readResult(expected, expectedResult=''):
    index = expected[0]
    readB = expected[2]
    read = readB.decode('utf-8')
    #noting
    if index < 0 or read == '': return [False, 'nothing was read']
    #expected result
    if expectedResult:
        endWith = tEnd[index].decode('utf-8')
        readStrip = read[0:-len(endWith)].strip()
        if (readStrip != expectedResult):
            return [False, f'{readB}']
    #PyON->json
    match = re.search('\nPyON (\d+) ([-_a-zA-Z\d]+)\n(.*)\n---\n', read, re.DOTALL)
    ###print('');print('');print('');print(index);print(match);print(read);print(readB);print('');
    if match:
        version = match.group(1)
        if version != '1': raise Exception('Response data version does not match')
        data = match.group(3)
        #to json
        data = re.sub('(:\s)?False', r'\1false', data)
        data = re.sub('(:\s)?True', r'\1true', data)
        data = re.sub('(:\s)?None', r'\1null', data)
        data = json.loads(data)
        return [True, data]
    #auth error
    match = re.search('\nERROR: unknown command or variable', read, re.DOTALL)
    if match:
        raise Exception('error sending command, wrong password?')
    #return read
    return [True, read]
def tnCreate(host):
    tn = telnetlib.Telnet(host, 36330, tConTimeout)
    readResult(tn.expect(tEnd, tReadTimeout))
    return tn

def sendCmd(tn, cmd, par=''):
    if cmd == 'auth':
        if hostsPassword:
            cmdStr = f'auth {hostsPassword}';
            tn.write(f'{cmdStr}\n'.encode('utf-8'))
            res = readResult(tn.expect(tEnd, tReadTimeout), 'OK')
            if not res[0]: raise Exception(f'Error with {cmd}, {res[1]}')
            return res[1]
        return True
    elif cmd == 'exit':
        cmdStr = f'{cmd}';
        tn.write(f'{cmdStr}\n'.encode('utf-8'))
        res = readResult(tn.expect(tEnd, tReadTimeout))
        if not res[0]: raise Exception(f'Error with {cmd}, {res[1]}')
        return res[1]
    elif cmd == 'slot-info' or cmd == 'queue-info':
        cmdStr = f'{cmd}';
        tn.write(f'{cmdStr}\n'.encode('utf-8'))
        res = readResult(tn.expect(tEnd, tReadTimeout))
        if not res[0]: raise Exception(f'Error with {cmd}, {res[1]}')
        return res[1]
    elif cmd == 'get-info-and-restart':
        queueData = sendCmd(tn, 'queue-info')
        slotData = sendCmd(tn, 'slot-info')
        ###
        #if type(queueData) == str: print('');print('');print('');print(queueData);print(queueData.encode('utf-8'));print('');
        #if type(slotData) == str: print('');print('');print('');print(slotData);print(slotData.encode('utf-8'));print('');
        restarted = []
        for slot in slotData:
            isStillRunning = False
            queueDl = False
            for queue in queueData:
                if queue['slot'] == slot['id']:
                    if queue['state'] == 'RUNNING': isStillRunning = True
                    if queue['state'] == 'DOWNLOAD': queueDl = queue
            if not isStillRunning and queueDl and queueDl['waitingon'] == 'WS Assignment':
                match = re.match('\s?(\d+ days?)?\s?(\d+ hours?)?\s?(\d+ mins?)?\s?([\d.]+ secs?)?', queueDl['nextattempt'])
                if match:
                    seconds = 0
                    if match.group(1): seconds += int(re.sub('[^\d.]', '', match.group(1))) * 3600 * 24
                    if match.group(2): seconds += int(re.sub('[^\d.]', '', match.group(2))) * 3600
                    if match.group(3): seconds += int(re.sub('[^\d.]', '', match.group(3))) * 60
                    if match.group(4): seconds += round(float(re.sub('[^\d.]', '', match.group(4))) * 1)
                    if seconds >= restartLimit:
                        if not testMode:
                          sendCmd(tn, 'pause', queueDl['slot'])
                          time.sleep(1)
                          sendCmd(tn, 'unpause', queueDl['slot'])
                        restarted.append([queueDl['slot'], queueDl['nextattempt']])
                else: raise Exception(f'Error with {cmd}, parsing queue nextattempt:{queueDl["nextattempt"]}')
        return restarted
    elif par and (cmd == 'pause' or cmd == 'unpause'):
        cmdStr = f'{cmd} {par}';
        tn.write(f'{cmdStr}\n'.encode('utf-8'))
        res = readResult(tn.expect(tEnd, tReadTimeout))
        if not res[0]: raise Exception(f'Error with {cmd}, {res[1]}')
        return res[1]
    else : return False

def check(host):
    st = time.time()
    pr(f'checking {host}', 1, True)
    try:
        tn = tnCreate(host)
        sendCmd(tn, 'auth')
        restarted = sendCmd(tn, 'get-info-and-restart')
        if len(restarted):
            pr(f'{host}: restarted {len(restarted)} slot{"s" if len(restarted) > 1 else ""}: ' + ', '.join(map(lambda item: '' + (' with '.join(item)), restarted)), 1, False, True)
        sendCmd(tn, 'exit')
        ed = time.time()
        time.sleep(max(0, 1 - (ed - st)))
    except Exception as err:
        pr(f'{host} error: {err}', 1, False, True)

checkKeep()

 

 

Looks like this when running:

 

It access the clients API in a similar(much simpler) way that FAHControl or HFM.NET do

It won't restart slots that are still running and trying to download a new WU at the same time.

Tested on python 3 on windows (3.8.2)and ubuntu (3.6.9)

Let me know if you find any issues, it was stable for me after a few hours

 

Nice work! I'm writing a bit of code on my end too to improve visuals and pull data I want out. All in nodejs also using the socket interface.

[ColdThief]

Whelp I did all I could do. My landlords noticed a power bill increase. I contributed the best I could, but I can't finish the last 5 days. Good luck to everyone and I'm glad we are helping!