Folding on GPU failing constantly

[BrandonTheCat]

So after I tried to install a 580, my other GPU started to fail while that 580 was happily chugging along. Since then I have removed the 580, and since then the 980 refuses to fold again. Any idea why? The 580 isnt in the system but the 980 refuses to do only folding. BOINC works fine, but folding doesn't 

 

Here are my logs if that helps 

Edit: I also reinstalled F@H So please dont suggest that, as it didnt help.

 

15:23:12:WU01:FS01:Connecting to 171.67.108.200:80

15:23:13:WU01:FS01:Assigned to work server 171.67.108.31

15:23:13:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GM204 [GeForce GTX 980] from 171.67.108.31

15:23:13:WU01:FS01:Connecting to 171.67.108.31:8080

15:23:14:WU01:FS01:Downloading 1.39MiB

15:23:15:WU01:FS01:Download complete

15:23:15:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9615 run:0 clone:16 gen:161 core:0x18 unit:0x000000c20a3b1e815546ee27d28193b8

15:23:15:WU01:FS01:Starting

15:23:15:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 01 -suffix 01 -version 704 -lifeline 5936 -checkpoint 15 -gpu 0 -gpu-vendor nvidia

15:23:15:WU01:FS01:Started FahCore on PID 8920

15:23:15:WU01:FS01:Core PID:1408

15:23:15:WU01:FS01:FahCore 0x18 started

15:23:16:WU01:FS01:0x18:*********************** Log Started 2015-07-03T15:23:15Z ***********************

15:23:16:WU01:FS01:0x18:Project: 9615 (Run 0, Clone 16, Gen 161)

15:23:16:WU01:FS01:0x18:Unit: 0x000000c20a3b1e815546ee27d28193b8

15:23:16:WU01:FS01:0x18:CPU: 0x00000000000000000000000000000000

15:23:16:WU01:FS01:0x18:Machine: 1

15:23:16:WU01:FS01:0x18:Reading tar file core.xml

15:23:16:WU01:FS01:0x18:Reading tar file system.xml

15:23:16:WU01:FS01:0x18:Reading tar file integrator.xml

15:23:16:WU01:FS01:0x18:Reading tar file state.xml

15:23:16:WU01:FS01:0x18:Digital signatures verified

15:23:16:WU01:FS01:0x18:Folding@home GPU core18

15:23:16:WU01:FS01:0x18:Version 0.0.4

15:23:18:WU01:FS01:0x18:ERROR:exception: Error compiling kernel: ptxas application ptx input, line 9; fatal   : Unsupported .version 4.3; current version is '4.2'

15:23:18:WU01:FS01:0x18:ERROR:ptxas fatal   : Ptx assembly aborted due to errors

15:23:18:WU01:FS01:0x18:Saving result file logfile_01.txt

15:23:18:WU01:FS01:0x18:Saving result file log.txt

15:23:18:WU01:FS01:0x18:Folding@home Core Shutdown: BAD_WORK_UNIT

15:23:18:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)

15:23:18:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:9615 run:0 clone:16 gen:161 core:0x18 unit:0x000000c20a3b1e815546ee27d28193b8

15:23:18:WU01:FS01:Uploading 2.30KiB to 171.67.108.31

15:23:18:WU01:FS01:Connecting to 171.67.108.31:8080

15:23:18:WU02:FS01:Connecting to 171.67.108.200:80

15:23:19:WU01:FS01:Upload complete

15:23:19:WU01:FS01:Server responded WORK_ACK (400)

15:23:19:WU01:FS01:Cleaning up

15:23:19:WU02:FS01:Assigned to work server 171.64.65.84

15:23:19:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GM204 [GeForce GTX 980] from 171.64.65.84

15:23:19:WU02:FS01:Connecting to 171.64.65.84:8080

15:23:20:WU02:FS01:Downloading 3.51MiB

15:23:25:WU02:FS01:Download complete

15:23:25:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9120 run:9 clone:0 gen:64 core:0x18 unit:0x0000004e0a3b1e78553ea10779aab6a1

15:23:25:WU02:FS01:Starting

15:23:25:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 02 -suffix 01 -version 704 -lifeline 5936 -checkpoint 15 -gpu 0 -gpu-vendor nvidia

 

Where is @Whaler_99 when you need him....

Also I might post on the F@H Forums later if nobody on here has a clue.

Edited July 3, 2015 by BrandonTheCat

[Razarza]

Have you tried clearing out the WUs and starting new ones?

[BrandonTheCat]

Have you tried clearing out the WUs and starting new ones?

Yeah Ive done that, most of the time the WU's from the GPU dont show up at all... 

[Razarza]

Yeah Ive done that, most of the time the WU's from the GPU dont show up at all... 

What about clearing the GPU slot all together and reassigning it?

 

Edit - I just read through your log a little more and I think you may have an incorrect version of F@H? Can you press the about button and check what client version you have?

 

Edit2 - It may also be because Core18 is still early in development, has your GPU been failing on Core17 as well?

[BrandonTheCat]

What about clearing the GPU slot all together and reassigning it?

Have done that as well and cleared up everything

Update: I got the GPU to start folding after a driver update, however the ETA is 2 days and I'm getting only about 1000 points from it. But so far, nothing has failed!

[BrandonTheCat]

What about clearing the GPU slot all together and reassigning it?

Edit - I just read throught your log a little more and I think you may have an incorrect version of F@H? Can you press the about button and check what client version you have?

7.4.4. I reinstalled it yesterday soo..

[Razarza]

Have done that as well and cleared up everything

Update: I got the GPU to start folding after a driver update, however the ETA is 2 days and I'm getting only about 1000 points from it. But so far, nothing has failed!

Is it working on a core17 or core18? After some time the ETA should stabilise and become something more reasonable like 6~ hours. Oh and points will also fix themselves up, you have got your passkey entered too for the bonus points?

[Razarza]

If you don't know how to check what core the WU is check this.

[BrandonTheCat]

Is it working on a core17 or core18? After some time the ETA should stabilise and become something more reasonable like 6~ hours. Oh and points will also fix themselves up, you have got your passkey entered too for the bonus points?

Its working on core 17

Thanks for your help. After countless retrying and failures I got both GPU's to fold at the same time. (Thanks NVIDIA Driver) 

300,000 on the 980 and the 580 is stuck on that ETA thing...

Well All I can say is ROAD TO 25,000,000!~

Edit: And Yes I have a passkey

[Razarza]

Its working on core 17

Thanks for your help. After countless retrying and failures I got both GPU's to fold at the same time. (Thanks NVIDIA Driver) 

300,000 on the 980 and the 580 is stuck on that ETA thing...

Good to hear it is working now, there should be an advanced flag to prevent you from getting Core18s, I would look it up for you but I need to get some sleep. ETA thing? You mean it hasn't got a WU yet, if not it will get one eventually.

 

 

Well All I can say is ROAD TO 25,000,000!~

plsno, I should have gotten there last week if my 290 didn't die on me. Once I get it back and this G3258 and 980ti arrives I'll have my folding system going and I'll get those points back.

[BrandonTheCat]

Good to hear it is working now, there should be an advanced flag to prevent you from getting Core18s, I would look it up for you but I need to get some sleep. ETA thing? You mean it hasn't got a WU yet, if not it will get one eventually.

 

plsno, I should have gotten there last week if my 290 didn't die on me. Once I get it back and this G3258 and 980ti arrives I'll have my folding system going and I'll get those points back.

annnddd..... Crashed again

So I figured out the cause:

 I can either choose the 980 or the 580 to be it. Like I tried to enable the 580 in the device manager, however when doing that, the 980 will not fold any more. This is weird. 

[Razarza]

annnddd..... Crashed again

So I figured out the cause:

 I can either choose the 980 or the 580 to be it. Like I tried to enable the 580 in the device manager, however when doing that, the 980 will not fold any more. This is weird. 

Huh, that is weird, could be a driver conflict? I don't really have the capacity to think about it right now, I'll get back to you tomorrow afternoon after I finished work. Hopefully a F@H expert like @Whaler_99 might have some helpful input in the meantime.

[Xsilent(X)]

do you have any OC on those cards?

[BrandonTheCat]

do you have any OC on those cards?

No these are reference cards so I don't overclock. 

 

I do have a slight 17% boost on the CPU, though that is a stable 48 hour 4.0Ghz on the 5820K. So I don't expect that to be a factor. 

[Xsilent(X)]

cpu would be fine with OC! but the cards hhhmmm did you do a fresh driver install?

[Razarza]

Ok so just a quick thought before I set off to work, like already suggested have you done any recent driver installs? If you have try rolling back to the previous version that worked and see if that fixes it.

Good luck.

[BrandonTheCat]

cpu would be fine with OC! but the cards hhhmmm did you do a fresh driver install?

Well I installed both drivers for either card, the 980 refused working with it. So yes. Fresh drivers were installed but they hated it.

[Razarza]

Well I installed both drivers for either card, the 980 refused working with it. So yes. Fresh drivers were installed but they hated it.

Damn forum downtime, I tried to reply earlier while watching the WAN show but the forum went down. Can you try using some older drivers, like maybe a month or so old. It could be something recent that is conflicting with Fermi and Maxwell cards. You were able to fold with the 580 and 980 without issue at sometime before, right?

[Xsilent(X)]

Both drivers? Use Only one driver of nVidia

[BrandonTheCat]

Damn forum downtime, I tried to reply earlier while watching the WAN show but the forum went down. Can you try using some older drivers, like maybe a month or so old. It could be something recent that is conflicting with Fermi and Maxwell cards. You were able to fold with the 580 and 980 without issue at sometime before, right?

Ok so I got good news. I installed the 580 drivers first, disabled the 580, then enabled the 580, then redownloaded the 980 software, and now it works. so I'm getting around 400,000 PPD which is about 100,000 more than what I was getting. 

 

Bad news is that it adds 250 watts against the power draw which should be fine, but performance per watt is being suffered here. Which I was really proud of.

[Razarza]

Ok so I got good news. I installed the 580 drivers first, disabled the 580, then enabled the 580, then redownloaded the 980 software, and now it works. so I'm getting around 400,000 PPD which is about 100,000 more than what I was getting. 

 

Bad news is that it adds 250 watts against the power draw which should be fine, but performance per watt is being suffered here. Which I was really proud of.

Cool, good to hear you've managed to fix it. Should take you only a few months to get that 25mil.