Jump to content

Machine Learning to "guestimate" missing details in a low quality video or images, generate textures based on samples.

N.tony
 Share
Posted

improving.video.2x254.jpg?sw=1180&cx=0&c

An example of the algorithm, "sharpening" a low-poly image

https://www.technologyreview.com/s/601258/artificial-intelligence-can-now-design-realistic-video-and-game-imagery/

 

A UK startup called Magic Pony Technology is aiming at using neural networks, a common AI technique, to improve the quality of streamed video content and images.

 

Quote

The company has developed a way to create high-quality videos or images from low-resolution ones. It feeds example images to a computer, which converts them to a lower resolution and then learns the difference between the two. Others have demonstrated the feat before, but the company is able to do it on an ordinary graphics processor, which could open up applications. One example it’s demonstrated uses the technique to improve a live gaming feed in real time.

Quote

Our first product demonstrates that image quality can be greatly enhanced using deep learning, and fast mobile GPUs now allow us to deploy it anywhere

 

Link to comment
Share on other sites
Link to post
Share on other sites
Posted

That's impressive. Wonder how long it took though...

COMPUTER: Mobile Battlestation  |  CPU: INTEL I7-8700k |  Motherboard: Asus z370-i Strix Gaming  | GPU: EVGA GTX 1080 FTW ACX 3.0 | Cooler: Scythe Big Shuriken 2 Rev. b |  PSU: Corsair SF600 | HDD: Samsung 860 evo 1tb

 

Link to comment
Share on other sites
Link to post
Share on other sites
Posted
  • Author

They claim real-time using mobile GPUs. I mean, it could take a significant amount of time to "train" the network, but once it's done, you can deploy the resulting network as is, and it should work pretty fast.

Link to comment
Share on other sites
Link to post
Share on other sites
Posted

Incredible. Now I might not have to worry about the odd bad photos that I need. What if you continued to do it? That'd be interesting.

COMPUTER: Mobile Battlestation  |  CPU: INTEL I7-8700k |  Motherboard: Asus z370-i Strix Gaming  | GPU: EVGA GTX 1080 FTW ACX 3.0 | Cooler: Scythe Big Shuriken 2 Rev. b |  PSU: Corsair SF600 | HDD: Samsung 860 evo 1tb

 

Link to comment
Share on other sites
Link to post
Share on other sites
Posted

Black lettering on a black background . . . .

COMMUNITY STANDARDS   |   TECH NEWS POSTING GUIDELINES   |   FORUM STAFF

LTT Folding Users Tips, Tricks and FAQ   |   F@H & BOINC Badge Request   |   F@H Contribution   |   My Rig   |   Project Steamroller

I am a Moderator, but I am fallible. Discuss or debate with me as you will but please do not argue with me as that will get us nowhere.

 

Spoiler

† † †

 

Character is like a Tree and Reputation like its Shadow. The Shadow is what we think of it; The Tree is the Real thing.  ~ Abraham Lincoln

Reputation is a Lifetime to create but seconds to destroy.

You have enemies? Good. That means you've stood up for something, sometime in your life.  ~ Winston Churchill

Docendo discimus - "to teach is to learn"

 

† CHRISTIAN MEMBER †

 

 
 
 
 
 
 

 

Link to comment
Share on other sites
Link to post
Share on other sites
Posted

I wonder if this could be done in real time? That would be great for things like older games and emulators.

Link to comment
Share on other sites
Link to post
Share on other sites
Posted

enhance!

i9 11900k - NH-D15S - ASUS Z-590-F - 64GB 2400Mhz - 1080ti SC - 970evo 1TB - 960evo 250GB - 850evo 250GB - WDblack 1TB - WDblue 3TB - HX850i - 27GN850-B - PB278Q - VX229 - HP P224 - HP P224 - HannsG HT231 - 450D                                                         
Link to comment
Share on other sites
Link to post
Share on other sites
Posted

Reminds me of Waifu2x. It's a program that uses convolutional neural networks to upscale and denoise anime pictures. This might be slightly more useful though (and to be clear, they work completely differently)...

 

I wonder how much bandwidth it could save. The article says that it needs high resolution pictures as well to compare the low resolution ones with. I wonder how many high resolution images it needs to upscale let's say 10 seconds of video game footage. It might not save that much data if it needs lots of high res images as reference points.

Link to comment
Share on other sites
Link to post
Share on other sites
Posted
6 hours ago, SteveGrabowski0 said:

I have a bunch of 80s porn on videotape that this could be useful for. Christy Canyon in blu-ray quality would be great.

How much did you pay for them ?

  ﷲ   Muslim Member  ﷲ

KennyS and ScreaM are my role models in CSGO.

CPU: i3-4130 Motherboard: Gigabyte H81M-S2PH RAM: 8GB Kingston hyperx fury HDD: WD caviar black 1TB GPU: MSI 750TI twin frozr II Case: Aerocool Xpredator X3 PSU: Corsair RM650

Link to comment
Share on other sites
Link to post
Share on other sites
Posted

Oh boy, no more potato quality camera feeds, everywhere :D?

Groomlake Authority

Link to comment
Share on other sites
Link to post
Share on other sites
Posted
6 hours ago, SteveGrabowski0 said:

I have a bunch of 80s porn on videotape that this could be useful for. Christy Canyon in blu-ray quality would be great.

lets just hope it doesnt guess how she looks like these days

Current setup

Images of setup: http://linustechtips.com/main/topic/183-show-off-your-setup/?p=5872590

Link to comment
Share on other sites
Link to post
Share on other sites
Posted
2 hours ago, LAwLz said:

I wonder how much bandwidth it could save. The article says that it needs high resolution pictures as well to compare the low resolution ones with. I wonder how many high resolution images it needs to upscale let's say 10 seconds of video game footage. It might not save that much data if it needs lots of high res images as reference points.

I could be wrong, but I believe it just needs the high resolution images for the "training" of the algorithm. Once it has seen enough examples of "This is what the low-res image looks like, and this is what it should look like in high-res" the computer will adjust the algorithm until they feel it is able to work effectively with most images. So the end user doesn't need any high res images, they just need the low-res image they want to enhance and the algorithm.

Link to comment
Share on other sites
Link to post
Share on other sites
Posted
On 4/16/2016 at 11:39 AM, Misanthrope said:

I can see the licence plate now. Hold on I think there's a partial fingerprint on it, enhance harder!

alright, now isolate it and run it through the system!

i9 11900k - NH-D15S - ASUS Z-590-F - 64GB 2400Mhz - 1080ti SC - 970evo 1TB - 960evo 250GB - 850evo 250GB - WDblack 1TB - WDblue 3TB - HX850i - 27GN850-B - PB278Q - VX229 - HP P224 - HP P224 - HannsG HT231 - 450D                                                         
Link to comment
Share on other sites
Link to post
Share on other sites
Posted
On 4/16/2016 at 8:39 AM, Crazy Ginger said:

My god, finally we can tell a computer to "enhance the video" like they do in those csi shows

They had this technology decades ago. It was given to CSI shows from aliens after their agreement with George Bush went to shit and then he had to do 9/11 to vent off his anger. I also believe this is the reason HL3 will be released at 9/11 this year xD

MacBook Pro 15' 2018 (Pretty much the only system I use)

Link to comment
Share on other sites
Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share
Go to topic listing Tech News

×