Jump to content

NVIDIA in collaboration with Aalto University (Finland) created an AI that creates fake celebrity photos that look so real

Source: NVIDIA via CNET

 

I can't upload the actual paper because of the attachment limitation to 20 MB of LTT so just click on the NVIDIA link above to read the actual paper which is 28.7 MB. -_-

Quote

Progressive Growing of GANs for Improved Quality, Stability, and Variation

Tero Karas (NVIDIA), Timo Aila (NVIDIA), Samuoi Laine (NVIDIA), Jaakko Lehtinen (NVIDIA and Aalto University, Finland)

Under review as a conference paper at 6th International Conference on Learning Representations

 

ABSTRACT

We describe a new training methodology for generative adversarial networks. The key idea is to grow both the generator and discriminator progressively: starting from a low resolution, we add new layers that model increasingly fine details as training progresses. This both speeds the training up and greatly stabilizes it, allowing us to produce images of unprecedented quality, e.g., CelebA images at 1024². We also propose a simple way to increase the variation in generated images, and achieve a record inception score of 8.80 in unsupervised CIFAR10. Additionally, we describe several implementation details that are important for discouraging unhealthy competition between the generator and discriminator. Finally, we suggest a new metric for evaluating GAN results, both in terms of image quality and variation. As an additional contribution, we construct a higher-quality version of the CelebA dataset.

I think the likes of TMZ or other famous celebrity gossip website would love this. 

Quote

The graphics chip maker published a study last week on its use of "generative adversarial networks," or a kind of artificial intelligence that employs two neural networks, to create photo-realistic images of fake celebrities. See those photos above? Those aren't real people. The process begins with a low-resolution image, and the two neural networks work to lay out more high-definition features until you get to those finished results. The company used the CelebA database of stock celebrity images to create different mash-ups. 

From the paper:

Quote

We use generator and discriminator networks that are mirror images of each other and always grow in synchrony. All existing layers in both networks remain trainable throughout the training process. When new layers are added to the networks, we fade them in smoothly, as illustrated in Figure 2. This avoids sudden shocks to the already well-trained, smaller-resolution layers. Appendix A describes structure of the generator and discriminator in detail, along with other training parameters.

 

We observe that the progressive training has several benefits. Early on, the generation of smaller images is substantially more stable because there is less class information and fewer modes (Odena et al., 2017). By increasing the resolution little by little we are continuously asking a much simpler question compared to the end goal of discovering a mapping from latent vectors to e.g. 10242 images. This approach has conceptual similarly to recent work by Chen & Koltun (2017). In practice it stabilizes the training sufficiently for us to reliably synthesize megapixel-scale images using WGAN-GP loss (Gulrajani et al., 2017) and even LSGAN loss (Mao et al., 2016b).

 

Another benefit is the reduced training time. With progressively growing GANs most of the iterations are done at lower resolutions, and comparable result quality is often obtained up to 2–6 times faster, depending on the final output resolution.

59fb16ee8ed99_Screenshot(367).png.73b6598997af4f4bbe81427327385dd1.png59fb16f26ad6f_Screenshot(368).png.ac008f2f4393726a853c1307e126ac76.png

59fb17b039877_Screenshot(369).png.b43f134fdc2ad9db998bb7293a5cd2a7.png59fb18350099a_Screenshot(370).png.6da18bd7e454dbf1b1139fb16d0bb111.png

Just so you know, those pictures above aren't pictures of real people They're just computer generated. Although in Figure 5, one of the pictures kinda looks like Beyonce. The researchers concluded that it still needs improvement.

Quote

While the quality of our results is generally high compared to earlier work on GANs, and the training is stable in large resolutions, there is a long way to true photorealism. Semantic sensibility and understanding dataset-dependent constraints, such as certain objects being straight rather than curved, leaves a lot to be desired. There is also room for improvement in the micro-structure of the images. That said, we feel that convincing realism may now be within reach, especially in CELEBA-HQ.

To be honest I only understood a few of it but from the looks of it, it can be used by the likes of Apple to train Face ID in their neural networks in order to spot impostors or fake news websites can use it to create mass hysteria.

There is more that meets the eye
I see the soul that is inside

 

 

Link to comment
Share on other sites

Link to post
Share on other sites

This would be perfect for my Satire paper. 

My eyes see the past…

My camera lens sees the present…

Link to comment
Share on other sites

Link to post
Share on other sites

Good to see all that brain power going to something so pointless, and potentially extremely dangerous. 

CPU: Ryzen 9 5900 Cooler: EVGA CLC280 Motherboard: Gigabyte B550i Pro AX RAM: Kingston Hyper X 32GB 3200mhz

Storage: WD 750 SE 500GB, WD 730 SE 1TB GPU: EVGA RTX 3070 Ti PSU: Corsair SF750 Case: Streacom DA2

Monitor: LG 27GL83B Mouse: Razer Basilisk V2 Keyboard: G.Skill KM780 Cherry MX Red Speakers: Mackie CR5BT

 

MiniPC - Sold for $100 Profit

Spoiler

CPU: Intel i3 4160 Cooler: Integrated Motherboard: Integrated

RAM: G.Skill RipJaws 16GB DDR3 Storage: Transcend MSA370 128GB GPU: Intel 4400 Graphics

PSU: Integrated Case: Shuttle XPC Slim

Monitor: LG 29WK500 Mouse: G.Skill MX780 Keyboard: G.Skill KM780 Cherry MX Red

 

Budget Rig 1 - Sold For $750 Profit

Spoiler

CPU: Intel i5 7600k Cooler: CryOrig H7 Motherboard: MSI Z270 M5

RAM: Crucial LPX 16GB DDR4 Storage: Intel S3510 800GB GPU: Nvidia GTX 980

PSU: Corsair CX650M Case: EVGA DG73

Monitor: LG 29WK500 Mouse: G.Skill MX780 Keyboard: G.Skill KM780 Cherry MX Red

 

OG Gaming Rig - Gone

Spoiler

 

CPU: Intel i5 4690k Cooler: Corsair H100i V2 Motherboard: MSI Z97i AC ITX

RAM: Crucial Ballistix 16GB DDR3 Storage: Kingston Fury 240GB GPU: Asus Strix GTX 970

PSU: Thermaltake TR2 Case: Phanteks Enthoo Evolv ITX

Monitor: Dell P2214H x2 Mouse: Logitech MX Master Keyboard: G.Skill KM780 Cherry MX Red

 

 

Link to comment
Share on other sites

Link to post
Share on other sites

Its cool to see that neural networks are improving, but the results still look unnatural. (Still a great deal better than an amateur Photoshop at least)

Link to comment
Share on other sites

Link to post
Share on other sites

56 minutes ago, tjcater said:

Its cool to see that neural networks are improving, but the results still look unnatural. (Still a great deal better than an amateur Photoshop at least)

The one that looked like Beyonce looks sort of real though 

There is more that meets the eye
I see the soul that is inside

 

 

Link to comment
Share on other sites

Link to post
Share on other sites

1 minute ago, hey_yo_ said:

The one that looked like Beyonce looks sort of real though 

Won't deny that, especially at a quick glance, but most of these photos just give me that uncanny valley vibe after looking at them long enough (Eg 10-15 seconds).

Link to comment
Share on other sites

Link to post
Share on other sites

one step closer to endless really good computer generated movies, cant wait :P

i9 11900k - NH-D15S - ASUS Z-590-F - 64GB 2400Mhz - 1080ti SC - 970evo 1TB - 960evo 250GB - 850evo 250GB - WDblack 1TB - WDblue 3TB - HX850i - 27GN850-B - PB278Q - VX229 - HP P224 - HP P224 - HannsG HT231 - 450D                                                         
Link to comment
Share on other sites

Link to post
Share on other sites

1 hour ago, tjcater said:

Won't deny that, especially at a quick glance, but most of these photos just give me that uncanny valley vibe after looking at them long enough (Eg 10-15 seconds).

Those will probably be kings to render faster CG scenes, not so much pictures of people. Because they can get more knowledge this way and make something better looking

Link to comment
Share on other sites

Link to post
Share on other sites

wow

Snorlax: i7 5820k @4.5ghz, Asus X99 Pro, 32gb Corsair Vengeance LPX 2666, Cryorig R1 Ultimate, Samsung 850 evo 500gb, Asus GTX 1080 ROG Strix, Corsair RM850x, NZXT H440, Hue+

Smallsnor: Huawei Matebook X

 

Canon AE-1 w/ 50mm f/1.8 lens

Pentax KM w/ 55mm f/1.8 SMC lens

Zenit-E w/ 58mm f/2 Helios lens

Panasonic G7 with 14-42mm f/3.5 lens

Polaroid Spectra System

 

Link to comment
Share on other sites

Link to post
Share on other sites

My school never taught us the RGB formula...?

Intel Xeon E5 1650 v3 @ 3.5GHz 6C:12T / CM212 Evo / Asus X99 Deluxe / 16GB (4x4GB) DDR4 3000 Trident-Z / Samsung 850 Pro 256GB / Intel 335 240GB / WD Red 2 & 3TB / Antec 850w / RTX 2070 / Win10 Pro x64

HP Envy X360 15: Intel Core i5 8250U @ 1.6GHz 4C:8T / 8GB DDR4 / Intel UHD620 + Nvidia GeForce MX150 4GB / Intel 120GB SSD / Win10 Pro x64

 

HP Envy x360 BP series Intel 8th gen

AMD ThreadRipper 2!

5820K & 6800K 3-way SLI mobo support list

 

Link to comment
Share on other sites

Link to post
Share on other sites

12 hours ago, Likwid said:

How to get accused for something you never did

#Tinfoil~Hat~Intensifies

But how can they accuse someone when the picture isn't from a real person?

There is more that meets the eye
I see the soul that is inside

 

 

Link to comment
Share on other sites

Link to post
Share on other sites

1 minute ago, hey_yo_ said:

But how can they accuse someone when the picture isn't from a real person?

Out of the 7 billion people on this planet, there might be a chance a few of these computer generated people is real.

Intel Xeon E5 1650 v3 @ 3.5GHz 6C:12T / CM212 Evo / Asus X99 Deluxe / 16GB (4x4GB) DDR4 3000 Trident-Z / Samsung 850 Pro 256GB / Intel 335 240GB / WD Red 2 & 3TB / Antec 850w / RTX 2070 / Win10 Pro x64

HP Envy X360 15: Intel Core i5 8250U @ 1.6GHz 4C:8T / 8GB DDR4 / Intel UHD620 + Nvidia GeForce MX150 4GB / Intel 120GB SSD / Win10 Pro x64

 

HP Envy x360 BP series Intel 8th gen

AMD ThreadRipper 2!

5820K & 6800K 3-way SLI mobo support list

 

Link to comment
Share on other sites

Link to post
Share on other sites

Just now, NumLock21 said:

Out of the 7 billion people on this planet, there might be a chance a few of these computer generated people is real.

True as they made an image looking so close to Beyonce but a picture of a person looking like a vampire is probably fake anyway

There is more that meets the eye
I see the soul that is inside

 

 

Link to comment
Share on other sites

Link to post
Share on other sites

4 minutes ago, hey_yo_ said:

True as they made an image looking so close to Beyonce but a picture of a person looking like a vampire is probably fake anyway

 

Intel Xeon E5 1650 v3 @ 3.5GHz 6C:12T / CM212 Evo / Asus X99 Deluxe / 16GB (4x4GB) DDR4 3000 Trident-Z / Samsung 850 Pro 256GB / Intel 335 240GB / WD Red 2 & 3TB / Antec 850w / RTX 2070 / Win10 Pro x64

HP Envy X360 15: Intel Core i5 8250U @ 1.6GHz 4C:8T / 8GB DDR4 / Intel UHD620 + Nvidia GeForce MX150 4GB / Intel 120GB SSD / Win10 Pro x64

 

HP Envy x360 BP series Intel 8th gen

AMD ThreadRipper 2!

5820K & 6800K 3-way SLI mobo support list

 

Link to comment
Share on other sites

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×