'Games can't get much more real looking', or can they?

[SkylineObsession]

Just a random thought i had when watching a vid of GT Sport cars drive through real locations in Scapes mode on YouTube just now (since we pretty much can't play the bloody thing with the servers down...).

I honestly think it'll be possible to create an engine (for PS5/PS6/Xbox equivalents) that can develop real photos taken in 3D (taken while driving slowly in a moving vehicle with heaps of cameras pointed at all sorts of angles) into a 3D polygonal 'world' that you can then drive etc around in a videogame.

So basically you are driving a virtual car (or maybe that can be realphotoised and polygonated too?) on a videogame polygonned track composed of real photos, not graphics.

Would require damn powerful engines/consoles etc probably (for a racing game) and some things will likely have to be fixed up that the cameras couldn't quite get accurate, but it could maybe save a lot of time creation wise? But eat a lot of room file size wise.

I mean, we have these point and click type games etc that are very realistic looking, so anything is possible.

Thoughts? Do you kinda see where i'm coming from? Nothing really seems to be off the table anymore, think back to 20 years ago and the things we thought were impossible back then are reality now (like games looking better than the FMV clips etc).

[dodint]

Not sure if it's a analogous, but flight sims have been overlaying satellite imagery on top of detailed topography data for a while to create photo realistic terrain.

[MR2 Fan]

Well, I mean it sounds like doing 2 things which are already done pretty often in video games, scanning 3D objects and capturing the actual textures/colors for texture mapping.

Otherwise games sometimes use a 360 degree cloud map for backgrounds where they just wrap around an existing cloud panorama

[Rare White Ape]

Skyline, what you’re talking about is photogrammetry, which is used extensively by DICE in the Battlefield/Battlefront games. It produces tremendous results.

However it has to be cleaned up by hand, otherwise it’s a janky mess. I couldn’t begin to imagine the difficulty of building entire worlds if someone drove around Google Street View style and let a computer figure it out all by itself. We are heading that way, and machine learning algorithms are probably already being developed that can map out entire road networks in 3D, but it’s not up to the standard required by a racing sim.

At the moment the gold standard is having laser scanned locations coupled with high quality photography to create game environments. Plenty of human input is involved, and they look great in VR.

[Tom Servo]

All I can think is, "I thought this same thing when Skyrim came out." It's really rare that I see a screenshot where I truly can't tell if it's real or rendered. I think we're still a good 10-20 years out before we get to true photorealism. In the meantime, there's this pesky uncanny valley we're close to. Racing sims are easier to pull off than anything involving people, so I'm not shocked we're a lot closer on that front. For racing sims, I think we're at that point where the secondary stuff is the issue. Forza 7 looks brilliant, right up until it shows you crossing the line in slow-mo in the rain and those weird snowflake rain spray things go slowly rotating through the air.

[MR2 Fan]

In some ways we're close. Humans will always be the most difficult thing.

The Unreal 4 engine is mind-blowingly good though, as long as the console/PC game has the power to render it at full power:


https://www.youtube.com/watch?v=lbMKSiq3Mpc

[animalica]

How could graphics get ever more realistic than this? :D


https://www.youtube.com/watch?v=Y3-gcJV8sgE

Or facial animations?


https://www.youtube.com/watch?v=T--NOuaKV0M

Or games that were like movies with amazing graphics like in SPR?


https://www.youtube.com/watch?v=XHscQgzkMKg

[stephenb]

Trouble is the closer we get to photo realism the more things stand out that aren't quite right. We're also getting close to the limit of how far existing silicon transistor processes can be shrunk, which is what gives us more powerful systems. Still, I never cease to be amazed with what they can drag out of the current consoles. I think if the next round of consoles are based on 7nm technology utilising the latest and greatest from AMD/Nvidia/Intel we'll be in for something truly spectacular, especially given the fact there won't be any higher resolutions to chase (taking 4K as todays baseline given the Pro/1X).

[MR2 Fan]

somewhat related, discusses laser-scanned tracks:



https://www.youtube.com/watch?v=5XI494nEJrQ