One of the Xbox Game Studios is experimenting with Machine Learning to ship low-resolution textures that are then upscaled in real time with AI.
That could be incredibly useful and the displayed image alone shows a dramatic improvement.
looks like this would benefit xcloud streaming as well as console/pc.
How would this benefit xcloud streaming?
Xcloud streaming doesn't stream the textures to be rendered client-side, it streams a video image of the entire game that was rendered by a server, much like PlayStation Now does. Also, upscaling via AI doesn't always work flawlessly, so they're basically bragging about selling us reduced quality textures so they don't have to give us actual high res texture packs to download or to fit on the disc, and hoping the AI can do a perfect job of up-rezzing them (which is will do great, but not perfect).
Fr0sty good point, but when it comes to Xcloud do we really care about high res textures when xcloud is capped at 720p right now anyway. I think lower res textures for better possible latency is a great trade off, people may think otherwise of course.
Did you make that up🤔
It's sacrificing expensive CPU/APU bandwidth to save on cheap disk space. This seems interesting but rather pointless. I mean, I guess it could make a download smaller (or save devs from having to ship a physical game on multiple discs), and if the upscaling could be done one time and the results saved (rather than be constantly upscaled during gameplay) I guess that would be useful. Kinda. But barely. For consumers the benefit of this would be negligible.
When current gen games are sometimes in the 200gb region, disk space is not cheap, neither is the bandwidth to download it, if it's used on stuff like backgrounds, ground, bricks etc... And they can save idk 20gbs then yeah I see a point, especially for remasters, might seem lazy but it's at least a good option. Disk space is only cheap now next gen it's gonna go to ssds, if it stays cheap good, if games run off hdds fine, good, if not then disk space is at a premium
Or it's for making current gen games running on next gen hardware look much nicer without any updates.
Wouldn't this look worse?
That's a cool little tool. Anything to keep the size of the 4k assets down to save disc space would be greatly appreciated. Still unclear if the high res textures live in the cloud and the AI builds what it needs from that or if it is all done locally.
If it's done locally, do you really want to sacrifice gaming performance (4K strains hardware as it is) just to save a bit of cheap disk space?
You seem like a hater. You haven’t even tried this tech yet yet everything that comes out your mouth is negative or as if you’ve experienced it already. Something tells me that if this was Sony saying this you would be jumping for joy. Let people be excited if they want to be. If you’re not convinced that’s fine but don’t be a hater about it
If it prevents games from taking up hundreds of gigs, I’m okay with this!
Not if it reduces the quality of the end result, which it will. No upscaler is perfect. https://www.techspot.com/ar...
I think it depends on the type of game. A racing game would be okay for example.
It sounds good in theory but we would need to see the end result and what is sacrificed .
Most of what you download is audio files. Want to greatly reduce your downloads? We need better compression audio that unpacks on installation.
The downloads don’t bother me too much yet. When games start getting about 500 gigs and take 5 days I am sure it will. Hard drive space is what I see becoming more of an immediate issue.
This could be insane with open world games that tend to use low res textures, wonder what the strain on hardware is compared with normal HD textures?
And people say MS doesn't try to innovate... Ha! I think the industry as a whole is gonna do some crazy things in the next few years. Can't wait to see what Sony, MS, and Ninty do in the future.
All three companies innovate. They have all added to console gaming.
I'm more interested if this tech can be used for older games somehow. If they could get that kind of result (or even a half step up) on a 360 or first XBOX gen game that would really be amazing.
Thats the first thing thought about after reading this. Could be great for original Xbox and 360 games on next gen consoles to expand on their texture quality.
It could easily be used for BC, which would be a really great idea.
An option would be cool, but i'd rather have it natively high res rather than upscaled
What if there's no visual difference in the end result?
If there wasnt then sure, but so far that hasnt been the case including the method mentioned in the article.
And I'm sitting here more interested in downsampled 8k images. I guess this has a purpose, I'm just not sure how good it would be for new games so much as older games.
This probably goes hand-in-hand with MS's strategy of all their games being compatible with XB1 for at least the first year of the XSX.
Welcome to the ever increasing world of always online single player gaming.
From my understanding, it's happening locally.
What does this have to do with always-online?
Sorry I thought he was returning to the old cloud statements of AI upscaling through the cloud in real time. Which I still think that’s what they’ll likely do. As it will again promote the always online agenda that they want.
Like it or not all these consoles are headed to an always online future. These nothing you can do about it. Most physical media is now being streamed like music,books and movies. Sure you can still buy this stuff in the physical form but you have to go out of your way to do it. Gaming is headed the same direction so be warned...
Neat, but...wouldn't native high-res images (whether it be 4K, 8K or whatever's popular these days) still look better?
It depends. I've seen multiple instances of this tech. In some cases you can't tell the difference. Sometimes the native looks better. Sometimes the AI-upscaled textures look better because the AI can sometimes craft even finer details.
Microsoft are innovators
For old games this makes sense if it works properly. Storage is cheaper by the month and this seems to have little use for new games
Sounds like a perfect fit for Microsoft flight simulator. All those assets streamed to Xbox then up rez'd. Neat
Interesting. I guess they could make the games smaller for download, then allow your CPU to reconstruct it on your hard drive later while unpacking/installing the game so it isn't doing it while actually playing the game later. I think doing it during real time play would be stupid, especially for CPU starved games. AI doesn't always reconstruct properly, but I suspect you could build algorithms into this so it does a much better job than it currently does to reconstruct the textures. Main benefit here would be allowing a X : Y ratio of saved space while downloading, which is a benefit for most consumers who have crappy bandwidth, ISP's, the publisher which is paying ISP's for their data, etc. It would come at a cost of a damn game maybe needing an hour or two to install after you download it though I suspect, which would kind of suck.
I guess this is to make sure BC games automatically look great without the BC team needing to go back and manually change things.
The BC team never changes assets in BC titles. Only the base resolution allowing the textures to come through at its clearest and how intended...
Peep the salt on the comments just based on the dislikes. This is incredible if it can shift the industry into finding innovative solutions like this..
Keep up the innovation.
id rather much adjust the size of those damn things, they are soo small most of the time.
Sounds extremely interesting
N4G is a community of gamers posting and discussing the latest game news. It’s part of NewsBoiler, a network of social news sites covering today’s pop culture.