Watch this: Unreal Engine’s latest tech demo showcases ‘high performance’ destruction system

There are undoubtedly gameplay-related justifications for why players can't, say, knock down skyscrapers in GTA V but some of the main reasons for these limitations are likely technical in nature.