Quick answer: Yes, especially for mobile. Emulators and your dev machine hide device-specific crashes, performance issues, and quirks that only appear on real hardware. You can't own every device, so combine some real-device testing with field crash capture across the rest.
Testing on real devices, actual phones, consoles, and PCs rather than just emulators or your dev machine, surfaces problems that simulated environments hide. Do you need it? For most games, especially mobile, yes, because a large class of bugs only appears on real hardware, and the alternative is your players being the first to find them.
Real Hardware Reveals What Emulators Hide
Emulators and your dev machine are approximations, they don't perfectly replicate real device behaviour, thermal throttling, actual GPU drivers, memory limits, OS quirks. A whole class of crashes and performance issues only appears on real hardware, and testing solely in simulation leaves them invisible until players hit them.
This is most acute on mobile, where device diversity and thermal behaviour are huge. Real-device testing catches the device-specific problems that emulators systematically miss, which is exactly what you most want to find before launch.
You Can't Own Every Device
The honest limit: there are thousands of device configurations, and you can't possibly own or test them all. Real-device testing covers the important and representative ones, but it can't be exhaustive. This isn't a reason to skip it, it's a reason to pair it with something that covers the rest.
Bugnet captures crashes and performance tagged by device from real players, so the configurations you couldn't test are covered in the field. Real-device testing plus field capture together give you coverage neither provides alone.
Combine Targeted Testing With Field Capture
The practical answer: test on a representative set of real devices before launch, covering your most common and most at-risk hardware, then rely on field crash capture to catch what slips through on the long tail of devices you couldn't test. This combination is realistic and effective.
Bugnet's device-tagged crash data both guides which devices to prioritise testing and catches the rest after launch. So yes, test on real devices before launch, especially for mobile, but accept you can't cover everything and back it with field capture across the devices you can't own.
Yes, especially mobile, real hardware reveals crashes and quirks emulators hide. You can't own every device, so combine targeted real-device testing with field crash capture.