Low-light: Large Sensors & Computational Night Modes

Low-light photography is dominated by two-prone approaches of having large sensors with large pixel sizes, as well as having the computational photography night mode image processing algorithms to do image stacking and try to extract more information that way. Night mode capture is generally a must on any smartphone device today and requires R&D on the part of the vendor’s software teams to be able to achieve good competitive results.

Click for full image
[ X-T30 ( ) ]
[ S21U(S)  -    ]
[ S21U(E) ]
[ Mi 11 Ultra  -  ]
[ Axon 30 Ultra  -  ]
[ OnePlus 9 Pro  -  ] [ Mi 11  -  ]
[ S21(E)  -  ]
[ iPhone 12 Pro ] [ Pixel 5  -  ]

As a start, I wanted to cover the most unconventional usage of night mode, and that’s on the longer focal ranges of the cameras. Generally, using the telephoto in lower light conditions isn’t exactly a very common scenario in my view, however it’s still interesting to showcase the results. For all phones I captured both the default auto mode images as well as the explicit night mode shots, when applicable.

On the S21 Ultras, at 10x on the periscope lens, the usage of night mode is actually detrimental to the image results as it seems that the exposure time becomes far too long and the phone can’t manage a sharp image result when hand-held. The Mi 11 Ultra seems to be doing a little better here in terms of the image stacking, but also loses out fine detail compared to the normal single shot exposure.

The Axon 30 Ultra doesn’t even allow night mode on its periscope module so it’s simply just a up-scaled result from the secondary wide angle. I didn’t quite understand why they’re using this module when the primary wide angle has a much better sensor as well as OIS, but now in hindsight after actually having captured the shots I realised that you can crop in closer in night mode just using that module, which wasn’t exactly clear to me at the time, so the phone should do much better than what’s showcased here.

At around 3x, the S21 phones generally do the best. The S21 Ultra uses its telephoto module with night mode, and surprisingly the regular S21’s image is also again extremely good via the 64MP sensor, when combined with night mode.

The iPhone 12 Pro deemed it too bright for night mode, so it’s a mere auto mode shot, and the OnePlus 9 Pro didn’t allow any zooming in at all when in nightscape mode, with its 3.3 telephoto not being able to compete with the S21’s.

Click for full image
[ X-T30 ( ) ]
[ S21U(S)  -  ] [ S21U(E)  -  ]
[ Mi 11 Ultra  -  ] [ Axon 30 Ultra  -  ]
[ OnePlus 9 Pro  -  ] [ Mi 11  -  ]
[ S21(E)  -  ]
[ iPhone 12 Pro ] [ Pixel 5  -  ]

On the main camera, the best performer was the Mi 11 Ultra, somewhat unsurprisingly. The S21 Ultras follow it, along with the S21, OnePlus 9 Pro. The Mi 11 has a good night mode processing, however suffers from the smaller pixels in its 27MP capture mode. The Pixel 5 similarly is limited by the sensor. The iPhone 12 Pro has Apple’s algorithm tendency of being able to brighten up mid-tones, but not doing well in dark shadows or blacks, which remain nearly clipped. The Axon 30 Ultra produces a brighter image but is completely flat.

At 2x magnification most phones refuse to use their native sensor resolution so it’s just a direct upscale from the 1x results. The iPhone 12 Pro similar refuses to use its telephoto module, rather cropping in on the main sensor.

Click for full image
[ X-T30 ( ) ]
[ S21U(S)   -     ] [ S21U(E)   -      ]
[ Mi 11 Ultra  -  ] [ Axon 30 Ultra   -     ]
[ OnePlus 9 Pro  -  ] [ Mi 11  -  ]
[ S21(E) [ iPhone 12 Pro ] [ Pixel 5  -  ]

In slightly brighter scenes, the iPhone does use its telephoto. On other devices which don’t have a dedicated module, the results are generally bad. The Mi 11 Ultra either has a native resolution 2x image with very low dynamic range and contrast, or a night mode crop from its binned 1x mode which doesn’t have the resolution.

On the ultra-wide, the Samsung phones are leading in detail and colour accuracy. The Mi 11 Ultra and the OnePlus 9 Pro do also very well in details, but colour balanced the image wrong, the whole scene was indeed very orange due to the sodium vapour lamps.

Click for full image
[ X-T30 ( ) ]
[ S21U(S)  -  ] [ S21U(E)  -  ]
[ Mi 11 Ultra  -    ] [ Axon 30 Ultra  -  ]
[ OnePlus 9 Pro  -  ] [ Mi 11  -  ]
[ S21(E)  -  ] [ iPhone 12 Pro ] [ Pixel 5  -  ]

On the main camera again it’s mostly the Mi 11 Ultra which does best. Here I would also mention that it’s one of the phones which actually even though you’re in auto-mode in the camera, the device will detect the low-light scenario and still capture a night mode shot, which is why both 1x pictures look the same.

The Samsung phones brighten the scene too much but manage to handle gradations and details well. The iPhone and Pixel follow, though the latter almost always gets colour temperature wrong in night mode. OnePlus also does mostly well but does have some flatter textures. The Axon is again bright, but also completely flat.

Click for full image
[ X-T30 ( ) ]
[ S21U(S)  -  ] [ S21U(E)  -  ]
[ Mi 11 Ultra  -  ] [ Axon 30 Ultra  -  ]
[ OnePlus 9 Pro  -  ] [ Mi 11  -  ]
[ S21(E)  -  ] [ iPhone 12 Pro ]

As scenes become darker, some sensors start to not be usable anymore, even with night mode. The ultra-wide on the Mi 11 Ultra here struggles. The Axon 30 Ultra, Mi 11 and OnePlus 9 Pro’s night modes are starting to bring out sensor noise out, resulting in purple frame edges. The Samsung ultra-wides still hold up quite well.

On the main camera, the OP9Pro seems to have done the best, capturing more shadows and better details than the other devices. This is followed by the S21’s and the Mi 11 Ultra.

Click for full image
[ X-T30 ( ) ]
[ S21U(S)  -  ] [ S21U(E)  -  ]
[ Mi 11 Ultra  -  ] [ Axon 30 Ultra  -  ]
[ OnePlus 9 Pro  -  ] [ Mi 11  -  ]
[ S21(E)  -  ] [ iPhone 12 Pro ] [ Pixel 5  -  ]

This scene also generally follows the hardware ranking between the phones. The Mi 11 Ultra and the S21 Ultras do the best, along with the OnePlus 9 Pro. The S21 is starting to have notably more noise than the S21 Ultras here as it has smaller effective pixels. The iPhone and Pixel have good night modes but are laggards in the hardware department in terms of their sensors. The Axon 30 Ultra is again extremely flat.

Click for full image
[ X-T30 ( ) ]
[ S21U(S)  -  ] [ Mi 11 Ultra  -  ] [ Axon 30 Ultra  -  ] [ OnePlus 9 Pro  -  ]
[ Mi 11  -  ] [ S21(E)  -  ] [ iPhone 12 Pro ] [ Pixel 5  -  ]

This scene was extremely dark and generally just lit by far away street lights and just the light pollution in the cloudy sky. It’s not a very realistic scenario, but just a general showcase of the extremes of what the sensors and night modes can do.

The Mi 11 Ultra is the best performer alongside the OnePlus 9 Pro, one has the hardware advantage while the other seems to have a good night mode that extracts details in extreme low light. The S21 beats the S21 Ultra in getting any light in, even though it’s extremely noisy. The Pixel has a stronger night mode in the shadows than Apple, but both suffer from getting any light. The Axon 30 Ultra has a bright image but generally only useable as a thumbnail as it’s a blurry mess.

Overall Low-Light Conclusion

In general, the low-light results largely tracked with what we expected from the phones. The top performers are naturally those devices which have a hardware sensor advantage, with big sensors and larger effective pixels. This includes the Mi 11 Ultra and the S21 Ultra, with the OnePlus 9 Pro also being extremely competitive. Following the sensor advantages, it’s about the computational photography night modes. I think Samsung produces amongst the best results here as it has colours that are more often representative of the scene, whereas other phones can get colour temperature wrong. The Pixel here for example is almost always wrong as it tries to colour balance to the extreme instead of capturing the lighting of the scene.

Generally, the Samsung phones were the most versatile and consistent across the camera modules, while for the other phones the results could vary quite a lot from scene to scene. A phone camera is still only a phone camera and has many weaknesses in low-light, it will be interesting where vendors are heading next in terms of trying to augment their photography capabilities.

Daylight: Main Camera HDR Device Conclusions & Remarks
Comments Locked

60 Comments

View All Comments

  • Jon Tseng - Monday, June 21, 2021 - link

    Assume this is the iPhone Pro, not the Pro Max?

    If so might be worth looking at the Pro Max. Presumably the slightly upgraded camera with the funky Cirrus closed loop controller has some benefit?
  • Andrei Frumusanu - Monday, June 21, 2021 - link

    I don't have that unit.
  • damianrobertjones - Monday, June 21, 2021 - link

    Such a shame that Huawei cannot be included. If it wasn't for them, we might still be stuck with rubbish phone cams.
  • michael2k - Monday, June 21, 2021 - link

    Apple had a 2 camera system in the 7 Plus in 2016, just like the Huawei P9.

    So it seems a stretch to credit the Huawei, unless you think in the 5 months between the P9 and the 7 Plus Apple revamped their camera from one to two because of Huawei? That seems improbable since Apple designed iOS 10.1's portrait mode around a two camera system.
  • quiksilvr - Tuesday, June 22, 2021 - link

    Technically the P9 was a dual camera system but their second camera lacked a color filter to improve low light and merge the cameras together. the LG G5 was the first real dual camera system with one being a wide-angle camera. I honestly would argue that LG started it but Huawei took it to the next level.
  • ottonis - Wednesday, June 23, 2021 - link

    "It seems a stretch to credit Huawei" - really? The Night modes were initially brought by Huawei - all the other companies followed suit.
    There is no denying that P10-P30 have been extremely igniting the advancemend of phone-camera technology and if it weren't for the sanctions they might still be relevant in that market segment.
    Right now, it seems that Xiaomi is leading the pack with the most advanced combination of camera hardware+software, but we will see for how long they will be willing to invest into further optimizing the camera experience.
    Sony seems to be back in the game with their upcoming Xperia 1 iii but there has been some disappointment among the camera-enthusiasts that Sony of all people have not embraced their latest and greatest sensor technology (e.g. their newest and purpotedly spectacular 1" IMX sensor). My guess is that Sony will take another year or two in order to fully catch up with the best in business (w/r to phone camera quality).
    In my opinion, the future of phonecamera-technology is not in multisensor/multi-module options but in one bigger sensor (anything around 1", give or take) and a variable optics before the sensor. Just imagine being able to change from e.g. 16mm to 35mm and maybe 50 mm while always having the same great large sensor.
  • s.yu - Wednesday, June 23, 2021 - link

    No, the name doesn't matter. Stacking started with Google's HDR+. Night mode is just stacking with slightly different parameters. And P20 which debuted the so-called night mode had such waxy results that most of the time it was better to just use auto.
  • s.yu - Wednesday, June 23, 2021 - link

    Here, see how everything looks like crayon? This is actually one of the better samples, some samples from other sites look even worse.
    https://images.anandtech.com/galleries/6436/P20_IM...

    This is the Pixel from back then, with HDR+, which retains far more natural texture:
    https://images.anandtech.com/galleries/6436/P2XL_I...
  • sonny73n - Wednesday, June 23, 2021 - link

    Phone camera sucks and iPhone camera is the worst. Take a picture of your wife with your iPhone and ask her how she looks in it.
  • s.yu - Wednesday, June 23, 2021 - link

    You could use the IQ4 150MP paired with the Apo-Digitar 120/5.6 to take a photo of you wife at f/11. I don't think she's gonna be happy.
    Flattering != high quality.

Log in

Don't have an account? Sign up now