Low-light: Large Sensors & Computational Night Modes

Low-light photography is dominated by two-prone approaches of having large sensors with large pixel sizes, as well as having the computational photography night mode image processing algorithms to do image stacking and try to extract more information that way. Night mode capture is generally a must on any smartphone device today and requires R&D on the part of the vendor’s software teams to be able to achieve good competitive results.

Click for full image
[ X-T30 ( ) ]
[ S21U(S)  -    ]
[ S21U(E) ]
[ Mi 11 Ultra  -  ]
[ Axon 30 Ultra  -  ]
[ OnePlus 9 Pro  -  ] [ Mi 11  -  ]
[ S21(E)  -  ]
[ iPhone 12 Pro ] [ Pixel 5  -  ]

As a start, I wanted to cover the most unconventional usage of night mode, and that’s on the longer focal ranges of the cameras. Generally, using the telephoto in lower light conditions isn’t exactly a very common scenario in my view, however it’s still interesting to showcase the results. For all phones I captured both the default auto mode images as well as the explicit night mode shots, when applicable.

On the S21 Ultras, at 10x on the periscope lens, the usage of night mode is actually detrimental to the image results as it seems that the exposure time becomes far too long and the phone can’t manage a sharp image result when hand-held. The Mi 11 Ultra seems to be doing a little better here in terms of the image stacking, but also loses out fine detail compared to the normal single shot exposure.

The Axon 30 Ultra doesn’t even allow night mode on its periscope module so it’s simply just a up-scaled result from the secondary wide angle. I didn’t quite understand why they’re using this module when the primary wide angle has a much better sensor as well as OIS, but now in hindsight after actually having captured the shots I realised that you can crop in closer in night mode just using that module, which wasn’t exactly clear to me at the time, so the phone should do much better than what’s showcased here.

At around 3x, the S21 phones generally do the best. The S21 Ultra uses its telephoto module with night mode, and surprisingly the regular S21’s image is also again extremely good via the 64MP sensor, when combined with night mode.

The iPhone 12 Pro deemed it too bright for night mode, so it’s a mere auto mode shot, and the OnePlus 9 Pro didn’t allow any zooming in at all when in nightscape mode, with its 3.3 telephoto not being able to compete with the S21’s.

Click for full image
[ X-T30 ( ) ]
[ S21U(S)  -  ] [ S21U(E)  -  ]
[ Mi 11 Ultra  -  ] [ Axon 30 Ultra  -  ]
[ OnePlus 9 Pro  -  ] [ Mi 11  -  ]
[ S21(E)  -  ]
[ iPhone 12 Pro ] [ Pixel 5  -  ]

On the main camera, the best performer was the Mi 11 Ultra, somewhat unsurprisingly. The S21 Ultras follow it, along with the S21, OnePlus 9 Pro. The Mi 11 has a good night mode processing, however suffers from the smaller pixels in its 27MP capture mode. The Pixel 5 similarly is limited by the sensor. The iPhone 12 Pro has Apple’s algorithm tendency of being able to brighten up mid-tones, but not doing well in dark shadows or blacks, which remain nearly clipped. The Axon 30 Ultra produces a brighter image but is completely flat.

At 2x magnification most phones refuse to use their native sensor resolution so it’s just a direct upscale from the 1x results. The iPhone 12 Pro similar refuses to use its telephoto module, rather cropping in on the main sensor.

Click for full image
[ X-T30 ( ) ]
[ S21U(S)   -     ] [ S21U(E)   -      ]
[ Mi 11 Ultra  -  ] [ Axon 30 Ultra   -     ]
[ OnePlus 9 Pro  -  ] [ Mi 11  -  ]
[ S21(E) [ iPhone 12 Pro ] [ Pixel 5  -  ]

In slightly brighter scenes, the iPhone does use its telephoto. On other devices which don’t have a dedicated module, the results are generally bad. The Mi 11 Ultra either has a native resolution 2x image with very low dynamic range and contrast, or a night mode crop from its binned 1x mode which doesn’t have the resolution.

On the ultra-wide, the Samsung phones are leading in detail and colour accuracy. The Mi 11 Ultra and the OnePlus 9 Pro do also very well in details, but colour balanced the image wrong, the whole scene was indeed very orange due to the sodium vapour lamps.

Click for full image
[ X-T30 ( ) ]
[ S21U(S)  -  ] [ S21U(E)  -  ]
[ Mi 11 Ultra  -    ] [ Axon 30 Ultra  -  ]
[ OnePlus 9 Pro  -  ] [ Mi 11  -  ]
[ S21(E)  -  ] [ iPhone 12 Pro ] [ Pixel 5  -  ]

On the main camera again it’s mostly the Mi 11 Ultra which does best. Here I would also mention that it’s one of the phones which actually even though you’re in auto-mode in the camera, the device will detect the low-light scenario and still capture a night mode shot, which is why both 1x pictures look the same.

The Samsung phones brighten the scene too much but manage to handle gradations and details well. The iPhone and Pixel follow, though the latter almost always gets colour temperature wrong in night mode. OnePlus also does mostly well but does have some flatter textures. The Axon is again bright, but also completely flat.

Click for full image
[ X-T30 ( ) ]
[ S21U(S)  -  ] [ S21U(E)  -  ]
[ Mi 11 Ultra  -  ] [ Axon 30 Ultra  -  ]
[ OnePlus 9 Pro  -  ] [ Mi 11  -  ]
[ S21(E)  -  ] [ iPhone 12 Pro ]

As scenes become darker, some sensors start to not be usable anymore, even with night mode. The ultra-wide on the Mi 11 Ultra here struggles. The Axon 30 Ultra, Mi 11 and OnePlus 9 Pro’s night modes are starting to bring out sensor noise out, resulting in purple frame edges. The Samsung ultra-wides still hold up quite well.

On the main camera, the OP9Pro seems to have done the best, capturing more shadows and better details than the other devices. This is followed by the S21’s and the Mi 11 Ultra.

Click for full image
[ X-T30 ( ) ]
[ S21U(S)  -  ] [ S21U(E)  -  ]
[ Mi 11 Ultra  -  ] [ Axon 30 Ultra  -  ]
[ OnePlus 9 Pro  -  ] [ Mi 11  -  ]
[ S21(E)  -  ] [ iPhone 12 Pro ] [ Pixel 5  -  ]

This scene also generally follows the hardware ranking between the phones. The Mi 11 Ultra and the S21 Ultras do the best, along with the OnePlus 9 Pro. The S21 is starting to have notably more noise than the S21 Ultras here as it has smaller effective pixels. The iPhone and Pixel have good night modes but are laggards in the hardware department in terms of their sensors. The Axon 30 Ultra is again extremely flat.

Click for full image
[ X-T30 ( ) ]
[ S21U(S)  -  ] [ Mi 11 Ultra  -  ] [ Axon 30 Ultra  -  ] [ OnePlus 9 Pro  -  ]
[ Mi 11  -  ] [ S21(E)  -  ] [ iPhone 12 Pro ] [ Pixel 5  -  ]

This scene was extremely dark and generally just lit by far away street lights and just the light pollution in the cloudy sky. It’s not a very realistic scenario, but just a general showcase of the extremes of what the sensors and night modes can do.

The Mi 11 Ultra is the best performer alongside the OnePlus 9 Pro, one has the hardware advantage while the other seems to have a good night mode that extracts details in extreme low light. The S21 beats the S21 Ultra in getting any light in, even though it’s extremely noisy. The Pixel has a stronger night mode in the shadows than Apple, but both suffer from getting any light. The Axon 30 Ultra has a bright image but generally only useable as a thumbnail as it’s a blurry mess.

Overall Low-Light Conclusion

In general, the low-light results largely tracked with what we expected from the phones. The top performers are naturally those devices which have a hardware sensor advantage, with big sensors and larger effective pixels. This includes the Mi 11 Ultra and the S21 Ultra, with the OnePlus 9 Pro also being extremely competitive. Following the sensor advantages, it’s about the computational photography night modes. I think Samsung produces amongst the best results here as it has colours that are more often representative of the scene, whereas other phones can get colour temperature wrong. The Pixel here for example is almost always wrong as it tries to colour balance to the extreme instead of capturing the lighting of the scene.

Generally, the Samsung phones were the most versatile and consistent across the camera modules, while for the other phones the results could vary quite a lot from scene to scene. A phone camera is still only a phone camera and has many weaknesses in low-light, it will be interesting where vendors are heading next in terms of trying to augment their photography capabilities.

Daylight: Main Camera HDR Device Conclusions & Remarks
Comments Locked

60 Comments

View All Comments

  • hemedans - Saturday, June 26, 2021 - link

    Thank Nokia for Camera we have today, pureview was mother of phone camera and even today Ex Nokians are the one who revolutionize camera in other companies like Xiaomi, Huawei and Apple.
  • rajuk - Monday, June 21, 2021 - link

    Good review, can see the effort involved here.
    Like the idea of using reference camera. Could have been complete review if human subjects are involved to show the phones handle skin tones and textures. Majority of the pics at least half of the pics are use to capture people/human subjects. I noticed an issue with my s21 ultra even the slightest hand movement causes blurry pics. Where as my old pixel 4 xl is perfectly fine
  • s.yu - Wednesday, June 23, 2021 - link

    No, better to take people out of the equation, failure to use models of every skin tone risks accusations of racism! 😪
  • Teckk - Monday, June 21, 2021 - link

    Fantastic article Andrei.
    What would you want from future phones in terms of camera upgrades? Also, do you see phone with higher optical zoom incoming anytime soon?
  • Andrei Frumusanu - Tuesday, June 22, 2021 - link

    I consider the regular S21 great because it defies conventional wisdom, the Mi 11 also is very versatile due to it fully using its hardware that's designed with a balance.

    We don't need higher zoom unless it's on an additional module, filling the focal range with good quality results first should be priority.
  • Kangal - Thursday, June 24, 2021 - link

    Looking at teardowns, it seems these 5-camera modules take up quiet a lot of precious internal space with some very questionable results.

    What do you think about a phone with only 1 huge sensor, and an internal (periscope) lens, that covers a wide focal range? Eg from macro, ultrawide, wide, telephoto, and zoom. In theory, it might take up slightly less internal space, be slightly cheaper to manufacture, and yield slightly better quality shots at every every stage.
    ....would that even be do-able?
  • s.yu - Thursday, June 24, 2021 - link

    Not doable. The periscope, due to thickness limitation, severely limits the physical size of the aperture, which means it could only stay clear of "unacceptably slow" if it covered a small frame.
  • sharath.naik - Thursday, July 1, 2021 - link

    Agree.. best choice they have is a 3x..4x 48mp camera and a 8x 48mp periscope. this should have all the range needed by every one.
  • Fulljack - Tuesday, June 22, 2021 - link

    wait, no iPhone 12 Pro Max? while Apple fans would surely argue that it's the best camera, I'm just curious on how it compares.
  • s.yu - Wednesday, June 23, 2021 - link

    I agree, since they bought so many devices for review, might as well buy the one with the most hardware differences compared to the previous generation.

Log in

Don't have an account? Sign up now