On September 12th of this year, Apple unveiled its iPhone 15 series. The entire line-up is divided into four models depending on screen size and specifications: iPhone 15, iPhone 15 Plus, iPhone 15 Pro, and iPhone 15 Pro Max.
Among them, the iPhone 15 Pro Max has a telephoto camera that supports 5x optical zoom. This allows users to capture subjects from a distance as if they were close up. Moreover, with a maximum aperture of F2.8, it has excellent light intake, making it advantageous for taking bright photos even in dark shooting environments.
The technology embedded in the iPhone 15 Pro Max’s telephoto camera is top-notch within the series. However, a company has emerged claiming that the software level does not match this, which is disappointing. The U.S. optical technology startup Glass Imaging posted on its website on October 27th (local time) that the image processing technology of the iPhone 15 Pro Max does not fully utilize the performance of the telephoto camera.
When a photo is taken with a camera, the light is received by the sensor through the lens, the color data of the light recognized by each pixel of the sensor is collected, the image processing device (ISP) corrects the photo, and then the photo is stored in the device. Glass Imaging claimed that Apple’s ISP did not adequately fix the photos, failing to utilize the potential of the superior hardware.
What’s the difference between Glass Imaging’s technology and Apple’s?
Through the post, Glass Imaging explained the main features of its proprietary image processing software, GlassAI.
Existing image processing algorithms do not consider the subject’s characteristics in the photo or the overall balance. Therefore, the existing algorithm makes even the hair and fiber textures bland when it removes the image’s noise. On the other hand, GlassAI distinguishes between noise and non-noise in the photo, allowing it to remove noise while preserving the subject’s texture. In addition, GlassAI has divided algorithms specialized for low light, daylight, and telephoto environments, also optimized each for the various cameras installed on the iPhone.
The image processing speed is also fast. It takes a photo, processes the data, and then stores it in only about 0.5 seconds. Moreover, additional images can be taken while the data is being processed.
Glass Imaging stated that the performance of the chipset installed in existing smartphones was insufficient to correct photos finely. So far, AI has been used only for corrections applied to the entire image, such as adjusting the white balance or changing the exposure value. On the other hand, it added that the iPhone 15 Pro Max has improved computational performance and can quickly process tasks to finely correct images.
How much will the iPhone camera quality improve with GlassAI applied?
Glass Imaging compared photos taken with the iPhone 15 Pro Max camera in two versions. One picture shows correction by the ISP built into the default Apple camera, and the other displays the image’s raw data (RAW) updated with GlassAI.
Looking at the photo taken of a color/resolution chart, the default version has noise throughout, making the colors inconsistent. On the other hand, the picture corrected by GlassAI has significantly reduced noise to the point of being invisible, and the image is much more apparent. The photo’s white balance, updated by GlassAI, is also closer to reality.
When taking photos with a smartphone telephoto camera, the texture of the subject and letters often blur. Looking at the picture taken with the 5x telephoto camera of the iPhone 15 Pro Max, the default version has the floor texture and the writing on the wrapper partially broken. The photo’s main subject, the bread, is also challenging to recognize as a circle. On the other hand, the image corrected by GlassAI clearly expresses the texture of the floor and bread, as well as the writing.
When you zoom in and take a photo, the default ISP fails to recognize the text on the screen properly. In the example photo, the default version has distorted the letters written above and below the dial to the point of being unrecognizable. It results from incorrect correction due to failure to recognize the text. GlassAI nearly perfectly maintained the content and shape of the letters. It’s not even a similar font added in. Glass Imaging emphasized that it does not synthesize other images or create fake data during correction.
Will there be an iPhone-specific app?… “For now, selling the technology is the priority”
Looking at the example photos listed by Glass Imaging, it feels like they have fully utilized the camera performance of the iPhone 15 Pro Max, as the company claims. If released, a camera app with GlassAI applied would be worth using instead of the default one. However, Glass Imaging mentioned they are considering releasing an iPhone-specific app but have not confirmed this, and even if released, it would be later. The company revealed that its top priority is to sell its core technology to smartphone manufacturers.
By. Lee Byung Chan
Most Commented