iPhone Xr

At long last, pet portraits with background blur are possible on the iPhone XR

Posted by | Apps, artificial intelligence, bokeh, Gadgets, halide, iPhone, iPhone Xr, Mobile, Photography | No Comments

The new iPhones have some great new photography features, but the XR lacks a couple, for instance portrait mode for non-people subjects, owing to its sadly having only the one camera. So last year! Fortunately third-party camera app Halide is here to help you get that professional-looking bokeh in your doggo shots.

There’s more to this than simply the lack of a second camera. As you know, because you read my article, The future of photography is code — and the present too, really. What’s great about this is that features that might otherwise rely on specific hardware, a chip or sensor, can often be added in software. Not always, but sometimes.

In the case of the iPhone XR, the lack of a second camera means depth data is very limited, meaning the slack has to be taken up with code. The problem was that Apple’s machine learning systems on there are only trained to recognize and create high-quality depth maps of people. Not dogs, cats, plants or toy robots.

People would be frustrated if the artificial background blur inexplicably got way worse when it was pointed at something that wasn’t a person, so the effect just doesn’t trigger unless someone’s in the shot.

The Halide team, not bound by Apple’s qualms, added the capability back in by essentially taking the raw depth data produced by the XR’s “focus pixels” and applying their own processing and blur effect to make sure it doesn’t do weird things. It works on anything that can realistically be separated from the background — pets, toy robots, etc. — because it isn’t a system specific to human faces.

As they write in a blog post explaining some of this at length, the effect isn’t perfect, and because of how depth data is sent from the camera to the OS, you can’t preview the function. But it’s better than nothing at all, and maybe people on Instagram will think you shelled out for the XS instead of the XR (though you probably made the right choice).

The update (1.11) is awaiting Apple approval and should be available soon. If you don’t already own Halide, it costs $6. Small price to pay for a velvety background blur in your chinchilla pics.

Powered by WPeMatico

Review: Apple’s iPhone XR is a fine young cannibal

Posted by | Android, Apple, apple inc, Google, iOS, iPad, iPhone, iphone 5c, iPhone Xr, iPhone XS, smartphone, smartphones, TC, technology | No Comments

This iPhone is great. It is most like the last iPhone — but not the last “best” iPhone — more like the last not as good iPhone. It’s better than that one though, just not as good as the newest best iPhone or the older best iPhone.

If you’re upgrading from an iPhone 7 or iPhone 8, you’re gonna love it and likely won’t miss any current features while also getting a nice update to a gesture-driven phone with Face ID. But don’t buy it if you’re coming from an iPhone X, you’ll be disappointed as there are some compromises from the incredibly high level of performance and quality in Apple’s last flagship, which really was pushing the envelope at the time.

From a consumer perspective, this is offering a bit of choice that targets the same kind of customer who bought the iPhone 8 instead of the iPhone X last year. They want a great phone with a solid feature set and good performance but are not obsessed with ‘the best’ and likely won’t notice any of the things that would bug an iPhone X user about the iPhone XR.

On the business side, Apple is offering the iPhone XR to make sure there is no pricing umbrella underneath the iPhone XS and iPhone XS Max, and to make sure that the pricing curve is smooth across the iPhone line. It’s not so much a bulwark against low-end Android, that’s why the iPhone 8 and iPhone 7 are sticking around at those low prices.

Instead it’s offering an ‘affordable’ option that’s similar in philosophy to the iPhone 8’s role last year but with some additional benefits in terms of uniformity. Apple gets to move more of its user base to a fully gesture-oriented interface, as well as giving them Face ID. It benefits from more of its pipeline being dedicated to devices that share a lot of components like the A12 and True Depth camera system. It’s also recognizing the overall move towards larger screens in the market.

If Apple was trying to cannibalize sales of the iPhone XS, it couldn’t have created a better roasting spit than the iPhone XR.

Screen

Apple says that the iPhone XR has ‘the most advanced LCD ever in a smartphone’ — their words.

The iPhone XR’s screen is an LCD, not an OLED. This is one of the biggest differences between the iPhone XR and the iPhone XS models, and while the screen is one of the best LCDs I’ve ever seen, it’s not as good as the other models. Specifically, I believe that the OLED’s ability to display true black and display deeper color (especially in images that are taken on the new XR cameras in HDR) set it apart easily.

That said, I have a massive advantage in that I am able to hold the screens side by side to compare images. Simply put, if you don’t run them next to one another, this is a great screen. Given that the iPhone XS models have perhaps the best displays ever made for a smartphone, coming in a very close second isn’t a bad place to be.

A lot of nice advancements have been made here over earlier iPhone LCDs. You get True Tone, faster 120hz touch response and wide color support. All on a 326 psi stage that’s larger than the iPhone 8 Plus in a smaller body. You also now get tap-to-wake, another way Apple is working hard to unify the design and interaction language of its phones across the lineup.

All of these advancements don’t come for free to an LCD. There was a lot of time, energy and money spent getting the older technology to work as absolutely closely as possible to the flagship models. It’s rare to the point of non-existence that companies care at all to put in the work to make the lower end devices feel as well worked as the higher end ones. For as much crap as Apple gets about withholding features to get people to upsell, there is very little of that happening with the iPhone XR, quite the opposite really.

There are a few caveats here. First, 3D touch is gone, replaced by ‘Haptic Touch’ which Apple says works similarly to the MacBook’s track pad. It provides feedback from the iPhone’s Taptic vibration engine to simulate a ‘button press’ or trigger. In practice, the reality of the situation is that it is a very prosaic ‘long press to activate’ more than anything else. It’s used to trigger the camera on the home screen and the flashlight, and Apple says it’s coming to other places throughout the system as it sees it appropriate and figures out how to make it feel right.

I’m not a fan. I know 3D touch has its detractors, even among the people I’ve talked to who helped build it, I think it’s a clever utility that has a nice snap to it when activating quick actions like the camera. In contrast, on the iPhone XR you must tap and hold the camera button for about a second and a half — no pressure sensitivity here obviously — as the system figures out that this is an intentional press by determining duration, touch shape and spread etc and then triggers the action. You get the feedback still, which is nice, but it feels disconnected and slow. It’s the best case scenario without the additional 3D touch layer, but it’s not ideal.

I’d also be remiss if I didn’t mention that the edges of the iPhone XR screen have a slight dimming effect that is best described as a ‘drop shadow’. It’s wildly hard to photograph but imagine a very thin line of shadow around the edge of the phone that gets more pronounced as you tilt it and look at the edges. It’s likely an effect of the way Apple was able to get a nice sharp black drop-off at the edges that gets that to-the-edges look of the iPhone XR’s screen.

Apple is already doing a ton of work rounding the corners of the LCD screen to make them look smoothly curved (this works great and is nearly seamless unless you bust out the magnifying loupe) and it’s doing some additional stuff around the edge to keep it looking tidy. They’ve doubled the amount of LEDs in the screen to make that dithering and the edging possible.

Frankly, I don’t think most people will ever notice this slight shading of dark around the edge — it is very slight — but when the screen is displaying mostly white and it’s next to the iPhone XS it’s visible.

Oh, the bezels are bigger. It makes the front look slightly less elegant and screenful than the iPhone XS, but it’s not a big deal.

Camera

Yes, the portrait mode works. No, it’s not as good as the iPhone XS. Yes, I miss having a zoom lens.

All of those things are true and easily the biggest reason I won’t be buying an iPhone XR. However, in the theme of Apple working its hardest to make even its ‘lower end’ devices work and feel as much like its best, it’s really impressive what has been done here.

The iPhone XR’s front-facing camera array is identical to what you’ll find in the iPhone XS. Which is to say it’s very good.

The rear facing camera is where it gets interesting, and different.

The rear camera is a single lens and sensor that is both functionally and actually identical to the wide angle lens in the iPhone XS. It’s the same sensor, the same optics, the same 27mm wide-angle frame. You’re going to get great ‘standard’ pictures out of this. No compromises.

However, I found myself missing the zoom lens a lot. This is absolutely a your mileage may vary scenario, but I take the vast majority of my pictures with the telephoto lens. Looking back at my year with the iPhone X I’d say north of 80% of my pictures were shot with the telephoto, even if they were close ups. I simply prefer the “52mm” equivalent with its nice compression and tight crop. It’s just a better way to shoot than a wide angle — as any photographer or camera company will tell you because that’s the standard (equivalent) lens that all cameras have shipped with for decades.

Wide angle lenses were always a kludge in smartphones and it’s only in recent years that we’ve started getting decent telephotos. If I had my choice, I’d default to the tele and have a button to zoom out to the wide angle, that would be much nicer.

But with the iPhone XR you’re stuck with the wide — and it’s a single lens at that, without the two different perspectives Apple normally uses to gather its depth data to apply the portrait effect.

So they got clever. iPhone XR portrait images still contain a depth map that determines foreground, subject and background, as well as the new segmentation map that handles fine detail like hair. While the segmentation maps are roughly identical, the depth maps from the iPhone XR are nowhere as detailed or information rich as the ones that are generated by the iPhone XS.

See the two maps compared here, the iPhone XR’s depth map is far less aware of the scene depth and separation between the ‘slices’ of distance. It means that the overall portrait effect, while effective, is not as nuanced or aggressive.

In addition, the iPhone XR’s portrait mode only works on people.You’re also limited to just a couple of the portrait lighting modes: studio and contour.

In order to accomplish portrait mode without the twin lens perspective, Apple is doing facial landmark mapping and image recognition work to determine that the subject you’re shooting is a person. It’s doing depth acquisition by acquiring the map using a continuous real-time buffer of information coming from the focus pixels embedded in the iPhone XR’s sensor that it is passing to the A12 Bionic’s Neural Engine. Multiple neural nets analyze the data and reproduce the depth effect right in the viewfinder.

When you snap the shutter it combines the depth data, the segmentation map and the image data into a portrait shot instantaneously. You’re able to see the effect immediately. It’s wild to see this happen in real time and it boggles thinking about the horsepower needed to do this. By comparison, the Pixel 3 does not do real time preview and takes a couple of seconds to even show you the completed portrait shot once it’s snapped.

It’s a bravura performance in terms of silicon. But how do the pictures look?

I have to say, I really like the portraits that come out of the iPhone XR. I was ready to hate on the software-driven solution they’d come up with for the single lens portrait but it’s pretty damn good. The depth map is not as ‘deep’ and the transitions between out of focus and in focus areas are not as wide or smooth as they are on iPhone XS, but it’s passable. You’re going to get more funny blurring of the hair, more obvious hard transitions between foreground and background and that sort of thing.

And the wide angle portraits are completely incorrect from an optical compression perspective (nose too large, ears too small). Still, they are kind of fun in an exaggerated way. Think the way your face looks when you get to close to your front camera.

If you take a ton of portraits with your iPhone, the iPhone XS is going to give you a better chance of getting a great shot with a ton of depth that you can play with to get the exact look that you want. But as a solution that leans hard on the software and the Neural Engine, the iPhone XR’s portrait mode isn’t bad.

Performance

Unsurprisingly, given that it has the same exact A12 Bionic processor, but the iPhone XR performs almost identically to the iPhone XS in tests. Even though it features 3GB of RAM to the iPhone XS’ 4GB, the overall situation here is that you’re getting a phone that is damn near identical as far as speed and capability. If you care most about core features and not the camera or screen quirks, the iPhone XR does not offer many, if any, compromises here.

Size

The iPhone XR is the perfect size. If Apple were to make only one phone next year, they could just make it XR-sized and call it good. Though I am now used to the size of the iPhone X, a bit of extra screen real-estate is much appreciated when you do a lot of reading and email. Unfortunately, the iPhone XS Max is a two-handed phone, period. The increase in vertical size is lovely for reading and viewing movies, but it’s hell on reachability. Stretching to the corners with your thumb is darn near impossible and to complete even simple actions like closing a modal view inside an app it’s often easiest (and most habitual) to just default to two hands to perform those actions.

For those users that are ‘Plus’ addicts, the XS Max is an exercise in excess. It’s great as a command center for someone who does most of their work on their iPhones or in scenarios where it’s their only computer. My wife, for instance, has never owned her own computer and hasn’t really needed a permanent one in 15 years. For the last 10 years, she’s been all iPhone, with a bit of iPad thrown in. I myself am now on a XS Max because I also do a huge amount of my work on my iPhone and the extra screen size is great for big email threads and more general context.

But I don’t think Apple has done enough to capitalize on the larger screen iPhones in terms of software — certainly not enough to justify two-handed operation. It’s about time iOS was customized thoroughly for larger phones beyond a couple of concessions to split-view apps like Mail.

That’s why the iPhone XR’s size comes across as such a nice compromise. It’s absolutely a one-handed phone, but you still get some extra real-estate over the iPhone XS and the exact same amount of information appears on the iPhone XR’s screen as on the iPhone XS Max in a phone that is shorter enough to be thumb friendly.

Color

Apple’s industrial design chops continue to shine with the iPhone XR’s color finishes. My tester iPhone was the new Coral color and it is absolutely gorgeous.

The way Apple is doing colors is like nobody else. There’s no comparison to holding a Pixel 3, for instance. The Pixel 3 is fun and photographs well, but super “cheap and cheerful” in its look and feel. Even though the XR is Apple’s mid-range iPhone, the feel is very much that of a piece of nicely crafted jewelry. It’s weighty, with a gorgeous 7-layer color process laminating the back of the rear glass, giving it a depth and sparkle that’s just unmatched in consumer electronics.

The various textures of the blasted aluminum and glass are complimentary and it’s a nice melding of the iPhone 8 and iPhone X design ethos. It’s massively unfortunate that most people will be covering the color with cases, and I expect clear cases to explode in popularity when these phones start getting delivered.

It remains very curious that Apple is not shipping any first-party cases for the iPhone XR — not even the rumored clear case. I’m guessing that they just weren’t ready or that Apple was having issues with some odd quirk of clear cases like yellowing or cracking or something. But whatever it is, they’re leaving a bunch of cash on the table.

Apple’s ID does a lot of heavy lifting here, as usual. It often goes un-analyzed just how well the construction of the device works in conjunction with marketing and market placement to help customers both justify and enjoy their purchase. It transmits to the buyer that this is a piece of quality kit that has had a lot of thought put into it and makes them feel good about paying a hefty price for a chunk of silicon and glass. No one takes materials science anywhere as seriously at Apple and it continues to be on display here.

Should you buy it?

As I said above, it’s not that complicated of a question. I honestly wouldn’t overthink this one too much. The iPhone XR is made to serve a certain segment of customers that want the new iPhone but don’t necessarily need every new feature. It works great, has a few small compromises that probably won’t faze the kind of folks that would consider not buying the best and is really well built and executed.

“Apple’s pricing lineup is easily its strongest yet competitively,” creative Strategies’ Ben Bajarin puts it here in a subscriber piece. “The [iPhone] XR in particular is well lined up against the competition. I spoke to a few of my carrier contacts after Apple’s iPhone launch event and they seemed to believe the XR was going to stack up well against the competition and when you look at it priced against the Google Pixel ($799) and Samsung Galaxy 9 ($719). Some of my contacts even going so far to suggest the XR could end up being more disruptive to competitions portfolios than any iPhone since the 6/6 Plus launch.”

Apple wants to fill the umbrella, leaving less room than ever for competitors. Launching a phone that’s competitive in price and features an enormous amount of research and execution that attempt to make it as close a competitor as possible to its own flagship line, Apple has set itself up for a really diverse and interesting fiscal Q4.

Whether you help Apple boost its average selling price by buying one of the maxed out XS models or you help it block another Android purchase with an iPhone XR, I think it will probably be happy having you, raw or cooked.

Powered by WPeMatico

The iPhone XR shows Apple admitting 3D Touch is a failure

Posted by | 3d touch, Apple, apple inc, blackberry storm, Haptic Touch, iOS, iPhone Xr, Mobile, multi-touch, technology, touchscreen | No Comments

Remember 3D Touch? Unless you’re a power iOS user you probably don’t. Or, well, you’d rather not. It’s been clear for some time now that the technology Apple lauded at its 2015 unveiling as the “next generation of multi-touch” most certainly wasn’t. For the mainstream iPhone user it’s just that annoying thing that gets in the way of what you’re actually trying to do.

What Apple actually made with 3D Touch is the keyboard shortcut of multi-touch. Aka a secret weapon for nerds only.

Pro geeks might be endlessly delighted about being able to learn the secrets of its hidden depths, and shave all-important microseconds off of their highly nuanced workflows. But everyone else ignores it.

Or at least tries to ignore it — until, in the middle of trying to do something important they accidentally trigger it and get confused and annoyed about what their phone is trying to do to them.

Tech veterans might recall that BlackBerry (remember them?!) tried something similarly misplaced a decade ago on one of its handsets — unboxing an unlovely (and unloved) clickable touchscreen, in the one-off weirdo BlackBerry Storm.

The Storm didn’t have the iconic physical BlackBerry keyboard but did have a touchscreen with on-screen qwerty keys you could still click. In short, madness!

Safe to say, no usage storms resulted then either — unless you’re talking about the storm of BlackBerry buyers returning to the shop demanding a replacement handset.

In Apple’s case, the misstep is hardly on that level. But three years on from unveiling 3D Touch, it’s now ‘fessing up to its own feature failure — as the latest iPhone line-up drops the pressure-sensing technology entirely from the cheapest of the trio: The iPhone XR.

The lack of 3D Touch on the XR will help shave off some manufacturing cost and maybe a little thickness from the device. Mostly though it shows Apple recognizing it expended a lot of engineering effort to make something most iPhone users don’t use and don’t want to use — given, as TC’s Brian Heater has called it, the iPhone XR is the iPhone for the rest of us.

It isn’t a budget handset, though. The XR does pack Apple’s next-gen biometric technology, Face ID, for instance, so contains a package of sophisticated sensor hardware lodged in its own top notch.

That shows Apple is not cheaping out here. Rather it’s making selective feature decisions based on what it believes iPhone users want and need. So the clear calculation in Cupertino is lots of iPhone users simply don’t need 3D Touch.

At the same time, company execs heaped praise on Face ID at its event this week, saying the technology has proved wildly popular with users. Yet they glossed over the simultaneous depreciation of 3D Touch at the end of the iPhone line without a word of explanation.

Compare the two technologies and it’s easy to see why.

Face ID’s popularity is hardly surprising. It’s hard to think of a simpler interaction than a look that unlocks.

Not so fiddly 3D Touch — which requires a press that’s more than a tap and kind of akin to a push or a little shove. Push too softly and you’ll get a tap which takes you somewhere you weren’t trying to go. But go in too hard from the start and the touchscreen starts to feel like work and/or wasted effort.

On top of that the sought for utility can itself feel pointless — with, for example, content previews that can be horribly slow to load, so why not just tap and look at the email in the first place?

With all the fingering and faffing around 3D Touch is like the Goldilocks of user interfaces: Frustration is all but guaranteed unless you have an awful lot of patience to keep going and going until you get it just right. And who, but power users, can be bothered with that?

For the ‘everyman’ iPhone XR, Apple has swapped 3D Touch for a haptic feedback feature (forgettably named Haptic Touch) — that’s presumably mostly intended to be a sticking plaster to smooth out any fragmentation cracks across the iPhone estate, i.e. in the rare instances where developers have made use of 3D Touch to create in-app shortcuts that people do actually want to use.

If, as we’ve suggested, the iPhone XR ends up being the iPhone that ships in serious quantities there will soon be millions of iOS users without access to 3D Touch at all. So Apple is relegating the technology it once called the future of multi-touch to what it really was: An add-on power feature for pro users.

Pro users are also the people most likely to be willing to spend the biggest bucks on an iPhone — and so will happily shell out to own the iPhone XS or XS Max (which do retain 3D Touch, at least for now).

So while 3D Touch might keep incrementally helping to shift a few extra premium iPhones at the top of the range, it isn’t going to be shifting any paradigms.

Multitouch — combined with generous screen real estate — has been more than good enough on that front.

Powered by WPeMatico