Augmented Reality, or, An Ultra-Cool iPhone 3GS Feature, Yelping For Your Help
To say that we’re excited about Augmented Reality would be an understatement. The concept—overlaying computer-generated graphics and data on top of live video feeds—quite literally has the potential to change the way we travel, shop, and acquire information on all sorts of things. Imagine being able to hold your iPhone up in a store and see prices for all the items inside at a distance, or walk down the street and see menus for all the restaurants. One just-released iPhone app is already offering Paris street and Metro navigation tools with an Augmented Reality interface, overlaying subway entrance details and point of interest data on top of whatever your camera is looking at. It is unbelievably, seriously cool stuff, though currently limited to the iPhone 3GS as the feature depends on compass, GPS, and camera hardware. If Apple tosses them all into the iPod touch 3G, plus a battery capable of actually powering all three at the same time, we might just see these apps seriously take off.
There are, of course, two other potential stumbling blocks: the reliability of Apple’s compass and GPS tools, and the quality of the augmented reality software itself. We’re still in the process of sorting out which is to blame for some very different experiences we’ve had with the new version of Yelp for iPhone, which just launched with an augmented reality mode as an easter egg. Download the app, the instructions go, shake your iPhone 3GS three times, and up will pop a dialogue box for The Monocle, a hidden feature that overlays your current live camera video with Yelp’s local business data. We followed the instructions, and after way more than three shakes, several reloads, and a prayer, a Monocle button did appear. We pressed it. And that’s when the confusion began. What we saw on our iPhone 3GS, running iPhone OS 3.0, could only be described as a very poor implementation of augmented reality—so weak that we initially felt that Yelp shouldn’t have included it in the app at all. A reader echoed our thoughts in a comment this morning: “I see this more as a proof of concept than a working feature.”
In initial tests, there were so many things wrong with Yelp’s implementation that we couldn’t believe what we were seeing. Unless we were really close to a business in its database, the data overlays were unreadably small, and couldn’t be made larger without literally getting up and walking towards the places that were being identified. Then, they were so rarely in the proper position on screen to be interacted with that we needed to turn ourselves around to see them, even when the places are physically nearby. Next, there was the loading—data isn’t cached, which would kill the feature for hypothetical iPod touch 3G users—so the data was all but completely worthless when we tried the app as passengers in cars. Every few seconds, a “Loading” box appeared, updating the list with such frequency that we couldn’t even see the choices—we took a bunch of screenshots and only could only find one where options were actually, albeit very briefly, visible at the center of the screen. Even then, they were stacked in a basically useless list form with restaurant names blocked out for four of the 11 listings, and unreadable in three more.
But this wasn’t the only Yelp story. Despite the reader comment above, we were so surprised by what we were seeing that we asked around to see whether other iPhone 3GS users were experiencing the same things. One, based in another city, said no. He was getting very good results, he said, almost excellent ones. Labels were large and easy to read. The compass appeared to be stable, rather than jittery. And oh, by the way, he was running iPhone OS 3.1, whereas we were running iPhone OS 3.0. Maybe that was the difference?
In light of reports that Apple will be officially supporting augmented reality applications with version 3.1 of the iPhone OS, this could make some sense. But for the time being, it’s hard to know whether the performance problems we were seeing were a result of wonky iPhone 3GS hardware, a feature that doesn’t work the same in every city, or less than 3.0-optimized software. We’ve asked Yelp for comment and will let you know what we find out.
Once Apple enables full support for this feature, we predict that there’s going to be a goldrush-caliber series of efforts to augment reality with all sorts of questionable data and algorithms—tons of cheesy apps like “McDonalds Finder” and “Toilet Locator 3GS” and, of course, “Nearby Farts.” Please, developers, before you spend your time and labor on applications like this, please take note: the goal is to usefully augment reality with information people actually care about, can read, and rely upon. For the time being, Yelp on the iPhone seems to be delivering somewhat inconsistent results depending on factors that aren’t within the user’s control; we look forward to finding out whether performance actually does improve with 3.1, or or whether other issues are to blame. Those who have tried the new application with the iPhone 3GS are welcomed to offer insights and comments below; please mention your city and OS version in your comments.
Updated: A Yelp spokesman told iLounge that three key factors—Yelp’s database, GPS/location service data from the iPhone, and compass data from the iPhone—explain performance inconsistencies from user to user and city to city. The company’s database of businesses, featuring “some of the best data quality in the industry,” hasn’t needed to be audited in the past for small inaccuracies in latitude and longitude coordinates; for augmented reality, however, “it needs to be pretty dead on.” Regarding GPS/location service information, “even if the lat/long you get back from Core Location is 50 feet off, there’s a degradation in the experience.” In Yelp’s experience, both the database and the iPhone’s GPS/location service data are more accurate in major cities, which together would explain why we saw what we saw. The compass? iPhone OS 3.1? Yelp believes that the compass information is “generally solid” in OS 3.0, and the company hasn’t tried the Monocle on OS 3.1. It’ll surely only get better with time.
If you have a comment, news tip, advertising inquiry, or coverage request, a question about iPods or accessories, or if you sell or market products, read iLounge's Comments + Questions policies before posting, and fully identify yourself if you do. We will delete comments containing advertising, astroturfing, trolling, personal attacks, offensive language, or other objectionable content, then ban and/or publicly identify violators. Wondering why we're talking about something other than iPods? Check the Archives: Backstage has been here and kicking it since 2004.
- Report: iOS 9 will bring new security features, improve legacy device support
- Report: Apple’s push for local content may delay Apple’s TV service
- Adobe dropping Photoshop Touch in favor of more focused apps
- Report: Dual app viewing, multiple logins coming to iPad
- Transit coming to Apple Maps in iOS 9?
- Apple and IBM expand MobileFirst apps to Apple Watch
- Report: Pebble facing financial struggles?
- iOS 9 to include new Home app for HomeKit?
- Report: Apple to bring Apple Watch font to iOS 9
- Leak reveals Flow by Outlook, a Microsoft email messaging app for iPhone
- Apple iPhone Lightning Dock
- Witti Notti and Dotti
- PhoneSuit Elite 6 and Elite 6 Pro Battery Case for iPhone 6 and iPhone 6 Plus
- Wren V5US Speaker
- Skech Base for iPad Air 2
- Anova Culinary Precision Cooker
- Phiaton MS 100 BA Earphones
- Olloclip Ollocase for iPhone 6
- AKG Y50 On-Ear Headphones
- Audio-Technica ATH-MSR7 SonicPro Over-Ear Headphones
- Will removing a credit card from Safari also remove it from Apple Pay?
- Can I mute Handoff calls coming into my Mac from my iPhone?
- How do I keep my iPhone calls from ringing on my Mac?
- Why doesn’t Traffic show up on my Today Notifications Screen?
- Why doesn’t my iPhone reconnect to Wi-Fi after I turn it on?
- Why can’t I see the iPad-style landscape view on my iPhone 6 Plus?
- Is there a point to having both iCloud Photo Library and iCloud Photo Stream enabled?
- Why can’t I set a longer passcode timeout on my iPhone 6 Plus?
- Can I turn off Message Read Receipts for only some users?
- How do I share one iCloud Photo Library within a family?