Augmented Reality, or, An Ultra-Cool iPhone 3GS Feature, Yelping For Your Help
Published: Friday, August 28, 2009
To say that we’re excited about Augmented Reality would be an understatement. The concept—overlaying computer-generated graphics and data on top of live video feeds—quite literally has the potential to change the way we travel, shop, and acquire information on all sorts of things. Imagine being able to hold your iPhone up in a store and see prices for all the items inside at a distance, or walk down the street and see menus for all the restaurants. One just-released iPhone app is already offering Paris street and Metro navigation tools with an Augmented Reality interface, overlaying subway entrance details and point of interest data on top of whatever your camera is looking at. It is unbelievably, seriously cool stuff, though currently limited to the iPhone 3GS as the feature depends on compass, GPS, and camera hardware. If Apple tosses them all into the iPod touch 3G, plus a battery capable of actually powering all three at the same time, we might just see these apps seriously take off.
There are, of course, two other potential stumbling blocks: the reliability of Apple’s compass and GPS tools, and the quality of the augmented reality software itself. We’re still in the process of sorting out which is to blame for some very different experiences we’ve had with the new version of Yelp for iPhone, which just launched with an augmented reality mode as an easter egg. Download the app, the instructions go, shake your iPhone 3GS three times, and up will pop a dialogue box for The Monocle, a hidden feature that overlays your current live camera video with Yelp’s local business data. We followed the instructions, and after way more than three shakes, several reloads, and a prayer, a Monocle button did appear. We pressed it. And that’s when the confusion began. What we saw on our iPhone 3GS, running iPhone OS 3.0, could only be described as a very poor implementation of augmented reality—so weak that we initially felt that Yelp shouldn’t have included it in the app at all. A reader echoed our thoughts in a comment this morning: “I see this more as a proof of concept than a working feature.”
In initial tests, there were so many things wrong with Yelp’s implementation that we couldn’t believe what we were seeing. Unless we were really close to a business in its database, the data overlays were unreadably small, and couldn’t be made larger without literally getting up and walking towards the places that were being identified. Then, they were so rarely in the proper position on screen to be interacted with that we needed to turn ourselves around to see them, even when the places are physically nearby. Next, there was the loading—data isn’t cached, which would kill the feature for hypothetical iPod touch 3G users—so the data was all but completely worthless when we tried the app as passengers in cars. Every few seconds, a “Loading” box appeared, updating the list with such frequency that we couldn’t even see the choices—we took a bunch of screenshots and only could only find one where options were actually, albeit very briefly, visible at the center of the screen. Even then, they were stacked in a basically useless list form with restaurant names blocked out for four of the 11 listings, and unreadable in three more.
But this wasn’t the only Yelp story. Despite the reader comment above, we were so surprised by what we were seeing that we asked around to see whether other iPhone 3GS users were experiencing the same things. One, based in another city, said no. He was getting very good results, he said, almost excellent ones. Labels were large and easy to read. The compass appeared to be stable, rather than jittery. And oh, by the way, he was running iPhone OS 3.1, whereas we were running iPhone OS 3.0. Maybe that was the difference?
In light of reports that Apple will be officially supporting augmented reality applications with version 3.1 of the iPhone OS, this could make some sense. But for the time being, it’s hard to know whether the performance problems we were seeing were a result of wonky iPhone 3GS hardware, a feature that doesn’t work the same in every city, or less than 3.0-optimized software. We’ve asked Yelp for comment and will let you know what we find out.
Once Apple enables full support for this feature, we predict that there’s going to be a goldrush-caliber series of efforts to augment reality with all sorts of questionable data and algorithms—tons of cheesy apps like “McDonalds Finder” and “Toilet Locator 3GS” and, of course, “Nearby Farts.” Please, developers, before you spend your time and labor on applications like this, please take note: the goal is to usefully augment reality with information people actually care about, can read, and rely upon. For the time being, Yelp on the iPhone seems to be delivering somewhat inconsistent results depending on factors that aren’t within the user’s control; we look forward to finding out whether performance actually does improve with 3.1, or or whether other issues are to blame. Those who have tried the new application with the iPhone 3GS are welcomed to offer insights and comments below; please mention your city and OS version in your comments.
Updated: A Yelp spokesman told iLounge that three key factors—Yelp’s database, GPS/location service data from the iPhone, and compass data from the iPhone—explain performance inconsistencies from user to user and city to city. The company’s database of businesses, featuring “some of the best data quality in the industry,” hasn’t needed to be audited in the past for small inaccuracies in latitude and longitude coordinates; for augmented reality, however, “it needs to be pretty dead on.” Regarding GPS/location service information, “even if the lat/long you get back from Core Location is 50 feet off, there’s a degradation in the experience.” In Yelp’s experience, both the database and the iPhone’s GPS/location service data are more accurate in major cities, which together would explain why we saw what we saw. The compass? iPhone OS 3.1? Yelp believes that the compass information is “generally solid” in OS 3.0, and the company hasn’t tried the Monocle on OS 3.1. It’ll surely only get better with time.
If you have a comment, news tip, advertising inquiry, or coverage request, a question about iPods or accessories, or if you sell or market products, read iLounge's Comments + Questions policies before posting, and fully identify yourself if you do. We will delete comments containing advertising, astroturfing, trolling, personal attacks, offensive language, or other objectionable content, then ban and/or publicly identify violators. Wondering why we're talking about something other than iPods? Check the Archives: Backstage has been here and kicking it since 2004.
- iLounge Game Spotlight: Doggins
- Apps: Findery, Gmail 3.0, Real Racing 3 2.1 + Star Wars: KOTOR 1.2
- Apple ‘scrambling’ to meet FTC deadline on in-app purchases
- Report: Mercedes working on aftermarket CarPlay installations
- Suit alleges Apple stores discriminate against visually impaired
- Popular app developer ComiXology reports security breach
- Report: Apple moved $8.9B in profits to tax haven
- Azoi introduces Wello health monitoring iPhone case
- Report: Apple bringing full-screen video ads to iOS
- Report: Apple working to expand Siri functionality for iWatch
- TwelveSouth SurfacePad for iPad mini
- Neptor NP056K Dual Port Portable Battery Charger
- RooCase Dual-View 360 for iPad Air
- Mophie Space Pack for iPhone 5/5s
- SnowLizard Products SLXtreme 5 for iPhone 5/5s
- Lepow Moonstone 9000mAh Power Bank
- Thought Out PED4 Planet IPA10 for iPad Air
- Plantronics Voyager Edge Bluetooth Headset
- Anker TC930 Bluetooth Keyboard Cover for iPad Air
- iBattz Mojo Battstation Optimus
- Viewing only downloaded iTunes Match tracks
- Splitting purchased content between two iPads
- iLounge’s 2014 CES Best of Show Awards: iPad, iPhone, iPod + Mac
- Preview: 7 Big Apple Trends To Expect At The 2014 CES
- Non-Bluetooth Lightning dock speakers
- Shared Apple ID and switching away from iPhone
- Syncing multiple iCloud data with a family Mac
- iMessages come in from email address instead of phone number
- Whether to include specific apps in iCloud backups
- Passcode entry field not appearing on iPhone