Augmented Reality, or, An Ultra-Cool iPhone 3GS Feature, Yelping For Your Help
Published: Friday, August 28, 2009
To say that we’re excited about Augmented Reality would be an understatement. The concept—overlaying computer-generated graphics and data on top of live video feeds—quite literally has the potential to change the way we travel, shop, and acquire information on all sorts of things. Imagine being able to hold your iPhone up in a store and see prices for all the items inside at a distance, or walk down the street and see menus for all the restaurants. One just-released iPhone app is already offering Paris street and Metro navigation tools with an Augmented Reality interface, overlaying subway entrance details and point of interest data on top of whatever your camera is looking at. It is unbelievably, seriously cool stuff, though currently limited to the iPhone 3GS as the feature depends on compass, GPS, and camera hardware. If Apple tosses them all into the iPod touch 3G, plus a battery capable of actually powering all three at the same time, we might just see these apps seriously take off.
There are, of course, two other potential stumbling blocks: the reliability of Apple’s compass and GPS tools, and the quality of the augmented reality software itself. We’re still in the process of sorting out which is to blame for some very different experiences we’ve had with the new version of Yelp for iPhone, which just launched with an augmented reality mode as an easter egg. Download the app, the instructions go, shake your iPhone 3GS three times, and up will pop a dialogue box for The Monocle, a hidden feature that overlays your current live camera video with Yelp’s local business data. We followed the instructions, and after way more than three shakes, several reloads, and a prayer, a Monocle button did appear. We pressed it. And that’s when the confusion began. What we saw on our iPhone 3GS, running iPhone OS 3.0, could only be described as a very poor implementation of augmented reality—so weak that we initially felt that Yelp shouldn’t have included it in the app at all. A reader echoed our thoughts in a comment this morning: “I see this more as a proof of concept than a working feature.”
In initial tests, there were so many things wrong with Yelp’s implementation that we couldn’t believe what we were seeing. Unless we were really close to a business in its database, the data overlays were unreadably small, and couldn’t be made larger without literally getting up and walking towards the places that were being identified. Then, they were so rarely in the proper position on screen to be interacted with that we needed to turn ourselves around to see them, even when the places are physically nearby. Next, there was the loading—data isn’t cached, which would kill the feature for hypothetical iPod touch 3G users—so the data was all but completely worthless when we tried the app as passengers in cars. Every few seconds, a “Loading” box appeared, updating the list with such frequency that we couldn’t even see the choices—we took a bunch of screenshots and only could only find one where options were actually, albeit very briefly, visible at the center of the screen. Even then, they were stacked in a basically useless list form with restaurant names blocked out for four of the 11 listings, and unreadable in three more.
But this wasn’t the only Yelp story. Despite the reader comment above, we were so surprised by what we were seeing that we asked around to see whether other iPhone 3GS users were experiencing the same things. One, based in another city, said no. He was getting very good results, he said, almost excellent ones. Labels were large and easy to read. The compass appeared to be stable, rather than jittery. And oh, by the way, he was running iPhone OS 3.1, whereas we were running iPhone OS 3.0. Maybe that was the difference?
In light of reports that Apple will be officially supporting augmented reality applications with version 3.1 of the iPhone OS, this could make some sense. But for the time being, it’s hard to know whether the performance problems we were seeing were a result of wonky iPhone 3GS hardware, a feature that doesn’t work the same in every city, or less than 3.0-optimized software. We’ve asked Yelp for comment and will let you know what we find out.
Once Apple enables full support for this feature, we predict that there’s going to be a goldrush-caliber series of efforts to augment reality with all sorts of questionable data and algorithms—tons of cheesy apps like “McDonalds Finder” and “Toilet Locator 3GS” and, of course, “Nearby Farts.” Please, developers, before you spend your time and labor on applications like this, please take note: the goal is to usefully augment reality with information people actually care about, can read, and rely upon. For the time being, Yelp on the iPhone seems to be delivering somewhat inconsistent results depending on factors that aren’t within the user’s control; we look forward to finding out whether performance actually does improve with 3.1, or or whether other issues are to blame. Those who have tried the new application with the iPhone 3GS are welcomed to offer insights and comments below; please mention your city and OS version in your comments.
Updated: A Yelp spokesman told iLounge that three key factors—Yelp’s database, GPS/location service data from the iPhone, and compass data from the iPhone—explain performance inconsistencies from user to user and city to city. The company’s database of businesses, featuring “some of the best data quality in the industry,” hasn’t needed to be audited in the past for small inaccuracies in latitude and longitude coordinates; for augmented reality, however, “it needs to be pretty dead on.” Regarding GPS/location service information, “even if the lat/long you get back from Core Location is 50 feet off, there’s a degradation in the experience.” In Yelp’s experience, both the database and the iPhone’s GPS/location service data are more accurate in major cities, which together would explain why we saw what we saw. The compass? iPhone OS 3.1? Yelp believes that the compass information is “generally solid” in OS 3.0, and the company hasn’t tried the Monocle on OS 3.1. It’ll surely only get better with time.
If you have a comment, news tip, advertising inquiry, or coverage request, a question about iPods or accessories, or if you sell or market products, read iLounge's Comments + Questions policies before posting, and fully identify yourself if you do. We will delete comments containing advertising, astroturfing, trolling, personal attacks, offensive language, or other objectionable content, then ban and/or publicly identify violators. Wondering why we're talking about something other than iPods? Check the Archives: Backstage has been here and kicking it since 2004.
- Congress passes bill to legalize phone unlocking
- Bose sues Beats over noise-canceling patents
- iLounge Game Spotlight: Modern Combat 5: Blackout
- Apps of the Week: ShipAntics, Modern Combat 5, This American Life 3.0 + more
- Report: Apple could launch own mobile wallet this fall
- Report: Apple ‘tentatively’ plans mid-September iPhone event
- Apple faces class action suit in California for labor violations
- Apple, AT&T now sending $40 checks to some iPad 3G owners
- Apple denies iOS “back door” access in new report
- Notes from Apple’s Q3 2014 earnings call
- Incipio offGRID Smart Bluetooth Low Energy-Enabled Portable 6000mAh Backup Battery
- Divoom Voombox Travel Rugged Portable Wireless Speaker
- Logitech protection+ for iPhone 5/5s and +trip
- Beats Powerbeats2 Wireless
- Incipio Steno Ultra-Thin Bluetooth Keyboard Folio for iPad Air
- OtterBox Resurgence Power Case for iPhone 5/5s
- Gumdrop Cases FoamTech Case for iPad Air
- Ztylus Camera Case + RV-2 Revolver Lens for iPhone 5/5s
- JBL Synchros Reflect In-Ear Sport Headphones
- JBL Synchros E50BT Over-Ear Headphones
- What’s New in iTunes 12
- iLounge Picks: Five Great Summer Party Speakers
- Editorial: Endings And Beginnings
- Live From CE Week 2014: Brand New iPad, iPhone + Mac Accessories!
- What’s New In iOS 8 For iPad, iPhone + iPod touch
- iLounge Multi-Editorial: WWDC 2014’s iOS 8, OS X Yosemite + More
- The Complete Guide to Apple TV Channels
- iHistory: From iPod + iTunes to iPhone, Apple TV + iPad, 2001 to 2010
- iHistory: From iPod + iTunes to iPhone, Apple TV + iPad: 2011 to Today
- Viewing only downloaded iTunes Match tracks