Augmented Reality Development: Guide for Business Owners and Managers
By Andrew Makarov,
Augmented Reality Solution Architect at MobiDev
Augmented reality (AR) has seen a significant uptick in commercial support from big tech names like Google, Apple, Amazon and Microsoft in recent years. Gartner indicates 100 million consumers will actively shop online using AR by 2020. The number of AR-enabled devices is expected to reach 2.5 billion by 2023.
This guide is a roadmap for business managers on how to deploy Augmented Reality technology and overcome the critical challenges during development and integration.
We'll explore the current state of Augmented Reality technology and then guide you through an AR app development case study, discovering how to bring a software product to the market.
Augmented Reality Technology Overview
To understand what is Augmented Reality technology and how it works we will break the AR ecosystem up into four classes based on devices suitable for AR apps:
• Mobile-based AR
• Head-mounted gear, for example, Microsoft HoloLens
• Smart glasses like Google Glass and competing products
• Web browser-based AR
Mobile apps on phone and tablet platforms are focused on AR overlays that leverage a combination of the device's processing power, camera lenses and internet connectivity to provide an augmented experience.
Headsets are built to deliver highly immersive experiences that mix augmented and virtual reality environments, and Microsoft HoloLens and Magic Leap are the industry leaders.
The browser-based experience leverages new technologies to provide a similar experience to what mobile AR offers but without app downloading.
Mobile Augmented Reality
The mobile AR sector is easily the one that is most readily accessible to both consumers and companies. Mobile AR apps are built on phone and tablet platforms with AR content visible on the screen as a hologram.
The 2017 introduction of Apple's ARKit and Google's ARCore software development kits (SDKs) has standardized the development tools and democratized mobile AR app creation which brought about more than doubled amount of mobile AR-enabled devices and tripled the number of active users during 1.5 years.
We can see a significant ARKit's dominance over ARCore, however the latter has grown almost 10 times in absolute figures.
Searches of commit repositories show that a preference for ARKit by developers. Despite the fact that both platforms were announced within a few months of each other, there has been three times more development on and two times greater frequency of discussion about ARKit than ARCore. Each of these frameworks has the necessary resources for developers to create robust virtual environments on top of real-world scenes.
Indicators of AR development by platform
|End of July, 2019||ARKit, iOS||ARCore, Android
|Github repository results||3,493||1,046|
|Stackoverflow question threads||2,080||999|
Augmented Reality for iOS: ARKit 2.0
It's worth taking a moment to discuss some of the solutions that will allow you to get the most out of the ARKit 2.0 framework.
USDZ file formats for AR
At the WWDC 2018, Apple announced the introduction of a new file format named USDZ. The goal of USDZ is to standardize 3-D imaging data for AR development that ultimately reduces compatibility issues and lets developers focus on coding. That means savings in both time and money.
Extended Face Tracking
The iOS face-detection system is hardware-dependent, and is supported in iPhone X, iPhone XS, iPhone XS Max, iPhone XR with TrueDepth Camera. The technology allows the detection of faces and its tracking is more precise and faster than the similar software-driven face detection that Android-based devices employ.
Try-on capabilities for fashion and beauty shopping apps are the main drivers of consumer application of the face detection feature. Social media and messaging platforms utilize the tongue or winking tracking feature to let users augment communication with virtual filters and masks.
The video below shows how iPhone employs AR-based gaze-tracking technology that creates use cases for device controlling performed with eyes, from serving users with limited abilities to hands-free experience and monitoring. Combined with computer vision, face-based AR opens up further opportunities for facial recognition apps.
Multi-user Experiences or Shared AR
The key purpose of shared AR is to produce a scene that multiple users can recognize from their own perspectives. This is accomplished using ARWorldMap, a snapshot of all the available spatial mapping information from the users' devices. 3-D AR objects are then mapped onto the terrain just like actual objects in the real world. Done well, this process creates the illusion of a shared virtual space that each of the users can interact with seamlessly.
Due to high level of interactivity multi-user AR experience makes education, presentation and collaboration easy and effective.
The video below explains how remote AR, a customized version of the shared AR experience, may be adopted in the industry. Remote workers can collaborate with each other or consult with experts. By screencasting from their own devices, they can deal with problems in minutes that used to take months or years of back-and-forth communication to solve. WebRTC-based system permits the communication of notations, video, voice and metadata in real time.
For a realistic AR experience objects in the 3-D space must have reflections. ARKit 2.0 provides developers with a library of automatically generated textures to create reflections and apply them to objects in apps.
ARKit 2.0 is capable of recognizing 2-D images in the real world and then impose a virtual image over the original one. It also tracks the image movement in real time. For developers, this means being able to attach a virtual content to surfaces, from business cards to billboards. The video below shows a use case for AR in marketing and brand promotion using AR.
3-D Object Detection
Object detection feature has brought about virtual manual apps to appear for cars, home equipment, and machinery. Various use cases are already on the marquee as Ask Mercedes, IKEA AssembleAR, and Hyundai Virtual Guide.
Tracking of 3-D real-world objects is a feature that is currently missing from ARKit 2.0. Hopefully, Apple will add it to the new version. Meanwhile, the arrival of iOS 13 and ARKit 3.0 at WWDC in June of 2019 has brought the developers a couple of new features:
• Tracking multiple faces
• Motion capture
• Detecting when people are occluded
• Concurrent use of both the back and front cameras on the phone
We are expecting new use cases with enhanced immersive AR experiences to appear after its official release.
Augmented Reality for Android: ARCore 1.9.0
Not meaning to be outdone by its competitors at Apple, Google has also pushed ARCore development to keep pace with ARKit. Let's check out some of the benefits ARCore offers app developers and businesses.
To allow users to drop virtual objects into a scene in a shared physical space, ARСore uses Cloud Anchors. The objects are seen by multiple users based on their perspective. Cloud Anchors also allow collaborative experiences to be shared with individuals on Apple platforms as well.
The demo below explains how we can use the ARCore object detection feature in a virtual user manual.
By generating a 468-point 3-D of a user's face, ARCore enables developers to provide high-quality renderings of people. After the user's face is identified, masks or filters can be applied that starts various use cases for AR apps.
The image detection and tracking feature opens up the same sorts of use cases that were previously discussed for ARKit. From virtual business cards to applying advertising posters on large surfaces, marking content to it for use in virtual manuals or promotional materials. These 2-D markers can even be used as navigation markers in AR indoor navigation. You can watch an example of ARCore-based indoor navigation solution.
What is better: ARKit or ARCore?
Just as Apple and Google chose to fight it out in the world of mobile phones and apps, they're also going to war for market share in the AR sector. Each company is already very deep into building platforms for AR, and they're both intent on being there as AR goes from revolutionary to mainstream.
For both of them, that's a fight over platforms, installed users and billions of dollars in cash. Apple has very successfully positioned itself as a lifestyle brand. There's a reason that many startups are flooding the market with ARKit-based apps aimed at the iOS audience. It is perceived as more affluent and therefore a better source of revenue to cash-hungry startups.
However, ARCore is bigger in terms of market size. The installed base of ARCore-compatible Android devices grew from 250 million devices in December 2018 to 400 million in May 2019.
Both platforms offer pretty much the same tools in terms of understanding environments, access motion sensors and monitoring change of lighting conditions; both ARKit and ARCore are compatible with the Unity framework. However, there are a few important differences. ARCore holds the upper hand when it comes to mapping. It collects, understands and stores 3-D environment information in a way that makes later use or repurposing simple. In the ARKit environment, only a small amount of info about local conditions is stored, meaning that storage of mapping data is limited to a "sliding window" of what has been recently experienced. ARCore produces a larger mapping dataset that lends it significant gains in both speed and stability.
On the flip side, ARKit dominates in terms of recognizing and augmenting images. You can actually check out this comparison of how the two SDKs work by viewing the demo video below.
A user takes a look at the famous painting of the Mona Lisa, and then the app replaces the real picture with a virtual one. Watch as the subject of the painting blinks her eyes when the user taps on the virtual object version in the app.
A wearable device is one that is either overtly strapped to the head or a set of glasses. While they go about the job in very different ways, the dominants major form factors in wearables are:
• Head-mounted gear like the Microsoft HoloLens
• Glasses in the style of Google Glasses
It cannot be stated strongly enough the differences between these devices. HoloLens aspires to be the solution that blurs the line between AR and VR giving rise to Mixed reality (MR). While there is still a see-through display involved, virtual objects are rendered in the user's line of sight and placed over the real world environment.
Conversely, Google Glasses' core concept is to use the glasses as a layer where augmentation of everyday content can be done using a 2-D display of information. It does much the same work as a smartphone, and it provides support for apps, taking and storing photos and video, wayfinding, mapping and voice-based internet search. Digital content is projected into only one eye, and all information is displayed in 2-D rather than 3-D. In other words, it's a screen.
The companies' goals for the products are also different. Each one has its use cases, and it's wise to overview these players in the wearable sector separately rather than comparing them as competitors of any kind.
87% of respondents surveyed by Harvard Business Review Analytic Services expressed interest in MR use cases, pilots or product deployments. Likewise, the survey indicated that most companies were confident that the now-robust technologies in the wearables sector would allow them to achieve gains in productivity, employee training and customer satisfaction.
Utilizing MR to provide remote support and assistance, collaborate, conduct inspections and perform repairs represent some of the most practical use cases companies see for HMDs. They also see plenty of value in data visualization. Many companies see HMDs as primarily cost savers in the sense that augmentation for workforce tasks can speed things up and provide quicker access to critical information. Boeing reported 40% improvements in productivity of electricians who used 3-D wiring diagrams on the plane. Airbus has discovered more than 300 MR-based use cases.
What makes the HoloLens so impressive is the suite of sensors it employs to scan the user's environment and generate 3-D meshes of those surfaces. This is one of the main reasons the HoloLens has been so successful in blurring the lines between AR and VR. It goes one step further than other products and treats the environment itself as just a very large object in the 3-D space.
Microsoft has been able to leverage its existing Kinect technology from its Xbox video game systems. The accuracy of its scanning and mapping to the 3-D virtual space is tight enough that it can flawlessly determine whether the user is touching and interacting with something in the app's environment or the real world. In other words, HoloLens isn't just layering.
The semi-transparent design of the actual lenses in the HoloLens means that objects are always somewhat see-through. It's a feature because it's important to address safety, prevents a user clumsily running into real-world objects.
Arriving in 2019, the HoloLens 2 features real-time eye tracking, see-through holographic lenses and a more powerful and faster processor, the Qualcomm Snapdragon 850. The company has stated that it can be worn for several hours. Likewise, the headband is meant to be more ergonomic, and the visor will now allow the user to flip it up to disengage from the MR environment.
Microsoft HoloLens 1 and 2 features
The HoloLens platform is impressively feature-rich, and it's worth taking a moment to appreciate a few of its greatest strengths.
Interact with 3-D Content
For users, who work with plans and materials, the HoloLens is the best way to interact with schematics and instructions. This makes it an ideal platform for engineers, designers, and architects where it's easy to manipulate virtual objects in real time.
Hold Mixed-Reality Meetings
With Hololens, bringing folks together in a meeting, enables sharing of 2-D or 3-D graphics in real time with alterations being made on the fly. Remotely located team members can be represented in the virtual space by avatars.
Field Service Assistance
While performing repairs and maintenance, technicians often get stuck in situations where it's neither feasible nor safe to remove their hands from a system. Simultaneously, they do need to pull information from manuals, databases and control units. They may also need to ask a question of someone elsewhere, and pulling out a phone isn't always a great option. With HoloLens, they can access resources in real time through a voice- or gesture-driven interface.
All the classroom learning in the world cannot function as a substitute for getting visual, tactile and kinetic with objects. Especially for employees who don't always learn well when being instructed verbally, HoloLens offers them the chance to train in a hands-on environment. They get immediate feedback while also being able to rewind the scene to whatever might have gone wrong.
This can be a huge leap forward in fields where training is risky or expensive. For example, a first-year medical student can't be asked to perform many procedures on a live person. The HoloAnatomy, though, opens up the chance for them to get a hands-on experience they'd otherwise have to wait years to receive.
Looking at an empty space and imagining what it can be is a challenge for many people. While there are whole industries, such as interior design, that have grown up around visual creators who can picture the future of a space, the rest of humanity often struggles to see it. For creators, the HoloLens makes it possible to deliver an "oh" moment to a client. For customers, it means not having to take the designer's word for it that everything will look amazing.
Microsoft doesn't see HoloLens an expensive VR toy for gaming enthusiasts. It's a step toward the logical conclusion for mixed-reality devices, and the target buyers are users who need to change the ways we work, learn and convey information.
In the long run, Microsoft has set a goal of getting to a form factor that duplicates that of reading glasses. A 2019 patent from the company indicates Microsoft plans to deliver to market that approximates the largest set of glasses the company can picture a person comfortably wearing. They're likely to achieve this goal in the coming years.
Alternatives for Microsoft HoloLens
When it comes to anything resembling a use case from a viable competitor, the only company in the space that has a product that holds a candle to HoloLens is The Magic Leap One is backed by $2.3 billion of funding from Google and other major tech investors.
A mere industry rumor for 7 years and possible just vaporware, the headset eventually arrived in 2018. Reviewers frequently rated the experience superior to the HoloLens 1. In particular, the Magic Leap One delivers about a quarter better field of view of the HoloLens 1. On the downside, that actually puts the company a generation behind Microsoft, as the HoloLens 2 has a similarly sized field of view. That said, Magic Leap is the only alternative on the market that achieves a competitive level of quality.
Where the Magic Leap One manages to really outcompete the HoloLens is pricing, costing about $1,000 less than HoloLens 2. The company has also entered into several entertainment industry partnerships for augmenting 2-D television programs. In this regard, the Magic Leap HMDs appear to be much more targeted at the consumer sector, although business use cases should not be discounted.
Microsoft crushes the competition, though, on the basis of business support. Thanks to a long history of relationships with companies across numerous industries, Microsoft has loads of experience meeting enterprise expectations. It can readily build on what it has learned from developing products like Office or Azure to service its customers better. For Magic Leap and its business use cases, this presents the conundrum of whether enterprise clients want to take a chance on dealing with a fresh entrant or an experienced and respected heavyweight.
Practical Challenges of HoloLens App Development
The environment for each use case determines most of how well HoloLens performs in real life. Performing spatial mapping, Hololens scans a room with an infrared (IR) illumination and creates triangle meshes of the surfaces. HoloLens can have trouble with the task if you:
• Walk around a dimly-lit room;
• Encounter a black, planar surface that doesn't reflect IR light well;
• Deal with objects that react differently to infrared or lack visual consistency from all angles;
• Observe moving objects or people walking.
These issues often force HoloLens in rescanning, and the scene can also fail to match well with the original spatial map the system makes at the beginning of a session. On average , the best use cases tend to be for uniform and well-lit environment.
Thanks to a robust framework, the HoloLens isn't a challenging platform for coders. Instead, the biggest challenges tend to be in the creation of 3-D models. In particular, there can be a difficult balancing act between performance and speed.
Both choices risk breaking the illusion of realism, and often the decision boils down to practicality versus visual impressiveness. It's best to constrain poly counts in the design process, reducing models from 100,000 to 1,000 triangles.
Web Group Leader
"As a project moves ahead, it's wise to contain expectations. Given that the UI/UX experience is already being defined by consumer mobile phone apps, this can pose some problems. Users need to get accustomed that employing HoloLens calls for some understanding of things like the use of semi-transparent 3-D objects versus solid ones and forming the skills required to use gestural and voice input commands."
AR Smart Glasses
The Google Glasses launch was massively hyped in 2013, but the initial momentum among consumers eventually wore off. Business use cases, however, did appear, and the company rebranded the product with what it calls the "Google Glass Enterprise Edition." Thanks to Google's robust support for both apps and device APIs, the enterprise version of the smart glasses has attracted a following.
One measure of the success of smart glasses has been the recent appearance of competitors. As can be expected any time one of the two companies has proven a market, Apple has sought to compete with Google. Many mid-tier tech players have entered the game, and Vuzix Corporation is an especially strong standout in that group.
The niche for smart glasses has largely been a combination of similar use cases for the HoloLens. Generally, the systems are favored for work that demands hands-free engagement or that calls for providing visualization while looking at a real-world environment. In particular, smart glasses are ideal for situations where the bulk of HMDs isn't worth the payoff in total performance.
Clients typically see value in several specific applications, including:
• Viewing 2-D schematics
• Information-intensive jobs that call for regularly being away from a workstation
• Quickly checking files
• Showing colleagues and supervisors what the wearer sees
• Live streaming of first-person video
Several interesting and highly practical uses cases for Google Glass Enterprise Edition have emerged over the last couple of years. Major corporations like GE and DHL have utilized them to boost worker productivity. An intriguing entry comes from AugMedix, a company that provides smart glasses and apps to physicians who provide patient care, leading to productivity increases of nearly one-third among their customers. EyeSucceed has entered the market with a hands-free learning system that allows trainers to follow along with new workers by watching their live streams in first-person views.
Google is also upping processing power and battery life with the new generation of smart glasses. The Google Glass Enterprise Edition 2 is designed around the Snapdragon XR1 platform. Another improvement is coming in the form of frames from Smith Optics that are much closer to what we see with traditional reading glasses, meaning the newest smart glasses will easily blow past both the HoloLens and Magic Leap platforms in terms of lightness.
Providing smart glasses to people who already wear glasses due to vision problems is a big issue. These buyers will likely need a way to acquire bespoke solutions without incurring significantly higher costs.
Vuzix is highly interested in addressing the question of prescription lenses in this sector. At CES 2019, the company announced consumer-grade devices called Blade AR Smart Glasses that are intended to provide prescription lenses in a consumer-friendly package for about $1,200. Working from the XR1 platform that borders on ubiquitous in the industry, Vuzix intends to deliver a product that has the processing power to handle vision-based machine learning on the fly. Combined with AR functionality, these glasses are expected to define the standard object classification.
Web-Based Augmented Reality
For the vast majority of the public, using mobile apps has been the only way to make use of AR functionality. Moving past the app economy is important for one big reason: most users aren't especially committed to apps. According to surveys, one in 5 consumers will abandon an app after using it once. Likewise, 7 in 10 app users will churn within 90 days.
Even those who commit to apps aren't deeply in love with them. Of the 80 or so apps the average user employs, only 10 of them will be used each day. Just a 30 of them will be used each month.
Particularly for e-commerce companies, that represents a scary lack of loyalty. You simply don't want to put millions of dollars into creating an AR app that will likely be forgotten by the downloader within three months.
One solution that has great appeal is web-based AR. Rather than requiring the user to download an app, all the functionality is packed into the phone's web browser. AR-enabled websites get access to the same features as apps, and users lose the hassle of constantly installing and uninstalling barely-wanted software. Powering this revolution is the WebXR API. It is built to provide support for both AR and VR scenes right in web browsers.
Use cases are still coming along, but limited compatibility is a drag on the industry. Some companies are starting to enable this, including the retail platform Shopify or virtual artist by Sephora – as time goes on, more will.
How to Develop Augmented Reality App for Your Business
Cutting through the hype and arriving at answers about how AR apps can benefit your business is essential. As with other forms of software development, the current state of the available technologies imposes constraints. It's prudent to always take these constraints into account, even if you're working with absolute rock star developers on a project. Let's explore a hypothetical use case to develop your understanding of the process and to guide you through it.
Case Study: Mobile AR Outdoor Navigation App Development
The system is going to have:
• A backend database to store the venues' data.
• An admin panel
• A mobile app
From the end user's perspective, the app delivers information about the bars and restaurants. They whip out their phones, and they learn what's the scuttlebutt about these places. People get to see and submit ratings and reviews, and they also get access to information about open hours, locations and directions.
This is obviously a heavily saturated section of the market. How does Jacob cut through the noise and differentiate his app from all the rest? Adding AR functionality would definitely do the job, attracting media attention as the offering becomes the first bars and restaurants app to leverage the power of Augmented reality.
AR in this situation is an add-on feature in the software. A linear workflow for the project would look like this:
1. Pre-Contract stage
Before anything too big gets started, Jacob and the development team need to iron out the basics. There needs to be a technical strategy, and Jacob's goals also have to be enumerated.
An NDA should be signed at this stage to protect the IP rights of Jacob. It's also common for some amount of consultancy to be provided at this stage, especially if the vision for the project isn't entirely production-ready. At this point Jacob may be asked questions like:
• Will a completely new app be written, or can AR be added to an existing one?
• What devices, especially iOS and Android systems, do target audience actually use?
• How do you picture the user actually utilizing the AR component?
• How accurate does navigation have to be?
• Can third-party systems, such as Google or Apple Maps, be incorporated?
• Where are you going to get the data about the venues? Will they sign up, will users submit it or will you scrape the web for existing information?
2. Business Analysis / Technical Analysis
Synthesizing all the answers into a vision for the project is critical. Jacob and the project managers will need to impose constraints. This means arriving at conclusions about a budget, any deadlines and what technologies will be employed to produce the app.
Technical analysts provide an overview of the available development tools to narrow down the technology stack. For the AR feature development it means to choose an Augmented Reality software development kit and 3D engine. In Jacob's case it could be:
Having AR feature in the application doesn't impact on choice of back-end technology because the data is transmitted in JSON format via API. So it may be Node.js, Python, Ruby or any other technology based on the project requirements.
Making the right choice here is essential because it dictates everything else that follows. In particular, Jacob's choice is between developing code natively or using a cross-platform architecture. In our case, the optimal solution will be native development with Swift for iOS and Kotlin for Android. Using cross-platform development is possible but could bring more complexity in the system architecture and its support, because the AR module must be developed with native platform anyway to ensure the best app performance.
When developing for iOS, ARKit is used in conjunction with SceneKit. For the Android platform, the go-to tools are ARCore and Sceneform. An AR app development team should have the skills needed to process 3-D content, deal with imagine tasks and work with most major mobile technologies. To assemble a team for this project, professionals would take on the following roles:
• iOS/Android developer for mobile AR
• Back-end developer
• Front-end designer
• UI/UX designer
• 3-D artist
• Project manager
• QA engineer
If the project doesn't call for 3-D models or the models are likely to not be complex, the 3-D artist's job may be assumed by the UI/UX designer.
"It's crucial to ensure that a development team is using the latest tools, technologies and approaches on the project. Using older tools poses a great risk as there's always the chance that they will become outdated and unsupported in the not-too-distant future. There's also the risk that outdated software will affect the implementation of new features later down the road. While it may work perfectly now, you must think of the future."
3. Design stage
At this point, a prototype with simplified 3-D models is created. The models don't have to look amazing at this point - it's sufficient to operate with simple navigation boxes and spheres. Later they will be replaced with attractive 3D signs and arrows created by the UI/UX designer.
4. Development stage
Not much differentiates this stage from typical app development, but the one major exception is QA. With an outdoor navigation app that uses AR, QA can be challenging. The QA engineer and the developers will need to walk around with several smartphones to judge what works, and they'll also need a laptop to perform debugging. Logs will have to be dumped to the laptop, and they'll have to be studied to determine where misfires occurred and why.
AR navigation feature can be either added to an existing application as add-on module or be laid down in the architecture of an app built from scratch. On average, development of the application from scratch may take about four to six months, with one month spent on the AR outdoor navigation module.
5. Deployment and support stage
Jacob is now ready to show the world his new AR app! In addition to typical mobile app concerns, such as fixing bugs and listening to customer feedback, he'll also need to keep it updated. Apple and Google release new versions of their SDKs ARKit and ARCore up to several times a year. New updates to the app should be rolled out with each new release. Ongoing support and maintenance will ensure the app stays up-to-date.
Tada! That's it. Jacob has now delivered a new AR-enabled mobile app. Further, we'll take a deeper dive into AR app development process.
Augmented Reality SDKs
An AR SDK powers the development of AR apps by providing a set of tools, libraries, relevant documentation, code samples, and guides to developers. The SDK determines the app spatial awareness and virtual objects rendering, underpinning the features and functionality. So it's essential to choose the correct platform based on the project requirements.
Besides the above mentioned ARKit and ARCore, which are free SDKs, there is a number of popular paid SDKs like Vuforia and Wikitude which offer great compatibility with an array of platforms.
.NET Team Leader
"Going the cross-platform route also acts as a great razor because hybrid apps (Flutter-based and others) still have technological limitations, including performance issues, when AR feature is added. Vuforia or Wikitude could be a choice for cross-platform AR development. For graphics-heavy AR apps a good choice is Unity 3D with Vuforia, or Unity ARKit Plugin and ARCore. Compatibility with more than twenty platforms makes Unity3D an optimal cross-platform tool, too."
One of the main reasons why it's important to outline so many technical aspects during the pre-contract phase is because SDK choice can be narrowed down by looking at the project requirements. If you're with an iOS-only app, you can quickly jump toward ARKit and supporting SDKs. If it's Android-only, then you just cut the list of SDKs down to ARCore.
"Though Google and Apple offer out-of-the-box solutions for AR development, sometimes a business owner doesn't need a complex app but just an MVP to showcase the product's basic purpose and functionality. In this case, it doesn't make sense to deal with complex SDKs to get an AR feature into the app, especially if it would become part of a larger ecosystem with a host of related products based on a variety of technologies. In order to prevent any discrepancies, a custom AR SDK can be developed to simplifythe process of integration of the AR app with other products. The custom AR SDK controls the AR features and allows easy integration of an Augmented reality experience into various products. Moreover, it becomes easier to update the AR features across an array of products. Generally, custom AR SDK development might be a choice for business owners who have two and more products to integrate with AR features."
3D Graphics and UI/UX Design for Augmented Reality
Adding life to static objects is one of the killer features of AR apps. The graphic design process entails:
• Figuring out how information will be presented
• Designing a wireframe of the app
• Establishing the user's pathway for exploring the app
• Adding 3-D models and 3-D interface elements
To create this experience, a graphical engine has to seamlessly merge the real-world scene with 3-D content, and that calls for a graphics engine that's up to the task. On the iOS platform, Apple's SceneKit is the go-to solution. Google's SceneForm is the complementary solution for Android apps.
"UI/UX designer deviates from the regular 2D screen perception of a user, and designs the reality where a user is inside but not from the sidelines.This is where the rubber meets the road as far as the user is concerned. The interface has to be simple and intuitive, or they'll give up and move on to their next app in a matter of minutes. Likewise, the 3-D graphics have to look fabulous."
As previously mentioned, Unity 3D is a hugely popular choice when it comes to graphic-intensive apps. Unity Asset Store offers plenty of free and commercially available models, animations and textures. In case your AR app doesn't have strict requirements for unique 3D graphics created from scratch, you may use the existing libraries for obtaining UI elements and 3D models.
QA for Augmented Reality Applications
Adding AR and MR components means taking on a relatively time-consuming QA process. Not only does the app have to play nicely with all the devices it will be deployed on, but the user experience has to be thoroughly evaluated. In particular, the QA engineer has to determine that people "get" how to use the app. This fits well within a traditional software testing pyramid.
AR app testing initially goes within the standard scheme; then after the product specifications and usage conditions are set, we create a testing checklist to consider various screen orientations, speed of the Internet connection and its cut off, low level of memory and battery consumption.
Quality Assurance Engineer
"There are many tricks that the process induces when adding AR to mobile apps. For example, what happens when an app is used in a moving vehicle, on a train or a plane? Standard testing scenarios are applicable to static scenes only. For non-static ones we need to apply a custom algorithm to compensate vibration and the mismatch of visual and motion data."
Testing HoloLens applications requires a specific approach considering user's position both sitting and standing, during movement, in situations of different light conditions, encountering moving objects and interior changes.
It's essential to test an AR app on all devices listed in the project documentation as emulators cannot substitute real devices when it comes to finding and eliminating possible issues within real world physical environments. Murphy's Law applies. All scenarios that can be imagined must be tested.
4 Factors to Influence on Cost of AR App Development
Is it expensive to create an augmented reality app? Let's look at the factors that influence AR development costs.
Development costs are usually 10 to 20% cheaper for iOS versus Android due to the complexities of Google's mobile app development platform.
2. User Interface
Style and creativity matter. Users want a pleasant interface that invites them to spend more time with the app. Enticement requires refinement, and refinement demands more time and greater costs.
3. Cost of 3-D Content Creation
Realistic scenes are just as important to an app's appeal as a great interface. Creating new 3-D models requires the time of at least one artist. Adding in animation means even more time.
What specific factors matter?
• The number of low-poly models that have to be created is a big one. If high-poly models need to reduced to usable forms, there will be a transfer process.
• Extensive model details also incur costs.
• Any sort of animation will demand an artist's time and drive the price up.
4. Choice of AR development company
Bringing on board a software development vendor to produce an AR app means accepting a degree of cost, especially compared to making a traditional 2-D app. The U.S.-based freelance AR developer costs about $100 per hour, and working with a company will cost between $100 and $150 per hour. Going overseas will reduce costs to between $30 and $50 per hour.
There are several approaches to estimation of software development projects. Rates could be "equal", meaning all the team goes under the equal rates and are billed based on time spent. It's the approach MobiDev often uses on complex projects. The company is taking responsibility for the project and its delivery.
Another approach is "rates differentiation" where the vendor provides distinct rates based on expert qualifications for a specific project. It often works if there's a need for some rare, highly skilled expert to handle a task. This person may be needed for a span of time during the project, or they may be brought on as a technical leader for the development team.
Augmented Reality Development Key Takeaways
• AR app development is primarily about finding a solution to overcome software and hardware limitations. In spite of the technology breakout and fast growing development tools update, there are still blind spots developers face when dealing with various devices and OS versions. It is more typical for Android due to the vast range of the devices and ARCore still being in its infancy.
• User experience is important in all apps, but it is crucial with AR. AR experience and user behavior patterns are still to be studied. Educating and training users also should be considered. It's important not to miss specific user experience issues, for example, decontamination of shared HMDs and smart glasses, at the stage of project idea evaluation.
• Proof of concept (PoC) stages may be necessary because the convergence of use cases, consumer interest and specific solutions may not be known. Technology possibilities aren't always fully known in AR development until a use case is tested and proved. It's wise to add a PoC step if you're not sure about a novel app idea.
Mobile Augmented Reality continuously reveals its potential for practical purposes. Our today's demo is the second one to... more →
April 04, 2019
Augmented reality saw its record growth in 2018. Commercial support for AR is positioned to be strong, with big tech names like... more →
Based on a keynote "ARKit: Creating Non-Standard Augmented Reality Solutions", which was contributed to MobileTechCon 2018 by... more →