Augmented Reality Technology

Following this weeks meeting with my tutor I was advised to do some more research into Augmented Reality, in terms of its current state, the applications available, and maybe how my project could be developed without the need to hold a device in-front of us; but to instead wear it.

ARKit – https://developer.apple.com/arkit/

New from iOS 11, this app offers a new framework that allows the user to create augmented reality experiences for iPhone and iPad.

Sprite-Kit – http://www.sprite-kit.com/about/

Sprite-kit.com is a central hub of tutorials, books, open source projects and various assets for developers working with Sprite Kit – iOS/Mac graphics framework for 2d games – by iUridium.

Sprite Kit is a powerful iOS/Mac graphics framework for 2D games (side-scrolling shooters, puzzle games, and platformers) introduced by Apple targetting games on iOS 7, OS X Mavericks and potentially Applet TV:

  • flexible API lets developers control sprite attributes such as position, size, rotation, gravity, and mass without requiring advanced knowledge of the underlying OpenGL code
  • Built-in support for physics to depict the force of gravity and inertia
  • Built-in support for particle systems for creating essential game effects such as fire, explosions, and smoke

This platform can also be integrated with Apples ARKit to create an AR game and other interactive artifacts. I could use this platform for my final development – https://blog.pusher.com/building-ar-game-arkit-spritekit/

Aurasma – https://www.aurasma.com/

Aurasma is available as a software development kit, or as a free app for iOS and Android-based mobile devices. Its image recognition technology uses a smartphones camera to recognise real world images and overlay media on top of them in the form of animations, videos, 3D models and web pages. This type of platform could be an option for me to develop my project on as the app is already there for me to use, I would just have to simply implement my data and follow the instructions provided.


Wearable Technology – 

https://www.androidauthority.com/wearable-computing-history-238324/3/

https://www.interaction-design.org/literature/article/augmented-reality-the-past-the-present-and-the-future

Augmented Reality has come a long way from when it was achieved in 1957 by the cinematographer Morton Heilig. His invention, the Sensorama, delivered visuals, sounds, vibration and small to the viewer. This wasn’t computer controlled but it was the first example of adding additional data to an experience.

Augmented reality today is achieved through a range of technological innovations, all of which can be implemented on their own or in conjunction with each other.

  • General Hardware Components – The processor, display, sensors and input devices. This will typically be a smartphone as it contains all the hardware required to be an AR device.
  • Displays – A monitor is more than capable of displaying AR data, however there are other systems that could achieve the same. Optical projection systems, head-mounted displays, eyeglasses, contact lenses and handheld displays.
  • Sensors and input devices – GPS, gyroscopes, compasses, wireless sensors. touch recognition, speech recognition and eye tracking.
  • Software – There is an Augmented Reality Markup Language (ARML) which is being used to standardise XML grammar for virtual reality (VR). There are also software development kits (SDK) which offer simple environments for AR development.

Google Glass seems to have established a new kind of consumer electronics device, which is distinguished by its integration of an optical head-mounted display, augmented reality, camera, web access, and voice-based interaction. Google Glass can be categorised and an “ubiquitous” computer, mainly because it can be used both actively and passively.

Analogous Research

Kurzgesagt – In a Nutshell – https://www.youtube.com/watch?v=t7tA3NNKF0Q

This video discusses how Facebook is stealing millions of views a day from independent creators. They have done this by creating an algorithm that when videos are uploaded into their player, they are preferred to YouTube links. This helps to keep as many users as possible on their site, so that they can then be shown advertisements. This method results in content creators receiving much less attention than they deserve. As well as this topic being important and informative it is also very appealing to watch. Through motion graphics and sound they can explain a theory in detail, all whilst keeping the viewers attention fixed.

This type of style is something that I would like to consider within my project, with bright colours and smooth transitions it makes these simple animations come to life. The assets that are used are made with a lot of detail, this helps in adding depth and an element of fun to the videos. I also believe that sound is a very important factor to help in making these videos enjoyable, when there is any transition or movement within the video there is some element of sound.

I also like the way in which these videos show the dashboard for a social media platform, the second image can easily be distinguished as some form of social media. This is something that I will need to consider as I will need to be able to show that what the viewer is seeing is a form of social media, without having to tell them.

Kurz1

Kurz2

Kurz3


 Ahrefs – https://www.behance.net/gallery/36551745/Ahrefs

Ahrefs is a Search Engine Optimization platform (SEO), allowing their users to rank higher in search engines. This feature can be used for businesses to rank higher, increasing publicity and sales. I believe that the video that they made for this service is a great marketing technique as it is relevant to the service, and it is also very nice to watch, which will in turn keep the viewer entertained.

When a lot of simple components and animations are put together they make something that looks a lot more in depth and professional. The pastille colour and chunky style of assets help in making the video unique and memorable, which is something that I will need to consider within my videos. The use of colours and overall art style will help in making my videos all fit together. I am also going to take inspiration from the way in which this video shows a computer dashboard, as it will be a main component for one of my short motion graphics.

This videos use of sound is also a significant feature, it helps in making simple transitions like a line moving from one side of the screen to the other come to life. It helps in giving each component of the video a reason for being there, even though there are a lot of moving components the video does not seem cluttered. This is something that I will need to consider within my animations. I will need to include enough content so that it is interesting to watch, but not too much that it makes the video seem cluttered.

Ahrefs1

Ahrefs3

Ahrefs2


 Panic Studio – https://www.behance.net/gallery/49558457/GIF-Collection

These are a series of short GIFs that help in bringing any mundane task to life. The amount of detail that each asset has helps in making these short and snappy animations fun and enjoyable, they do not need to run for any longer as they already show some sort of interesting story. This is something that I will need to consider within my animations as I do not want them to run for very long, but they still need to be entertaining and memorable.

As these short pieces are GIFs they do not have any sound, if sound was included I think it would help in adding more life to the characters, for example the sound of the TV playing or the buttons being pressed on the remote, creating another element to enjoy.

Panic Studio1

Panic Studio2

Panic Studio3


EAT IT! – https://www.behance.net/gallery/56350953/EAT-IT

A project by Nasser Pindarry helps to advertise and online food service that makes choosing food easier. I have chosen to include this piece as I would like to take into consideration the way in which the creator has taken these 2D images and added depth to them. Through the use of colour, shadows, and image layering it creates the illusion that the food is raising above the assets underneath it. Again the only other way I believe this piece could be improved would be to add mini sound effects over the small animations and transitions from one plate of food to the other, rather than just having a voice-over.

Eatit1

Eatit2

Eatit3

Augmented Reality Test

As this part of the project is where I am least familiar with I decided to try and tackle it by first doing a test run with the online program Vuforia, which is integrated with Unity. The website provides you with a bare-bones way of getting starting with Augmented Reality in Unity. I simply had to follow the step by step process to then hopefully have a finished augmented piece.

https://library.vuforia.com/articles/Training/getting-started-with-vuforia-in-unity-2017-2-beta.html#betas

https://www.assetstore.unity3d.com/en/#!/content/30659

The Process

The first step was to install Unity 3D and allow it to support Vuforia Augmented Reality.

After creating a new project I then needed to activate Vuforia in the project, this would then allow me to use the play mode option or even use Vuforia to build and app.

Unity2 Unity1

I would also need to print the target images for me to work with, these are the images that the target image will search for in order to project the augmented 3D model.

Print Pages Unity

  1. The first step to creating the augmented piece is to delete the main default camera and add an ARCamera. This is a special camera type that supports augmented reality app for both handheld devices and digital eye wear.
  2. Next will be to add a target image to the scene, these can also be configuration in the inspector.
  3. I will then add a digital asset to augment the target, in this case it is a 3D model of a skeleton. All I then need to do is parent this asset with the target in the scene hierarchy, this automatically sets up the necessary rendering and physics behavior.
  4. Vuforia then provides a simulator in the Game view, this allows me to quickly evaluate the scene without having to deploy to a device. (Below I have attached a video which captures this process).

Conclusion

Following this process took me around 2-3 hours, this was to make sure that I had set everything up in the correct way, which included organising assets and workflow. I did not think it would take this long to produce a short piece of evidence of me using motion graphics, however taking into consideration that it was my first time with using both unity and Vuforia, I think this is great progress. The overall platform of Unity is not too hard to use, following a step by step process did make it easier to use, however this is all great practice and I will be able to familiarise myself with the software the more I use it. As this software is also free to use I will not need to worry about any subscription fees, or it even being unusable after 30 days.

It also shows that this may be the best platform for me to create the augmented reality side of my project, as it also supports 2D motion graphics. One feature that I did not quite accomplish was to implement movement data to make the skeleton model animate when augmented, this is something that I will need to develop and work on with future experiments.

Following this short test I believe the next step will be for me to further understand how to use and operate Unity and Vuforia, hopefully with some 2D motion graphics. In order for me to do this I will need to create and test my skills with using motion graphics. I also want to try and move the augmented platform to a mobile device, but this can be tested later in the production process.

Initial Ideas

My first initial idea for what the animations might be are to direct ironic humor to the use of social media. It is being proven that social media platforms such as Facebook are continually stealing content from creators, resulting in more revenue for them and less publicity for the artists. This being said I thought it would be a fun idea to create short animations that show how social media platforms may not always be a good thing to use.

Storyboards

Storyboard Scan 1
Storyboard Scan 2

Proposal Development

This week was about pitching my refined idea on a project proposal form, meeting all the requirements given it would then be reviewed and discussed with my tutors. Following the discussion with my tutor they believed this project is doable within the time frame given for this semester, I will need to integrate my still image design based work into a motion graphic form.

I was also encouraged to decide to have an overall theme or purpose for my motion graphic videos, whether it be for educational or entertainment purposes. It could also be a platform for me to advertise myself as an artist; for example, instead of just having the still images printed into a digital art book for my own personal use, they could be printed as business cards, flyers or even stickers. They could then be scattered around to the public for them to use and view the animations for themselves. This however may be a longer and more difficult process, one that may not fit in one semester, as I would have to make the augmented side of the artifact public for people to download so they could then view the animations.

Proposal

Project Outline and Aims

Working Title – Augmented Motion

Aim of the project – The intended aim of this project is to push my own creative ability and understanding of two subject fields that I am not too familiar with.

Summary of idea – For this semester I would like to create a series of short animations that show my progress with using motion graphics. I will then take still images of these to be printed into a booklet.

From these images I would like to use augmented reality (AR) to bring the printed animations to life on a phone, this will show my development and understanding of AR.

The final output of the project will be a physical booklet, when combined with augmented reality the images will animate through the phone.

Strand Chosen – I have chosen to do the development strand for this project as I believe the research and development process for this project is just as important as the final artefact. As this project will mainly focus on my development and understanding of how to use motion graphics and augmented reality, it would be wise to choose this strand.

Individual Objectives – Throughout this process I would show my research and development via a blog, where I will make weekly updates on the process of motion graphics and augmented reality. As well as research into current projects that are relevant and successful. From this I will then be able to create a Research and Development file to be submitted alongside.

In this project I will have to come up with animations that are going to be fun and impressive to watch, both visually and technically. I will do this by looking for inspiration of projects that currently exist, as well as follow tutorials on how to use the software at a professional level.

Intended Audience – The concept is mainly targeting my own personal development in my understanding of the two software’s, if completed correctly it will be a great piece to add to my portfolio and to show to employers. If I was to apply to a business that is experimenting with motion graphics, augmented reality, and design, then this project would be a great way for me to receive positive feedback from them.

Extending creative and technical skills – This project will push my creativity and ability as I will be using software’s that I have only used in short spans. It will allow me to explore them in greater detail, and with enough patience and time I will be able to improve my skills and abilities with them.

Research Agenda

Work by others – Eyejack are an independent company that specialise in using augmented reality alongside artists work, this was the main inspiration for my project idea. With their own app they upload digital art that can then be shown through augmented reality at exhibitions or through their own art-book. https://eyejackapp.com/

To help in finding more inspiration I will be following artists on Behance and checking for posts that are relative and like my idea, in terms of style and functionality.

Critical texts – I will consider articles that help in the discussion of the potential augmented reality has for artists to establish themselves.

https://www.artsy.net/article/artsy-editorial-this-augmented-reality-app-reveals-art-in-public-spaces

http://www.bbc.co.uk/news/technology-41590323

https://qz.com/1072528/the-next-trend-in-street-art-will-be-graffiti-in-augmented-reality/

https://techcrunch.com/2017/10/08/jeff-koons-augmented-reality-snapchat-artwork-gets-vandalized/

https://www.youtube.com/watch?v=t7tA3NNKF0Q

Primary research – I will post my ideas and work onto forums that specialise in my subject field, where I will then hopefully receive feedback on how to improve my project. E.g. animations/AR.

I will also consider what types of short animations are most successful, this will help to give me a better understanding of the types of things to include.

Secondary research – I will conduct analogous reviews of content that already exists, this will help in inspiring me of what I may want to create, as well as further understand the development process.

Illustrating research and development – To help in show my development process I will produce weekly blogs. These will include updates of my research into the project, as well as the production process of my final artifact, such as test animations and progress with creating the AR side of the product.