Thursday, 12 January 2012

Evaluation of the impacts that a future development in Human Computer Interface (HCI) could bring


What have I chosen?

Microsoft Surface is a new multi-touch computer that allows multiple users to interact with it, all without using traditional ways to access a PC. Microsoft Surface is currently an electronic table that you can use by natural motions, hand gestures and by placing physical objects on it.

Microsoft Surface goes on sale in January 2012. Even though this development in HCI has been invented, it still has not been released yet and the technologies provided by it are fairly new. There are not many other computer interfaces like it, which is why I have chosen it. Only a few companies use them at the moment including the Royal Bank of Canada, but in the future, a lot of other companies and home users will have them.

Microsoft makes Surface, however I have come up with my own version called Microsoft Air. Air is my own enhancement that is more futurist and I believe better than Surface. It is basically a room with projectors and a 3D way of viewing your applications and files, as explained later on.

How does it work?

Microsoft Surface has had many prototypes. The original version (1.0) used a lot of equipment to work and was very bulky, due to the fact it used a projector for the display. Since then, it has developed a lot; the new version on sale in 2012 is now known as 2.0, and it is a lot smaller.

Since Microsoft only makes software for computers, the same aspect goes for Surface 2.0. “Surface” is just the software platform for the device. The name of the glass table or the computer hardware is the Samsung SUR40.

It features the following specifications:
·      40-inch (1-meter) LCD screen;
·      4-inch (10.2-centimeter) unit depth/thickness for easier horizontal mounting;
·      2.9 GHz 64-bit AMD Athlon X2 dual core processor;
·      1 GB AMD Radeon HD graphics processor;
·      4 GB DDR3 RAM;
·      320 GB hard drive;
·      Wired (1 GB Ethernet) and wireless (802.11 and Bluetooth) network hardware;
·      Physical connectors include HDMI, stereo RCA, USB and SD card;
·      Embedded 64-bit Windows 7 Professional operating system;
·      Corning Gorilla Glass to protect the surface;
·      Recognition for more than 50 simultaneous touch points.

The device works by recognising your touch movements on the glass surface, which then tells the operating system what to do. No mouse and keyboard are needed because it is one big touch screen.

The device is good if you need multiple users interacting with one device – you can share information with each other or connect the devices to it. The software included allows you to control the way Surface works. Generally speaking though, the Surface platform uses the following software for it to work properly and for the touch screen to be recognised:
·      Embedded Windows 7 Professional 64-bit;
·      .NET Framework 4.0;
·      Windows Presentation Foundation (WPF) 4.0;
·      Microsoft XNA® Framework 4.0;
·      Windows PowerShell and DMTF DASH support, and enhanced administrator tools.

Some features of Microsoft Surface

The core features of the Surface designed by Microsoft are:

·      Concierge. This is used so that your company can tell users some of your venue locations on a map. Users can browse the locations by lists, view these locations on the map, navigate the map and get driving directions to the different locations.

·      Photos. This is used so that you can browse and manage photos and videos. The photos can be on you’re your Surface computer or devices that are placed on the Surface table.

·      Music. This adds music to your Surface, allowing you to browse, select and play any sound files. You can get music from CDs and downloads.

·      Water. Water is an interactive screensaver – it is applied when Surface is not being used. It is used so that you can see the effects that Surface uses, and how it recognising hand gestures.

Other sample applications provided by Microsoft:

·      Games Pack. These are games for the hospitality and entertainment industries. The games are Chess, Checkers, Tiles and Ribbons.

·      Financial Services. This shows how your customers could invest their money, by using a fictional bank. Graphs, videos, services options and items on the screen help them to make decisions.

·      Live Stream. This is a social networking application used so that customers can view your Twitter, Flickr and RSS. They can submit their own social messages as well as looking at yours.

·      Bluetooth Connect. This is used so that your Surface computer can share files with Bluetooth devices. You can share pictures, contacts, ringtones and a lot of other files.

·      Mobile Connect. Similar to Bluetooth Connect, this application is used for people to connect their mobile phone to Surface. They can share their photos, contacts and other information in a nice layout.

There are some applications made by other companies that have already been developed for the Microsoft Surface. Some examples of them include:

·      After-Mouse: Photos. This program allows you to view, modify and send (to email or Facebook) photos.

·      After-Mouse: Paint'Touch. This program allows four children to draw, colour and erase drawings. Educational games are also provided.

·      Brown University: Garibaldi. This application is designed so that you can view large paintings that are not possible to view by human hands, since they are so big (that are kept on a wheel for storage). However, this particular one is for Garibaldi Panorama.

·      Customer Solutions Group LLC: Digital Folio. This application allows you to manage products that you might like to buy online in a good way so that you can compare prices.

·      InfoStrat: “The Wonder of Light: Touch and Learn” at the Smithsonian Institution. This application is for anyone who likes to learn about science and history, as it allows you to use everyday items (e.g. paintbrush, magnifying glass) to learn kinaesthetically.

·      IntuiLab: IntuiFace Presentation. This program will create stunning visual presentations for Surface and other touchscreen devices.

·      Nsquared: The 1st application by this company is Thoughts, which allows you to create drawings. Make Words is a spelling game for children. Chemistry teaches users about the periodic table. There are also other applications by this company.

·      Touchtech AB: Tourist Guide. This program provides information to tourists wanting to explore a city, such as activities, sites, restaurants and any items that match their personality.

·      Vectorform LLC: Galactic Alliance. This is a game for 4 players. The objective is to create turrets from their own cash (which is generated), in order to defend and stop the aliens getting through.

My own version that is newer and enhanced

My development of Surface takes from a touch screen table computer to a 3D projection computer. It would have to be named something other than Surface as even though it is projected on a surface, everything is done in the air, so it could be called Microsoft Air. The Air will be based upon a new Microsoft operating system that has all of the smart technologies built in as I will explain in this blog. It will use many of the technologies from Surface.

Across all the walls in your Room

My version of Surface is designed to spread across all of the walls that are in a room, but the floor and ceiling are not used. Therefore in the future, rooms will be designed for this new version just to fit in. I think that this idea is good as it allows you to manage each of the applications in a way that suits you, and you get plenty of room to do this.

The rooms that would be best for this are circular ones so that you get a 360° display. The idea is that you stand in the middle of the room, either standing or sitting. The computer itself will be placed in the porch of the room so that it doesn’t get in your way. There will be a pop-up dock in the centre of the room that allows you to plug in portable devices, insert DVDs and place devices on top for recognition via Bluetooth (like the current Surface system). The docking station features a touchscreen top so that you can place devices on it like Surface, and memory sticks are plugged in on the side.

Even though items are projected on the white walls of the room via projectors mounted on the ceiling, to you they will look 3D. I’m not sure how this technology might work, but one of the ways it works at the moment is by wearing 3D glasses. Air will be able to tell what you are selecting in the air compared to what is projected on the display. In the future, 3D glasses might be replaced by an alternative.

Air Gestures

Air gestures will be used instead of touching a set of large screens. For example, you can simply move applications from one side of the room to another just by moving your hand in mid air, dragging it from one side to another. This would make it more interactive, a better experience and easier to use than a touch screen version.

Similar technology exists with the Xbox Kinect, it just needs to be developed a bit more along with better sensors that recognise gestures in the air and middle of the room. However, air gestures can be used to recognise more than tapping with figures, such as a grabbing gesture to grasp a window and then you realize the grab to let go of the window. You can also use software tools as additional ways of interacting with Air, for example you can bring up a keyboard and type in midair if you don’t want to speak what text content should be placed in a Word document. Note that the sensors used are the same sensors used to recognise 3D objects.

3D Recognition

3D recognition is one of the main features of Air. Not only does it recognise objects, but Faces as well. The recognition would be for all of the room, as sensors will be near the ceiling, middle and near the floor of the room to detect objects, on each of the walls (360° basis).

I would add Face recognition to allow easier logging on. The Air could automatically call up your favourite applications as you log on. If necessary this could also be used to allow individuals different access rights to areas on the surface. For example, the owner may only want themselves to access the admin rights for the computer, meaning that only they can use the administrator profile.

With Face recognition being available for 360° of the room, Air will recognise the owner when they first enter the room. This could allow Air to automatically log on the administrator without having to enter a password. Face recognition could detect the facial expression and other factors of the owner, meaning that the device activates different features depending on his/her mood. For example, the owner could ask for it to automatically play music when he/she enters, meaning that depending on which mood they are in, different music is played. It can also use this information to provide a better experience for different parts of the program.

Object recognition is the other recognition provided. It will be able to see items with the sensors pointed at the 360 degrees around your room. Even though you won’t have many objects in the room, you may use them every now and then as a way of interacting with the computer other than by pointing – for example, if you are drawing you will use a pen instead of your fingers.

Object recognition can also be used to detect objects and tell you where they are in the room. For example, if you dropped your car keys on the way in, it will tell you the location of them.

Voice Recognition and Output

Voice recognition would allow easier control of the Air. As well as controlling the device by using your hands, voice recognition would be needed as not everything can be done visually; for example, you can’t put text into a document unless you copy and paste it or use the onscreen keyboard as described before. Microphones can be placed by each of sensors so that it captures what you are saying from each angle of the room, and one placed directly above the centre of the room. Speakers are used to provide surround sound on the ceiling.

The main purpose of voice control would be to open programs and change settings. This would provide an easier way of doing this than having to navigate through the computers programs folder or control panel. Users will have to learn voice commands for the computer to respond, such as “Open Paint” will open Paint! Voice control would be the main alternative to using a keyboard, since there is no mouse or keyboard, you have to say what you would normally type.

You can also say more advanced things and the computer will recognise then. A user could give simple instructions like “find me a recipe for chicken casserole, that doesn't have cream in it”. The Air would search the internet or any recipes that it already had in its memory and select an appropriate one. The air could then read out the instructions step-by-step at a pace the user needs to prepare their dinner. This could be via speakers in a separate rom like the kitchen. Air could also prepare its own presentation and display this information on a smaller monitor in your kitchen that also reads out the instructions.

Interaction with Mobile Devices

Like Surface, Air should be able to interact with other devices that are placed on top of the docking station in the middle of the room. It should be able to automatically synch with portable media devices such as smart phones and music players. This is a good feature because people need to add content to their portable devices, but this method does it without wires.

Impacts brought by my newer version of Microsoft Surface

Ease

With Microsoft Air, computers will be easier to use. There are a few reasons for this, including the software and hardware for it.

By touching the air, it is easier for people to use the computer. For example, you don’t need to learn how to use a keyboard or mouse as you use hand gestures. Hand gestures make it easy to use, as you already know how to use your hand, whereas with a mouse you have to learn how to use it.

You can easily share files with each other, quicker than what you can on a normal computer. I you placed two digital cameras onto the docking station they will both be recognised. You can then view the photos in a nice way, as you can easily change the angle of them by pinching the corners of each photo, adjust the size and sort through the ones you want. To share files with your friend, you can simply drag and drop them onto your friend’s camera on the docking station.

So in general, by using air gestures, it makes computing easier. This has an impact because it might encourage others who have never used a computer before to start learning due to the ease. This therefore means that these people can benefit from the technology that computers offer, such as contacting family members by email, printing off photos, storing all of their music in one location, etc.

Previously touch screen computers have not been very popular, but touch screen mobile phones and tablets are popular. There are a few reasons why touch screen computers are not very popular, the cost of them, they are not comfortable to use and don’t bring any benefits yet.

The Air should be a success as it has unique features, which no other computers on the market at the moment use. By having the whole room as a computer space, it is a lot more comfortable and allows you to decide where you place each of the application windows. This affects society because everyone will use Air, meaning that when people visit your organisation, you can use it as a way of allowing them to explore information about your services. This should encourage them to use your company.

Big display

The Air is a good device as it provides a lot of space, meaning that users get plenty of room to manage applications and files. You can easily share files between sources, such as transferring photos from one camera to another by just placing it on the dock, and then dragging and dropping.

It was designed so that multiple people can use one computer to “connect, learn, and decide”. You get a perfect 360-degree 3D projection, which is used with special technology to detect air gestures, 3D object recognition and voice recognition.

The idea of Air being a large interactive 360 display has an impact. It affects society because people will like the idea of having a large amount of room to do their computing tasks on, meaning that people will buy the package. This therefore means that it will be used a lot in businesses for meetings for everyone to use, customers to view business applications on and for restaurants to provide entertainment – as Microsoft says, the possibilities are endless.

Encourage customers

By using Air, you are more likely to encourage people to use your services, as you are displaying the information to them in a nice view. If you work for a bank and you have an appointment with a customer to ask whether they would like to upgrade their account to a premium one. You could use Air to display the benefits that are provided by this account. You could swipe through the benefits one by one and allow them to interact with it to find out more information, and maybe watch videos. Air will be good for presentations, providing that you provide a 180-degree view instead of the full 360 degrees, as it would annoy people, as they would have to turn around.

This has an effect on the economy. If the customer is encouraged to take out the deal with the bank (partly due to the assistance of presentation provided by Air), the bank has gained a customer. This helps the bank to maintain or increase their profits. If the customer likes your services, then they are likely to use your again in the future, all with the help from Air and your persuasion.

Also, a lot of money is made for Microsoft. Due to it being a new technology, lots of companies will want it for their business so that they are more productive. Therefore Microsoft make greater profits, as small and big companies will use them.

Bring documents to life

With Air, you can make complex and boring information look better. With financial services, you could get a complicated graph and turn it into something a lot more visual and fun to view, while displaying key calculations.

This impacts on you as it encourages the customer to use your services, due to the fact that you have presented the information in a clear way and have allowed them to explore it themselves by just using hand gestures. This therefore means that your business gains more sales, and the customer is more likely to use you again in the future.

Make learning more fun

With Air, learning is more fun. The computer allows people to work as a team to complete a task, challenge, educational game, note down ideas, share photos from the Internet or from a camera. Far more possibilities are  also available.

The impact on education means that students’ learning is enhanced. If students are having a fun experience using the Air, they are more likely going to remember it later on for their exams. This therefore means that they get better grades, as they have had a better education. This is a particular big help for the visual and kinaesthetic learners, as they can remember what they wrote or did while using Air.

It also has an impact because it helps the students develop their teamwork skills. While using Air in a team, students have to interact with others what they need to display and write down. Therefore they need to make decisions, as if everyone tries to control Air at once, they will fail at completing the task as a team.

If students buy the Air for their own home, it will enhance their education even more. Students will be able to do their homework on it, which is a good impact as they can make it look more professional than someone who hand written theirs. It can also impact on their education as they can use it to make revision notes such as mind maps, which will help to create visual memories for the exam.

Shopping is Easier

With Air, you can make your shopping experience easier. This can be done by allowing you to set more options on what you want your products to be like, seeing other similar products easily, seeing price comparisons easier and defining options that make the service more personalised for you.

This has an effect in several ways; the experience for you as a customer is made better and more pleasant. You can easily find out more information about a product and similar items like it, as you have a big screen that you can use and you can easily navigate through the products by just using your finger. This therefore means that you are more likely going to use the Air for shopping in the future, as you are able to get the best possible deals.

This also has an effect on business. By being able to compare the prices of products, customers are going to go for the prices that are cheaper. This therefore means that there is increased competition between businesses, so that customers are attracted to the stores that sell the cheapest products. This is good as customers get the best deals possible, however it can also mean that some businesses struggle, as they have to lower their prices.

Provides Entertainment

The Air is a good computer to have in public places of entertainment, including restaurants, cafés, bars and other venues. It can provide games, music, images, web access, movies and other entertainment. People can dine in the centre of the room with the computer screens going around the outside of each room.  It would encourage groups of people to socialise more.

By having customers who enjoy their experience at your venue (partly due to Air), they will come back again and use you for future business, which gives your business regular customers. They will then tell others about how good your venue is and how fun Air is to use, meaning that yor business has even more customers.

A New way of Communication

By using Air, people have a new way of getting the information they need. This is useful in a Hotel, as they can get maps, attractions and other information from the Internet and manage which ones are best for them to use. You could also use it in a Hotel for them to pay for any additional services that you provide, meaning that pressure is taken off staff.

This impacts on your hotels efficiency and rating. For example, if tourists use Air to find out information about the Hotel rather than asking staff, this takes pressure off the staff. Most people using Air will enjoy using it, meaning that the tourists will keep this as a nice memory of their visit, and they might recommend it to friends so they can also use it.

A New Idea so it will be supported

Due to it being a new idea, software companies’ have/will quickly make a move to make applications for it. This therefore has a lot of effects, as their applications give the Air even more than just the standard Microsoft applications that are installed.

The first impact is on the economy of the company that made the application. If a company has created an application for the Air that requires customers to pay for it, this creates a direct profit for the company. If it is a free application, the company can still make money by their advertisements and popularity of the application.

The second impact on the economy is due to Air being a new device, lots of programs will be made for it. This means that programmers are needed, which has an impact on society because more jobs are created. Therefore the unemployment level will go down a bit when it is released.

You can do things that you couldn’t before

With Air, far more possibilities are opened up more than what they ever have been before. You can do things that standard computers can’t do. For example, multiple people can use it at once, you can control it by just moving your finger, it can be used to access storage devices without having to plug them in and there are other new possibilities with it.

This has an impact on society as it can encourage people to use it and become better at using technology. Even though it may take a bit of training for people to become used to it, it should be fairly easy to use as everything relies on natural hand movements. People will want to use it as computing tasks are easier than before.

If businesses use them, home users are more likely to want them as well

If people like to use Air, this will mean that they will want to use it again and have it for themselves. This impacts on the economy as profits are made for Microsoft, the companies who actually sell them and all the other companies involved in the manufacture of them. Even though it is not available for home usage, in the future they will be. When people do get them in their own homes, this will have an impact on getting a better computer experience and a way of being more productive with work.

Likely to make Greater Profits for Businesses

Using Air in a business has a number of benefits. You can use it to display information to the customer and let them have a play, use it as a way of sharing ideas during meetings, using it on the wall while presenting to share ideas and there are other ways of how Air can be used.

Therefore by using Air, it is likely going to help your business make greater profits. The reason for this is because you and your employees can become more productive, as everything is easier to use than on a normal computer. Therefore your section could be rewarded for your hard work, all because you had Air to make your work more productive.

Improve Presentations

With Air, you can make your presentations a lot better. First of all, you can make better visual effects on Air, as you can change the designs of items easier, as no keyboard and mouse are used. You can also enhance presentations as you can encourage user activity – for a presentation on cars, you could allow your colleagues to use Air to scroll through pictures, facts and other information to make the presentation better.

This will impact on your business. By creating better presentations, colleagues are more likely to remember the information. This therefore means that they are going to be higher in productivity. Not only does engaging the audience impress them, but also it could impress your manager, meaning that you get a reward.

Other Companies will copy Microsoft

It is likely that other companies will copy the Air and make it into their own product. Even though this is bad for Microsoft, in a way it is a good thing as it means that Microsoft has to improve its software. For example, if Apple and Google were not up against Microsoft, then Microsoft would charge more for its software, as they know that people would still pay for it, as there would be no competition for them.

This therefore has a good effect as it means that Microsoft has to be competitive – if Google and Apple had their own version of it, Microsoft would have to be competitive about pricing and the features of it. There is already a cheaper version of the Air, called EXOPC EXOdesk; therefore Microsoft already have competition that they must face up to in order to stay in the business.

If Microsoft lowered its price so that it was about the same price as competitors such as EXOdesk, this would also have an effect. First of all, Microsoft would not be making so much of a profit as the prices are lower. However, this may be overcome if they sell more in the first place by having more customers.

Environment effect

Even though Air brings many advantages as it makes computing and learning more productive, it means that people may not need their old mouse and keyboard computers anymore. This has a very bad effect on the environment as scrapping an old computer is bad for the environment, and creating a new one like the Air is also bad to the natural resources used and the chemicals released. If this did happen, then it shows that our culture is changing, as people no longer want to use desktop computers.

For Air to work, you need a full room. This would have a bad effect on the environment because you would have to build onto places in order to use it. For example, in a house you would need to extend it to make a circular room big enough to use Air. In businesses, you would have to do the same unless you had a big enough space in the first place and just built a dome.

Building new rooms has a bad impact in two ways. First of all, you have to alter buildings, which can be bad for the environment; if these are recycled then there isn’t as bad.  However there will be a lot that goes into landfill, which contributes to greenhouse gases and therefore global warming. There would also be damage to the environment due to new building work.

Other Impacts by Air

Society

It can be used for an individual user or for a group. By using it for an individual user, they can manage their applications easily. By using it for groups, you can get work done as a team and put it together when needed (for example, a work couple could have a half each to Air, and then they can put both documents together later on when they are finished). Team work means that you develop social and leadership skills.

Entertainment and work is completed better than on a normal PC. This is due to the fact that you can easily manage the applications that you have open by using hand gestures in the air. For example, if you pinch each of the corners, you can then drag one corner out and the window will get bigger. Another example is that you can say “Move Word 180 degrees” and it will place the window behind your back as you don’t need it, but you will need it for later.

By having this development, it will help IT companies to move designs even more. You can’t just go from command lines to brain computers, as you need to develop gradually. With this invention, it is a step closer to getting that brain computer – it uses hand movements and speech, which in my opinion is the closest thing.

Disabled people who struggle to walk can use this computer. They will be able to control by moving their hands and voice, which they will probably find a lot easier than typing and using a mouse, meaning that productivity is increased. However, due to not being able to walk, they will probably not turn around to use the 360 degrees but instead just use just half of it.

It makes people happier as it is better and easier to use than previous interfaces. This therefore means that they are going to be more productive with the computer, which means that they will be getting more work done for their business.

It provides good education. By being 3D, it means that you can view diagrams in 3D, such as a world globe. This is very good for education because students are more likely to remember things if they have fun doing it. This is good for all three types of learning styles, as you see it, interact with it and listen to notes that it gives. It also provides a good experience for entertainment, as you can watch 3D films.

Some people may find it confusing. By going from a desktop computer to a 3D projector computer with air gestures, some people will not like it. People don’t like to go from old technology to new. One of the reasons for this is because they will be used to a mouse and keyboard, so using something completed different to this will not be welcomed at first.

Some people might not be able to use Air. For example, if you are visually impaired, then this computer is useless, even though some features are accessible by voice recognition. Also, some people will not find it comfortable to move their hands in the air for long periods of time. This does not contribute to an all inclusive society.

Economy

There would be a new market for both software and hardware companies. Software companies would have to come up with new software to work with this operating system, and hardware companies would still have to build a computer but also the sensors. This would mean that new jobs would be available. However, jobs for making the old computers may be lost as this new market may take over.

It would be expensive for somebody to buy all the equipment needed for Air. For example, you need a decent computer (with a lot of graphics power), a lot of 3D projectors and a lot of sensors. You would also have to pay for a new building if you don’t have a big enough space for it. However, companies would be making a lot of money from selling the hardware and software for Air.

Culture

It would change the way that we use computers. The mouse and keyboard are removed since air gestures are used instead. This is good because we get more advanced features out of a computer, however it would make some current software useless. For example, how would you play a first person shooter with no mouse or keyboard?
It would mean that we would not have to worry about maintenance so much. The idea of Air is that it automatically maintains itself. Therefore it will automatically update without asking you. Since everything else is easier, that’s why the maintenance is also easier. This affects culture as people don’t think about maintaining their computer, as it is automatic. Take the example of managing files – Air will automatically place files into separate folders, unless you do it manually yourself.

Even though this is a few years ahead into the future, if we still had the same TVs that we have today, we would use this instead. As it provides a 3D experience, we would want to watch videos and play games on here as it is better quality, showing a change in our culture. Therefore the whole family could use the Air as a way of enjoying entertainment together, which helps build social skills.

Conclusion

The Microsoft Air brings many advantages to everyday life. Even though it has a few bad effects, there are many positive ones as computers are easier to use as less technical knowledge is needed, and transferring files from one device to another has never been simpler.

It can be a good device as it is good for many different purposes. Education is a good example, as students can learn information required for their studies, while learning how to work as a team. Venues are able to use the Air as a way of providing entertainment and a more fun experience, and once customers are finished, they can divide the bill by simply placing their credit cards on Air and then by confirming the payment.

The Surface will go on sale during January 2012. The problem with this is that it is only for businesses; so home users won’t be able to use it to entertain themselves. The process of making the hardware can be bad for the environment as chemicals are released, and products similar to Surface may get greater sales due to their lower price. In even more years to come, something similar to my design of the Air will probably be released.

No comments:

Post a Comment