RSS Feed
Blog: May Archive
Ubicomp Watch--Cisco: Visual Networking
Cisco has been working hard lately to change their image to be more consumer-focused in contrast to their traditional network infrastructure, business-oriented focus. Their branding efforts come under the umbrella of "The Human Network" in which they are showing how Cisco products enable and touch end users. They even offer Cisco ringtones for download. You can find general information on The Human Network at this site:
One of their television commercials which caught my eye recently is one entitled "Visual Networking" (another Cisco branding term). This commercial takes place on a city street and shows a number of ways in which video (as delivered by Cisco in some way) is impacting people's activities, for example telenavigation and providing audio-visual instructions to help a guy fix a scooter.
Mixed in this are a couple of Ubicomp application examples, specifically: proximity-aware applications. In one case, a woman is walking her dog, and as she approaches a bus stop shelter, the poster-like display on the side of the shelter changes to an advertisement for gourmet dog food--an advertisement targeted for an "audience of one". Presumably, the display system has detected and identified the woman (based for example on her mobile phone ID), performed a network access to a database somewhere, identified her as a dog owner/lover and selected this particular advert for display. I am assuming this is the scenario as opposed to the display sensing the presence of her dog (although technologically this could be done as well).
In a second example, a guy is passing a large flatscreen monitor in a glass storefront window, and the screen displays a woman--presumably a significant other--who is also apparently passing a similar display on a street somewhere else on the planet. This causes them to recognize each other, stop and wave, and probably start a conversation. The logistics of this can make you think a bit--like coordinating the timing and synchronization of these two people and displays. But this is where things could get interesting in an application like this. Maybe a number of people in a person's personal network could be tracked. Or maybe this is an acquaintance who happens to be traveling in the same city, in which case the service offers a chance for the two to hook up.
The commercial is careful in portraying positive reactions by the actors in the video. The woman walking the dog stops in her stride and shows interest in the dog food advertisement. And the man and woman in the "telepresense" link are happy to see each other. An alternative reaction to these applications could easily be concern about the implications of the underlying surveillance and personal privacy issues involved in the tracking and profiling of people. My personal opinion is that this stuff is going to happen sooner rather than later, so it is good to get these ideas out in the open so they can be debated and managed accordingly.
The video is on this page (you will need to scroll down to the Visual Networking video):
Cisco video: Visual Networking
rk
What Can We Do Differently With Ubicomp?
In my recent ponderings on how to move ubicomp from theory and philosophy into practice, I found it necessary to ask (re-ask, really--it's not like this is the first time) what exactly we might want to accomplish with ubicomp implementations. I will spare you my journey of convoluted mental ramblings, which scare even me sometimes, and present my current conclusions in the form of some questions which I believe address some real human-computer interaction challenges:
- We don't want to give up our online access to information and community, but how can we avoid becoming a slave to our computer screens?
- How can we deliver and present information differently and more effectively?
- How can we filter the ever-increasing flood of information we are trying to process on a daily basis?
- How do we use technology--including but not limited to computers--to better interact with our environment?
To answer each of these questions could fill a volume of writing on its own. However, I will summarize my answers to the questions in the form of 4 principles for ubicomp research and development. I propose these principles as a work in progress and as a basis for discussion.
Four Working Principles Of Ubicomp
- We will make the network and information come to us and follow us arround, not the opposite.
- We will layer the interfaces onto our environment and blur the line between information and things.
- We will use location-awareness and techniques like collaborative filtering to make information personally, physically and temporally relevant.
- We will use a variety of technologies to make things and our environment more aware and able to sense and communicate with us.
Although these principles do not exactly coincide with any particular list of known principles in the field of ubicomp, they are based on literature from known experts and not just naively springing from my head. I expect that someday we will have a relatively-agreed-upon set of working principles. Until then, I reserve the right to modify the content and number of the principles. Finally, I will also point out that the modifer "working" in "working principles has two meanings: a work in progress, but also that I am more interesting in the practical aspects of rolling up our sleeves and getting ubicomp systems constructed.
rk
Human-Computer Interfaces In The Iron Man Movie
I just saw the Iron Movie which, as expected, was replete with high-tech gadgetry and special effects. I also noticed that it specifically contained many examples of technology that embodied Human Computer Interfaces (HCI) concepts and themes, and I wanted to capture my observations and thoughts while the movie is (sort of) still fresh in my mind.
I myself have only seen the movie once, and if/when you see it you will notice that it has action pretty much from start to finish. So I apologize in advance if I don't get the details of the human-computer bits exactly right, or even if I saw one thing and imagined something different in my head. The items I will discuss were rather fleeting and subdued compared to the shots of high-tech armor and explosions they were wedged between. But they were cool in their own right and worthy of consideration.
Spoiler Disclaimer: I won't be discussing anything that is particularly revealing and certainly won't give away any significant parts of the plot, but I will include this disclaimer anyway.
Computers Are Ubiquitous
It should come as no surprise, in a movie featuring the comic character of Iron Man, that computers occur everywhere from bunkers and planes to his labs, home and of course his high-tech armor. HCI is not synonymous with ubiquitous computing, nor does it require it. However, they go tend to go hand-in-hand, since, the more computers become ubiquitous or pervasive in a person's environment, the more important is the requirement for intuitive, natural and effective interfaces.
Interfaces are overlaid on the environment
There were a few examples of this in Iron Man:
- The security access keypad to Tony Stark's personal lab appears on demand on the pane of glass next to the door.
- At one point in his lab Tony invokes a control keypad which appears on a black glass surface.
- Probably the best example is in his bedroom. When the (ahem) guest awakes in his bedroom, displays again materialize on the glass of the windows overlooking his beach view. It is hard to recall what they displayed, but they contained information relevant to the home, daily routine and environment.
- Last but not least, heads-up displays appear inside the helmet of the armor.
Icon Interfaces
In at least one case, the virtual overlaid control interface consists of icons rather than having the standard qwerty keyboard. There is a reason that fast food places have keyboards with specialized, iconic keys. It's not because the workers are not intelligent enough to think about the corresponding words. Rather it's not particularly efficient to have to think about them or worse to have to type them in. If an icon can simply, naturally, and effectively communicate an idea or command, then why require anything more?
Smart Home Control
Tony's home is controlled by an intelligent software assistant in the form of a virtual butler which accepts voice commands. Although it appears a bit too intelligent at times, this form of HCI has been developed and produced for years for smart home applications and will continue to be refined over time.
Anticipating user needs
Tony's software assistant also anticipates his needs and offers suggested courses of action it can take on Tony's behalf. It would desirable for any worthy software assistant to reduce the burden on it user by anticipating user actions and offering options, or even automatically performing actions which need no intervention or approval.
Mobile Agents
Rather than develop new programming for the armor, Tony downloads the home/lab butler program into the armor. Presumably it actually creates a copy since it makes little sense to leave the home unattended. But for Tony, the effect is that the software agent he is familiar with, and his probably extensive customized preferences and usage profile, seamlessly travel with him.
Ambient Information
In addition to whatever else the displays in the bedroom were conveying, they were also communicating information about the ambient environment including weather and surf conditions.
Intelligent Robotic Assistants
Tony Stark uses robotic assistants which are intelligent in the sense that they respond to his verbal commands and nonverbal cues. However, these robots are not android in their physical design, something which would not only require more suspension of belief but would also not be necessary or desirable for their dedicated purpose.
In the movie, Tony's robo-assistants mostly serve to provide comic relief. However, to casually dismiss them with this superficial analysis would be to ignore a couple of more subtle points they illustrate about human-computer interactions:
- The comic element of the robots stem from their failure in some cases to follow Tony's commands. This is precisely what we should expect in an intelligent artificial assistant. A software agent with a level of programming sophistication sufficient for exhibiting useful assistive behavior would necessarily need to work with incomplete and fuzzy information, and is further interacting with an imprecise and fuzzy (by computer standards) human being. So it is occasionally going to make mistakes in the same way that a human assistant would sometimes (or frequently, depending on the human) make mistakes.
- We see an example where the human being is probably exhibiting anthropomorphism (the attribution of human characteristics to nonhuman entities) toward the robot. We hear Tony delivering fairly extended and human-like communication to a robot. Yet we have no other indication that the robot is comprehending more than the basic elements of the speech, or that it's behavior is really anything more naive and imperfect responses to the situation. Humans are well known to be capable of attributing intelligence and even feelings to inanimate objects, even those which lack intelligence by any standards. On one hand, this says more about the human than the agent, but on the other hand it serves as a sort of metric by which to judge the behavior of the agent. It has achieved some level of success if it invokes anthropomorphism in the human.
As you can see, the Iron Movie movie demonstrated a variety of human-computer interface concepts. It is not the first movie to include such concepts (Minority Report comes to mind), but I believe it does a fair job and in closing I will leave you with a thought: was this a conscious effort on the filmmakers part, or are these ideas starting to entrench themselves as memes in our subconscious?
rk
Photo Disclaimer: The photos are most just blog candy as it was not possible to to find actual shots of the displays I discussed.
Xerox Plans For The Future
With their history of computer innovations at PARC, Xerox can certainly be credited in some ways with creating ubiquitous computing, at least the ubiquitous part. This new article Xerox plans the future of today (courtesy of BBC news) talks about research they are doing in different areas these days.
While I was hoping to see more ubicomp stuff, the work is meaningful nonetheless. The erasable paper idea might be co-opted for interesting applications. For example, I imagine a laser beam which could update posters in a room with fresh new information.
I still like the idea, though, of digital ink where a display is thin like paper but can be updated like an LCD screen.
rk