Sustainablilty in Good HCI

Sustainability is a simple concept to understand. It is easy to realize that we cannot continue the trends that have been established in the past century regarding manufacturing, consumption and waste. On this, I think everyone agrees. The role that interface design plays in sustainability, however, is more ambiguous. In his paper, Eli Blevis defines design as “an act of choosing among or informing choices of future ways of being”. This definition is quite different than what most would think of when asked to define the word. Yet, it blends the traditional definition with the new trend of sustainable and forward thinking. Tom Fischer, Dean of the University of Minnesota’s College of Design, adds to this idea: “good design involves exhaustive research into the repercussions of our actions”. Without a doubt, this is a very accurate assessment. However, in practice this often fails; many designs do not look at repercussions or consider the future.

At first, the entire notion that interaction design affected sustainability in any way struck me as odd. Indeed, the interface is a largely abstract (though crucial) part of any design, and many other aspects of besides it play a role in how effective and sustainable a design is. As I was thinking about this for a bit, I realized that a great example of this is the iPhone. The interface on it when it was introduced was, and still is to an extent, revolutionary. Nearly three years later, it is still as usable as it was the first day, and has spawned dozens of imitators. The iPhone has gone through two slight hardware changes, though there is little practical difference between the three generations; yes improvements have been made, but each generation can do nearly the same things. This leads to users hanging on their devices longer, and once they feel the need to upgrade, selling their device to someone looking to get into the iPhone ecosystem. This is largely because the underlying OS interface has not changed much, and users get (nearly) the same experience regardless of the hardware. In turn, Apple’s interface design has hit several of Blevis’ ‘heuristics’ on sustainability, primarily reuse as is, achieving longevity of use, finding wholesome alternatives to use and perhaps to some, achieving heirloom status.

That last ‘heuristic’, achieving heirloom status, is a very interesting one. Some categories of things are just ill suited for such a stature. For example, I feel that it is nearly impossible for computers achieve this standing. No matter how classy or unique the design (take the iMac as an example), the long lived appeal for computers is rather slim compared to other things. Cars on the other hand, have a much easier time being classified as heirlooms, and often times it is due to unique and elegant design.

Software, and more specifically interaction design, fits in very differently within the rubric proposed by Blevis, and is even harder to place than technology in general. The above iPhone example shows how a good interface meets some of rubric criteria, but only through the vessel of the innovative hardware that backs it. Blevis suggests to look at software (and the corresponding interaction that it creates) a little differently than we normally would. While it’s true that bits and bytes don’t have physical properties, the hardware that runs it is directly tied to it. Thus, thinking of hardware as the physical representation of software is one way to look at it from an interaction perspective: the software we design, with its different capabilities, directs hardware design. Therefore, the forward thinking that happens needs to analyze not just present needs, but also address future possibilities and anticipate them with hardware design.

Following this process though, one might conclude that in order to be future proof, a device must have many capabilities so that it is not quickly outdated. This, in turn, would likely drive the price of the hardware up, as more and more technology is crammed into one device. On the one hand, that may be true. To bring up the iPhone again, it debuted with an astronomically (for the time) high price. It packed many things into one, however, and people overlooked the price and bought it by the millions. To me, this shows that people will pay for good design, especially when you consider that free phones offer many of the same functionality albeit with shoddy hardware and software. There is more to this than just a pretty interface though. What the iPhone did that truly helped it succeed, I believe, was the seamless combination of several gadgets into one. This promotes sustainability enormously, as now instead of needing a phone, GPS, MP3 player, and laptop on you, you now can combine these four devices into one that does the functions of all well. This trend will only continue, as phones get more and more powerful (they are set to break the 1GHz barrier by years end) the consumer will be able to get more done on them, eliminating the need of further gadgets.

The backbone of why cell phones are able to provide all this power is also what’s driving sustainability in many other areas. The high speed networks that have been developed, both wireless and wired, are driving innovation in every aspect of our lives. Solid media will see a great decrease in use as nearly everything spawns an option for digital delivery. A good example of this is Steam, a computer game ecosystem. Instead of buying games at stores and having a CD of the game, you can download the game straight from the internet. The system works beautifully and removes the need to have disks and paper manuals. As an added benefit, the system knows what games you’ve bought so you no longer worry about lost disks. An even better example is Netflix. Their first innovation of delivering DVDs straight to your home over preexisting mail routes surely saved the environment the damage from millions of people driving to their Blockbusters. They took it to the next level however, when they introduced high quality movie streaming over the internet. This is another step to decreasing the need for physical media and who knows how many tons of Netflix’s distinctive red envelopes. These are just two examples of interaction design creating a more sustainable environment. These developments, and the overall idea will surely be receiving more attention in the near future as the world seeks ways to increase the sustainability of our ways. I suspect many will be surprised at the improvements that can be made from careful interaction design and HCI.

Value Sensitive Design and Information Systems

Friedman, B., Kahn, P. H., Jr., & Borning, A. (2006). Value Sensitive Design and information systems. In P. Zhang & D. Galletta (eds.), Human-Computer Interaction in Management Information Systems: Foundations, (pp. 348-372). Armonk, New York: M.E. Sharpe. [pdf]

This is a chapter about value sensitive design and information systems taken from the book: Human-Computer Interaction and Management Information Systems. Management Information Systems focus on the systems that enable organizations, primarily businesses to be more efficient in their routine tasks. The five component model of an information system suggests that a Management Information System is comprised of five major components including: hardware, software, data, processes and users. This book focuses on the user experience and this chapter in particular extends that focus to value sensitive design.

This chapter draws 10 conclusions on three case studies. The first case study examined web browser cookies and how the use of cookies may violate the value of informed consent. The second study looked at virtual office windows, and studied the trade-off between the value of physical and psychological well-being verses perceived privacy in public spaces. The third case predicted patterns of urban development for periods of 20+ years using different scenarios employing decision making methods to promote fairness, accountability and democracy in the decision making process.

The three case studies:

Cookies and Informed Consent
This case study explored the use of web browser cookies. This case explored the three central ideas or values related to browser cookies; voluntariness, comprehension and agreement. The authors use the term voluntariness to represent that a particular action is not coerced or controlled in anyway. Comprehension is viewed as the ability of the user to understand the implications of their actions. For example, if they accept a cookie do they fully understand what this means and the potential implications to privacy, etc. of this action? Agreement assumes that there has been an opportunity for the user to either accept or decline the action. Many systems assume agreement by the default of an automatically opted-in system. Users of such systems never have an opportunity to accept or reject the action, nor do they often even have the knowledge of this opportunity. In the end, consent should encompass the aforementioned values.

The authors found through this study that there was a balance between providing too many prompts for agreement or acceptance of a cookie and none at all. With too many prompts, users would become annoyed, desensitized and viewed the prompts as a nuisance. For the study, the group redesigned Mozilla’s open source web browser (Netscape) to develop a proof of process web browser interface. In the prototype they created a side window, similar to bookmarks, to provide peripheral awareness of cookies being downloaded. The cookies were color coded indicating where the cookie was coming from (third party, etc.). The system provided “just-in-time” information and helped with the management of cookies.

The authors argue “this project illustrates the iterative and integrative nature of Value Sensitive Design, and provides a proof-of-concept for Value Sensitive Design in the context of mainstream Internet software.” While I agree with this conclusion, it raises several questions for me. First, while this proof of process seemed to be successful and makes a lot of sense, why wasn’t it widely adopted? Why hasn’t awareness of our privacy or lack of, been brought to the forefront of our consciousness? It appears to me that we continue to be a society of automatic opt-ins without informed consent. This is a major social compromise many of us aren’t aware we are making.

Face book is an example. As a default our profiles are open to everyone in our network. While we “voluntarily” post our profile, pictures, and personal information on face book, I’d argue that many do not comprehend the social significance and potential implications of this. In a quick survey of 25 junior and senior college students, I found that over 40% had profiles without any privacy settings. I suspect and plan to follow this up, that when I speak with them that they will not be aware of having an open profile nor the implications that could result.

Room with a view
This case study used plasma screens displaying scenes from outside the building installed on internal office walls (offices without windows). The views of outside were found to decrease stress and have other positive physical and psychological benefits. What the case brought to light is that often we only look at the primary or direct stakeholders. In this case they were the “watchers.’ While the “watchers” enjoyed numerous benefits, the researchers found that the “watched” or indirect stakeholders had some real significant issues concerning their privacy once they learned they were being video typed. The concerns were more pronounced with women than men. This study demonstrated that if the focus is only on the direct stakeholders, a solution may look good and appear to meet the needs of the direct stakeholders. However, once the scope is expanded to include indirect stakeholders a more holistic understanding of the implications may be evaluated.

UrbanSim
This program was used to help predict and shape the patterns of urban development as far into the future as twenty years. This program was applied to several major metropolitan regions. The process of developing UrbanSim the group was committed to fostering moral values by promoting fairness, accountability and democracy in the decision making process. Fairness was incorporated by ensuring that the simulations did not discriminate unfairly against any groups of stakeholders, essentially providing freedom from bias. Accountability was assumed by confirmation that the values were reflected into the design of the simulations. The project supported a democratic planning process where all stakeholders had a fair say in the process. Agile software development as well as open source clear coding and rigorous testing made the incorporation of the moral values into the system possible.

This article concluded with ten practical suggestions. The suggestions start by looking at the value, technology or context of use. Once this has been identified future exploration of direct and indirect stakeholders may be considered along with the benefits and harms to each stakeholder group. Potential value conflicts as well as value implications should be considered. The authors also suggest heuristics for interviewing stakeholders and for tech investigations.

Reaction: Game Design Methodology to Incorporate Social Activist Themes

Submitted by Mark Galik for COMM-6480 Theory and Research in HCI


October 6, 2009

Summary

The authors propose a best practice methodology (VAP, or Values at Play) for the incorporation of social activist themes in a gaming environment. The approach is not geared towards measuring and critiquing existing games; rather they hope to offer these guidelines for incorporation in future entertainment and educational games.

Reaction

The authors frame their research through an experiment utilizing a game named RAPUNSEL where children learn basic computer programming while creating a character. Their primary focus in creating RAPUNSEL was to promote social and gender equity (the game was created for underprivileged girls), it also demonstrated other activist themes.

I’ll look at how some of the VAP concepts may exist in current entertainment games. I’ll also explore how some players may intentionally react counter to accepted social values as a means of escape in a gaming environment. Finally, I’ll offer a suggestion on how VAP can be marketed through a ratings system.

VAP themes in current games

What the authors propose is interesting, but I’m not sure to what degree the themes could be applied in a viable consumer product. The authors admit as much, but see many opportunities to incorporate VAP in entertainment games. I believe some already incorporate VAP, without being overtly obvious about it.

Shooters

In Infiniti Ward’s first person, military shooter, Call of Duty, a player will lose their life if they kill one of their allies. A message is displayed: “Friendly fire will not be tolerated.” (the Russian campaign, it even says “You are a traitor to the Motherland”). Given the main plot of the games in this series is a battle against the “evil” enemy, having targets that are deemed off-limits seems reasonable. Like other games in the military genre, teamwork, cooperation toward a common goal is a predominant theme.

If we evaluate Call of Duty against the author’s “values checklist”, it actually manages to address diversity in putting the player in the role of a Russian, Polish, French or British soldier. Gender equity is addressed in casting female characters as soldiers (a French Resistance fighter). Liberty and justice are common themes in most military campaigns and they translate into the plot of most games in the series. Defeating a common enemy – Nazi, Imperial Japan, middle-east terrorists – requires cooperation and inclusion with other computer controlled characters – if you don’t listen, it may get you killed. The online, multi-player mode of most of these games adds another dimension in bringing players from diverse age groups, skill sets and socio-economic backgrounds together in a common goal.

So, while Call of Duty is violent, it can also teach many of the VAP themes while it entertains and does so without spoon-feeding it in an obvious manner.

The shooter genre doesn’t typically embody the VAP principles by its very nature – though most put the shooter in the role of a person out for justice. The Grand Theft Auto franchise is rife with gender and ethnic stereotyping where running down pedestrians and carjacking is encouraged. Yet it is one of the most profitable entertainment games in history. Another game, “Saints Row 2”, develops its own set of skewed value system:

Respect can only be earned in Stilwater, and that requires a lifestyle that reflects your unique personality. Your crib, your crew, and your character define who you are on the streets and how you are perceived. The image you portray is as important as the decisions you make in a city ruled by false bravado and impulsive behavior. The only constant is the need for an identity that reflects your individuality and is backed up by your 12 gauge. (SaintsRow.com)

So what the authors of Saints Row are trying to say is that you may run a gang and have prostitutes, but you’re in charge of your criminality and you have to own it, make it your own – does this address the creativity and expression goal? Along the way, pick the right “crew” because that brotherhood is most important, to hell with the rest: “Sometimes sending a message to your enemies requires heavy lifting, like that of a rival gang member into oncoming traffic.” So I suppose cooperation and inclusion is addressed here as well? Unless the underlying plot of a game meets some altruistic goal, any social message you hope to convey will be lost.

Sports

Most sports simulations also carry over themes of good sportsmanship from the playing field to the game console. For example, in the Madden football series’ Superstar mode, a player develops a custom football star that hires an agent, talks to the press and develops a playing style. Superstars are penalized and labeled as selfish players if they hire the wrong type of agent, speak arrogantly to the press or play selfishly on the field. The game promotes the idea that along with being a superstar comes the role of being a “team leader”.

As the authors state, VAP themes should be a goal for any game. While it may be easy to incorporate some of the themes from the VAP toolbox in game play, such as privacy, creative expression and cooperation, other themes may prove difficult if they run contrary to the plot of the game. Developing games that are focused on social activism would allow a game designer to go deeper into the toolbox to explore multiple themes in greater detail.

Alter egos in a gaming environment

Something the authors may have not considered is idea that those who play games for entertainment may want to explore actions that run contrary to their on belief system. That’s not to say that you have to exhibit homicidal tendencies to play a game where you kill people, but a person’s decision making in other, less criminal, aspects of the game may be out of character with how they would respond in a similar real life situation. For example, in a sports game where an individual understands the benefit of team play, they may want to explore would it would be like to act like a lone wolf – attempting to make all the plays for themselves.

Without a system in place (in these games as in real life) to penalize this type of behavior, a player may run unchecked and any social value message the game creator hopes to convey may be lost.

VAP Rubric?

Games carry a rating system developed by the Entertainment Software Rating Board (ESRB) to assist parents in determining what themes are present in games (e.g.: intense violence, drugs, sexual content, nudity etc.) Both Call of Duty and Grand Theft Auto are rated M for Mature, but as discussed earlier, both have very contrary social themes. A rubric should be developed to measure new and existing games against the VAP principles. The rating system would assist parents in deciding whether the game would be appropriate for their children that are mature enough to handle the violence.

Value Sensitive Design

One core value of many generations and cultures is the desire to provide and leave something behind for the future generations. In his paper, Sustainable Interaction Design: Invention & Disposal, Renewal & Reuse Eli Blevis states that Sustainable Interaction Design (SID) should be the central focus of interaction design. Blevis addresses the important topic of environmentalism or environmental responsibility.

Belvis presents the example of Apple’s iPod device as being disposable (this example would fit in with Belvis’ model of invention & disposal.) And fitting with American culture, the iPod and many other gadgets are thrown away frequently when a “newer and better” model is released. This is good for Apple if you are looking at profits and market share, but when it comes to sustaining the planet for future generations it is abominable. While Apple offers the 10% discount on the purchase of a new item when you trade in your old mobile phone or iPod, I cannot see where they offer an incentive to keep the one you have, since hardware-wise they are not upgradable. The batteries and storage are all built in and not replaceable and/or expandable. The 2GB iPod that I purchased several years back still works, but its storage media was filled to capacity long ago. Apple’s recycling website does make mention that they are serious about the company’s environmental impact, and the impact that their devices make on the environment. But wouldn’t it be more responsible to make fewer devices, thus reducing their carbon footprint since their gadgets in are made in factories which pollute the environment? It would far more sustainable to produce items that are upgradeable.

Blevis does mention how Leica produces cameras that are “heirloom quality, professional objects.” Because new (digital) Leica cameras accept the same high-quality lenses that older 35mm camera bodies accepted, Leica is following a more sustainable design model. Blevis believes that this is more common in professional quality products than products made for common consumers, and to some extent he is correct, but there are other companies that do share this model. The Pentax camera company, a long-established company that historically made 35mm film Single Lens Reflex (SLR) cameras, film medium format cameras, and today makes digital SLR’s and is rumored to be soon producing digital medium format cameras. They are a company that makes products for both the average consumer and professionals. Every lens that Pentax has produced is usable on all present Pentax camera bodies (let us hope they keep this pattern with the new digital medium format bodies.) Pentax’s share in the U.S. photographic market is significantly smaller than that of Canon or Pentax. In a time where “green is hot,” I am surprised that Pentax hasn’t launched a more aggressive campaign highlighting this sustainable feature of their products. I purchased a Pentax digital SLR body because I owned a Pentax film body and lenses. The driving cause of this action was the money I would save, but it was also a major benefit that I could reuse equipment as opposed to starting a new system from scratch.

In their paper A Game Design Methodology to Incorporate Social Activist Themes Mary Flannigan & Helen Nissenbaum describe how the methodology Values At Play (VAP) can be used to develop and teach girls the programming code while playing a game. Flannigan & Nissenbaum demonstrate how the RAPUNSEL project can be used to empower a population of underrepresented people. In this case, the group of people is underprivileged girls. The RAPUNSEL game is intentionally designed to demonstrate positive values to girls. The game has reward systems and challenges that seem similar to other games. RAPUNSEL takes a different approach from what many games I have encountered before do. So many games I’ve seen let you collect a weapon inventory and reward you for killing your enemy. RAPUNSEL urges players to engage in social challenges and teaches girls programming code to design their own clothes and dance moves. Earlier this semester, I became deeply interested in the Smalltalk project, and I feel that the RAPUNSEL project shares some of the same key goals of empowerment.

According to Flanagan & Nissenbaum’s paper, players can challenge one to a dance competition, but players have the option of actually turning down a challenge if they do not want to engage in competition. This style of play can satisfy the human desire to compete, but it does not focus on it as the primary goal of the game. The game has many goals and appeals to different types of girls seeking different gaming experiences. According to the website rapunsel.org, the game is a “dance game designed to teach computer programming to 10-12 year olds.” The RAPUNSEL project is targeting this underrepresented population to help fill the void of young women entering technology-related career fields and educational programs. Girls playing this game not only get to experience a dance game, but they get to learn programming skills which could be the catalyst that gets them interested in technology, computers or programming. This “play and learn” style is not a new innovation, but in this case RAPUSNSEL intentionally reaches out to this demographic that is forgotten when it comes to computer games and learning the skills to create them.

The game does address activities that are more “girl-friendly” such as fashion and dance. These are activities that are historically more interesting to girls, and I feel it was very appropriate for the game designers to incorporate these activities into the project because it makes the game more appealing to girls. In screenshots available at rapunsel.org one will find that there is a diverse cast of characters featured in the game. I feel that the designers made conscious decisions to put them in modern dress, but did not over sexualize them (often seen with too-suggestive clothing and too much makeup)which is something that we see happen all to often in media targeting young girls.

In Value Sensitive Design and Information Systems (Batya Friedman, Peter H. Kahn Jr. and Alan Borning) and Human Values, Ethics, and Design (Friedman and Kahn) many human values are explored and how designers should take these values in to account. Two particularly interesting values they discussed were privacy and security.

We are living in a time where many groups are flocking to social networking websites and communities. Privacy is a key value to many individuals, but the amount of information people publish about themselves on public pages may be seen as contradictory. I often ask myself several questions, “do many of these “social networkers” even care about privacy anymore?,” “how much do I care about my privacy?” and “does anyone care about my privacy?” Friedman and Kahn point out in their reading that there is a “mismatch between industry practice and the public’s interest.” They mention that many websites are collecting personal information without informing users that they are doing so, but a poll suggests that a large majority (88%) of people want the sites to acquire their consent. Users of internet technology say they want informed consent and privacy, yet the actions of so many corporations and even some individuals contradict this human value. Social networking websites such as Facebook have settings that one can enable to protect their privacy, but they are rather complex. There are even third-party websites that offer “how-to’s” on protecting your privacy on Facebook (see: http://www.allfacebook.com/2009/02/facebook-privacy/. ) Many people do not want to be bothered with “tweaking” their privacy settings though, it is time consuming and I feel that most people want their web experience to be easy and hassle-free. A similar issue is raised by Friedman and Kahn about Cookies. Would a user really want to be bombarded with a warning every time a cookie will be stored on their system? I feel that the case of the Mozilla browser in this chapter is encouraging. I feel that folks may be more aware of their privacy online if info about cookies is readily available on a sidebar. Microsoft also seems to be working on meeting users’ desire for privacy. Internet Explorer 8 offers inPrivate browsing in which cookies are only stored in the memory so pages display correctly (according to Microsoft.) This feature is not available “out of the box,” a user must enable it. Again, learning to do this takes a little exploring, and I find myself asking, “does the average internet user bother with seeking out such a tool?”

girls roaring into the online game space

My two sons (aged 5 and 9) play a wide range of video games on their Nintendo DS devices, our Wii, and online at the family PC. Of the online games, several are community-oriented such as Club Penguin and Webkinz. There is a great difference between the action games they play such as the LEGO series (Batman, Star Wars, and Indiana Jones) and this other type. The action games are violent (yes, LEGO games involve a great amount of destruction and “killing” although there is no blood), competitive, fast-paced, and adventure-based. The boys are constantly seeking ways to outscore and outplay one another.

On the other hand, Club Penguin and Webkinz are tame, safe (no one gets hurt), non-competitive, puzzle and relationship-based games. Although there are scores to earn in both types, the points in the community-oriented games amount to a form of currency that players can spend on a variety of items that serve to create atmosphere. For example, in Club Penguin, players can buy an assortment of housing goods and style-related accoutrements to “trick out” their pad or character's appearance.

Although I have not made a gender distinction between these markedly different styles of gaming, our American cultural mores and ways of perceiving gender interests will undoubtedly create the divide for us. Action games are for boys and community-oriented games are for girls (penguins and stuffed animals do not rank high on the testosterone meter). The fact that my sons play these games is not so much a statement of their gender association as it is a testament to the overall design integrity of the games. Simply put, boys didn't play these kinds of games when I was growing up because these kinds of games weren't being designed (for boys or girls).

One person who can be credited with a large share of the popularity of the second type of game is Brenda Laurel, who over the course of several decades, has pioneered games for young girls. Laurel is a writer, researcher, and game designer. In the early 1990s, she joined Interval Research to begin looking at the question of how play varies by gender. In an interview for Designing for Interaction (http://www.designingforinteraction.com/laurel.html), she discusses why she didn't start with the question “why don't girls play computer games?” – an answer which corroborates my experience with games growing up: “... the answers to that question (at least at the time we were asking it, in the mid-1990s) were at the same time highly predictable (e.g., the early, rapid vertical integration of the computer game industry around a monolithic male demographic) and not particularly actionable (e.g., girls don't play games because games aren't design for them or offered in retail spaces where girls go).”

After several years of research involving over a thousand children and literature reviews which covered thousands more, Laurel and her team began developing heuristics for interface design practices that applied to young girls and gaming. The project, called Safari – as it sought the big game girls would play – sailed against the prevailing winds of the industry. At this time in history, the $10 billion dollar computer game industry largely ignored girls.

Some of the research involved mixing gender signal traits: “For example we made a pink furry truck, and we learned that pinkness overrides truckness. We did a diary with bullet holes in it, and found that it is still a diary and boys won't use it” (http://www.designinginteractions.com/). Based on the findings of the Safari research, Laurel founded Purple Moon in the mid-90s, a startup company funded by Interval. The company consisted of three interconnected business ventures: “interactive CD-ROMs, the purplemoon.com website, and an array of Purple Moon collectibles.” At one point, over 40,000 young girl gamers occupied the virtual space of Purple Moon. Descriptions of the now-defunct site read like a playbook for Club Penguin and Webkinz-style community-oriented games with an emphasis on participatory narrative play. Like these newer game environments, “There was an internal postcard system, like an internal e-mail system, so that we could protect kids from predatory behavior by adults.” Before Disney bought Club Penguin, the site owners emphasized the safety of their internal game communication system as having similar characteristics.

It is, in my estimation, Laurel's research acumen that helps to set her apart from others who may walk a similar path. She stresses several times in various sources the need for solid research: “I fervently believe in research as a necessity for good design and I teach it that way” (http://blog.ted.com/2009/03/interview_with_2.php). One of the first courses students must take in the Graduate Program in Design Laurel designed (and chairs) at California College of the Arts is Design Research. In her own work, listening to the girl gamers gave her insight into the special world they occupied as players. The girls said they wanted to “make up their own stories about the characters and to make up new characters and possibly put themselves as characters into the stories.” Research into ways girls engage in sports “had a huge influence on both the plots and the UI” for the successful Starfire series.

In 1998, Laurel was invited to speak at the Technology, Entertainment and Design (TED) Conference in Monterey, California. During that talk, she showcased and discussed several of the features of Purple Moon and the nature of designing games for girls:




At the height of the dot com boom, Mattel purchased Purple Moon. However, in a frustrating turn of events, Mattel killed the venture in 1999. Laurel writes about her experience in the book Utopian Entrepreneur. Even though her bitterness is justified, she still takes pride in seeing the continued cultural artifacts of her failed game empire in other areas: “The 'emotional navigation' interface we developed ... [has been] useful for working with folks with autism in helping them read emotional cues” (http://blog.ted.com/2009/03/interview_with_2.php).

The impact of the work Laurel did at Interval and Purple Moon shouldn't be underestimated. Will Wright's The Sims and Spore stand as exemplars of the participatory narrative frameworks championed by Laurel. Even the ability to customize one's Mii on the Wii game settings is an idea whose roots extend back to the kind of work Laurel was doing even before Purple Moon - she holds an MFA and a PhD in Theater and her dissertation was the “first to propose a comprehensive architecture for computer-based interactive fantasy and fiction” (http://www.tauzero.com/Brenda_Laurel/BrendaBio.html).

The fact that girls occupy such a large space in the world of gaming as compared to the virtual terrain of the 80s and early 90s speaks to the impact her work and research has had on a once boys-only zone. And although she is generally unwilling to take much credit in this regard, she does concede that “interventions like Purple Moon enhanced girls' comfort with computers, which we set out to do, and brought girls roaring into the online game space” (http://blog.ted.com/2009/03/interview_with_2.php).

My computer, my friend

To suggest that people do not have a relationship with their computers would be a mistake. Everyone I know talks to their computer at one time or another. Most of the time, they are irritated and voicing their frustration, but, none-the-less, they are having some sort of “conversation” with their computer. Everyone knows the computer will not answer back (yet), but it cannot be helped. As a student, much of my time is spent working with my computer, so it should not come as a surprise that I would feel something when it doesn’t work properly. My computer is set up just the way I want, enabling me to find things quickly. Another computer may function just the same, but it may not be quite as pleasant of an experience.

A similar phenomenon exists with people and their cars. People have been naming their cars for as long as I can remember. In essence, this gives their car an identity and shows that they have some sort of relationship; so why should this emotion toward a computer seem so farfetched? Both the computer and the car are types of technology that we may spend countless hours working on, working with or riding in from place to place. These technologies are vehicles for our daily life, making a lot of what we do possible. Some of these technologies even take on human voices and characteristics, which could be why people give or attribute a human quality to these items.

The research I found interesting is the study that showed people are polite to computers. I suppose if you have attributed a human quality to a device, you would treat it in a similar manner as you would a person. We all know, in our head, the computers’ feelings cannot be hurt, but this research shows we may be thinking more emotionally than expected, possibly with our heart.

Emotions are often at the center of how we go about our day. Therefore, if my computer were to flatter me each time I turned it on, I may start my session in a better mood. The research suggests people are not partial to flattery from a computer versus flattery from a person. Interesting to think an insincere compliment from a computer could make you feel the same way as an insincere compliment from a person. Our reasoning could be that when you receive flattery from a person, there stands a chance it may be genuine. This is obviously not so with a computer, which goes to show that ego is a powerful part of our personality.

People often relate to other people with the same personality characteristics, so why not a computer with the same characteristics? People often say opposites attract, but the opposite (pardon the pun) may be true. People seem to be drawn to others with similar interests, similar styles and similar ideas. People can also be too much alike causing them to repel one another, hence opposites attract. However, people identify with others that they can relate to and personality characteristics are no exception. It should come as no surprise to me, but it does, that people would be attracted to a computer that is similar to their own personality. Once you have given a computer a human quality and feel emotional about it, it stands to reason you would be drawn to it if the personality characteristics were similar to your own.

One of the other studies pondered whether or not a computer could be male or female. Before I began reading the passage, I had no idea the researcher was going to use stereotypes to test for gender. I find it a bit offensive that, in 1997, the author was still attaching and reinforcing such stereotypes that have been present for hundreds, if not thousands, of years. Of course these stereotypes still exist (even today) and I do not mean to suggest otherwise. But to create a study that puts them at the forefront of this research is, in my opinion, unimaginative. I suppose if you wanted to test for stereotypes this was the way to do it, but it was not what I was expecting.

I think that we are emotional beings who are protective of the things around us. The more time spent with something, the more protective you may become and the more personal these items may feel. They become a part of your world and without realizing, you have humanized your computer.

One final thought: as I googled humanized I found http://humanized.com/. The site has free software called ENSO which turns your caps lock button into a command key. You use it by holding down the caps lock button and typing in something simple and when you let it go, it puts your command into action. Haven’t tried it yet, but it looks interesting.

On “Emotion in Human-Computer Interaction” and Developing Compassion

People are inherently emotional. Emotions, sentiments, and moods effect each aspect of response and interaction in our lives. Indeed, if any interface ignores this, it “risks being perceived as cold, socially inept, untrustworthy, and incompetent.” Part of the truth of this lies in the personification of the computer or software by the user. However, we also have the choice to change our emotions, sentiments, and moods in order to modify our behavior. The key lies in consistent intention and progression.

Brave and Nass reveal the underlying mechanisms of emotion with a figure that demonstrates the connections between the thalamus, the cortex, and the limbic system. The thalamic-limbic pathway is responsible for the primary emotions, while secondary emotions “result from activation of the limbic system by processing in the cortex.” They then go on to cover the debate over whether or not emotion is innate or learned. Regarding this debate, Brave and Nass describe the middle of the two extremes where “the limbic system is prewired to recognize the basic categories of emotion, but social learning and higher cortical processes still play a significant role in differentiation.”

One recent article that came to my attention involves the ability to learn compassion using meditative states. The experiment in the article entitled Regulation of the Neural Circuitry of Emotion by Compassion Meditation: Effects of Meditative Expertise used functional magnetic resonance imaging (fMRI) to measure differences in brain activity between novice and experienced meditators, those having 10,000 plus hours of Buddhist compassion mediation practice. They were asked two alternate between actively generating a condition of compassion mediation and refraining from the practice.

In this case:

The meditative practice studied here involves the generation of a state in which an “unconditional feeling of loving-kindness and compassion pervades the whole mind as a way of being, with no other consideration, or discursive thoughts” ... According to the tradition, as a result of this practice, feelings and actions for the benefit of others arise more readily when relevant situations arise. Our main hypothesis was thus that the concern for others cultivated during this meditation would enhance the affective responses to emotional human vocalizations, in particular to negative ones, and that this affective response would be modulated by the degree of meditation training.

They analyzed the areas of the brain associated with empathy including the insula cortex and the somatosensory cortex. The data support their main hypothesis, namely that “the brain regions underlying emotions and feelings are modulated in response to emotional sounds as a function of the state of compassion, the valence of the emotional sounds and the degree of expertise.”

One interesting way to see these results is to acknowledge that the meditation itself, over time, changes the neurology of the practitioner in such a way that the empathy and compassion become more automatic and spontaneous. In the section on Effects of Affect: Attention, Brave and Nass state, “people also often consciously regulate mood, selecting and attending to stimuli that sustain desired moods or, alternatively, counteract undesired moods.” Compassion meditation would then put people in a more sustained compassionate mood. I say mood because it seems to fit the definition better than emotion. “Moods...are nonintentional; they are not directed at any object in particular and are thus experienced as more diffuse, global, and general.” This would seem to be the case with long-term practitioners of compassion mediation. It becomes a “way of being.”

Brave and Nass support this by saying, “Intense or repetitive emotional experiences tend to prolong themselves into moods.” The Lutz, Johnstone and Davidson study used fMRI results to measure affect, but Brave and Nass also suggest other methods for doing so, including electroencephalogram (EEG) to test neurological responses, autonomic activity, facial expression, voice, self-report measures, and affect recognition by users.

Depending on the conditions of the study, these methods for testing affect differ in efficacy. The Compassion Mediation study did not use behavioral analysis during the testing because the meditators informed them that this would interfere with the meditation process itself. So they has to rely on the fMRI measurements and a certain amount of self-reporting. Self-report measures, in particular, suffer from a problem with temporal relevance. Brave and Nass point out that “questionnaires are capable of measuring only the conscious experience of emotion and mood. Much of affective processing, however, resides in the limbic system and in nonconscious processes.”

The dimensional theories using arousal and valence were also used during the Compassion Mediation study and with correlational results. This would support that for further research, where any self-reporting is necessary, compassion should be tested as a mood emergent from a two-dimensional space of “conscious emotional experience.”

By Christine Rosakranse
Professor Nathan Freier
Theory and Research on Tech Comm and HCI
September 29, 2009

References:
Brave, S., & Nass, C. (2007). Emotion in human-computer interaction. In Sears, A. & Jacko, J. (Eds.). The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications, 2nd Edition. (pp. 77-92). Lawrence Erlbaum.
Fledman Barrett, L. & Russell. (1999). The structure of current affect: Controversies and emerging consensus. Current Directions in Psychological Science, 8(1), 10-14.
Lutz A, Brefczynski-Lewis J, Johnstone T, Davidson RJ (2008) Regulation of the Neural Circuitry of Emotion by Compassion Meditation: Effects of Meditative Expertise. PLoS ONE 3(3): e1897. doi:10.1371/journal.pone.0001897



1 Brave, S., & Nass, C. (2007). Emotion in human-computer interaction. In Sears, A. & Jacko, J. (Eds.). The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications, 2nd Edition. (pp. 77-92). Lawrence Erlbaum.
2 Brave, S., & Nass, C. (2007). Emotion in human-computer interaction. In Sears, A. & Jacko, J. (Eds.). The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications, 2nd Edition. (pp. 77-92). Lawrence Erlbaum.
3 Lutz A, Brefczynski-Lewis J, Johnstone T, Davidson RJ (2008) Regulation of the Neural Circuitry of Emotion by Compassion Meditation: Effects of Meditative Expertise. PLoS ONE 3(3): e1897. doi:10.1371/journal.pone.0001897
4 Brave, S., & Nass, C. (2007). Emotion in human-computer interaction. In Sears, A. & Jacko, J. (Eds.). The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications, 2nd Edition. (pp. 77-92). Lawrence Erlbaum.
5 Brave and Nass, pg. 87.
6 As described by Fledman Barrett, L. Russell, 1999. The structure of current affect: Controversies and emerging consensus. Current Directions in Psychological Science, 8(1), 10-14.