Taylor N, Frohlich DM, Egglestone P, Marshall J, Rogers J, Blum-Ross A, Mills J, Shorter M, Olivier P (2014) Utilising insight journalism for community technology design., CHI pp. 2995-3004 ACM
We describe the process of insight journalism, in which local amateur journalists were used to generate unique insights into the digital needs of a community. We position this as a means for communities to represent themselves to designers, both as a method of designing community technologies and as a first step towards supporting innovation at a local level. To demonstrate insight journalism, we present two case studies of community technologies that were directly inspired, informed and evaluated by journalistic content. Based on this experience, we evaluate the role that insight journalism can play in designing for communities, the particular characteristics that it lends to the design process and how it might be employed to support sustainable community innovation.
This article reports an investigation of the initiation and management of repair in human-computer interaction from a conversation-analytic perspective. It describes some ways in which pairs of novice users deal with what they see as ?trouble? in the operation of a multiwindow database system called Sales and Marketing Information (SAMi). A typical sequence has the character of a user request followed by a pause or computer granting, leading to user repair in initial or third position. Three components of repair are identified: The user attempts to get the computer to undo a previous granting, redo a previous request, or grant a new request. Some common ways in which these components are combined, ordered, and performed are illustrated with reference to transcripts of actual sequences of recorded interaction. The relevance of these findings for design is discussed, together with the future potential of the approach that generated them. © 1994, Taylor & Francis Group, LLC. All rights reserved.
Frohlich D, Fennell J (2007) Sound, paper and memorabilia: resources for a simpler digital photography, Personal and Ubiquitous Computing 11 (2) pp. 107-116
In this paper we reflect on a body of work to develop a simpler form of digital photography. We give three examples of 'Less is More' thinking in this area which are directed and inspired by naturalistic user behaviours and reactions to design ideas. Each example happens to review the place of an old technology in the new scheme of things, and challenges a technological trend in the industry. Hence, we consider the role of sound in photography to recommend audiophotographs rather than short video clips as a new media form. We look again at the role of paper in photo sharing and recommend its support and augmentation against the trend towards screen-based viewing. Finally, we consider the role of physical souvenirs and memorabilia alongside photographs, to recommend their use as story triggers and containers, in contrast to explicit multimedia presentations. The implications for simple computing are discussed.
In this paper we describe a design-orientated field study in which we deploy a novel digital display device to explore the potential integration of teenage and family photo displays at home, as well as the value of situated photo display technologies for intergenerational expression. This exploration is deemed timely given the contemporary take-up of digital capture devices by teenagers and the unprecedented volume of photographic content that teens generate. Findings support integration and the display of photos on a standalone device, as well as demonstrating the interventional efficacy of the design as a resource for provoking reflection on the research subject. We also draw upon the theoretical concept of Dialogism to understand how our design mediates intergenerational relationships and interaction aesthetics relating to the notion of ?constructive conflict?.
Lalmas M, Bhat R, Frank M, Frohlich D, Jones M (2007) Bridging the digital divide: Understanding information access practices in an indian village community, Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR'07 pp. 741-742
For digital library and information retrieval technologies to provide solutions for bridging the digital divide in developing countries, we need to understand the information access practices of remote and often poor communities in these countries. We must understand the information needs of these communities, and the best means to provide them access to relevant information. To this end, we investigated the current information access practices in an Indian village.
Al-Azzawi A, Frohlich DM, Wilson M (2007) Beauty constructs for MP3 players., CoDesign ? Intetrnational Journal of CoCreation and design and the Arts 3 (S1) pp. 59-74
Taylor & Francis
This paper contributes to the current debate about the nature of beauty and aesthetics as they apply to interactive products. Current disagreement centres around the question of whether beauty should be viewed as a continuous property of objects or as a rare emotional response to object encounters (Hassenzahl 2004, Frohlich 2004). Here we develop a new perspective of beauty as a complex psychological construct, subject to competing influences from visible object properties such as shape and colour, and invisible object associations such as perceived ease of use and brand. We introduce a new methodology for examining such constructs based on a card sorting procedure, and use it to show how 36 participants think about the beauty of 35 MP3 players. One major finding is that participants tended to evaluate the players holistically, applying similar categorisations to free sorts, beauty sorts and preference sorts. This involved a common polarisation between modern and post-modern forms as they have been found to apply to architectural styles (Wilson 1996).
Formulating precise descriptions of human-computer interactions is a prerequisite for the principled design, implementation, and evaluation of interactive systems. This article reports an exercise in interaction specification using Foley and Van Dam's (1982) multilayered method of documenting the design of a user-computer interface. The specification was used to communicate the intended behaviour of a Forms Helper system from a design team to an implementation team. The ease with which the interaction could be represented at each of Foley and Van Dam's four levels of abstraction is discussed, and recommendations are made for improving the method in places where its guidance was unclear or inadequate. The value of the method is examined prior to a discussion of the potential role of such specifications in the design and development cycle. © 1989, Taylor & Francis Group, LLC. All rights reserved.
With current digital technologies, people have large archives of digital media, such as images and audio files, but there are only limited means to include these media in creative practices of crafting and making. Nevertheless, studies have shown that crafting with digital media often makes these media more cherished and that people enjoy being creative with their digital media. This paper aims to open up the way for novel means for crafting, which include digital media in integrations with physical construction, here called 'hybrid crafting'. Notions of hybrid crafting were explored to inform the design of products or systems that may support these new crafting practices. We designed 'Materialise' - a building set that allows for the inclusion of digital images and audio files in physical constructions by using tangible building blocks that can display images or play audio files, alongside a variety of other physical components - and used this set in four hands-on creative workshops to gain insight into how people go about doing hybrid crafting; whether hybrid crafting is desirable; what the characteristics of hybrid crafting are; and how we may design to support these practices. By reflecting on the findings from these workshops, we provide concrete guidelines for the design of novel hybrid crafting products or systems that address craft context, process and result. We aim to open up the design space to designing for hybrid crafting because these new practices provide interesting new challenges and opportunities for future crafting that can lead to novel forms of creative expression. © 2013 Springer-Verlag London.
The application of biometric technology has so far been top-down, driven by governments and law enforcement agencies. The low demand of this technology from the public, despite its many advantages compared to the traditional means of authentication is probably due to the lack of human factor considerations in the design process. In this work, we propose a guideline to design an interactive quality-driven feedback mechanism. The mechanism aims to improve the quality of biome?trie samples during the acquisition process by putting in place objective assessment of the quality and feeding this information back to the user instantaneously, thus eliminating subjective quality judgement by the user. We illustrate the feasibility of the design methodology using face recognition as a case study. Preliminary results show that the methodology can potentially increase efficiency, effectiveness and accessibility of a biome?trie system.
We report a user requirements study of several interfaces for the playback of sounds from photographs. The study showed that users liked listening to audiophotos when the sounds are played back from photographic prints, but as a compliment to playback on a PC. When handling prints the audio needs to be invoked manually from the print with a facility to pause the audio during playback. A handheld audioprint player was then designed to fulfill these needs, based on an embedded chip in the paper.
Frohlich D, Murphy R (2000) The memory box, HP Laboratories Technical Report (95)
A Memory Box was built to illustrate the possibility of recording and attaching stories to memorabilia kept in a box. Potential users then provided a range of ideas about what kinds of stories and objects they would keep in the box, and how they would use it. The findings confirm the value of attaching stories to souvenirs, especially in the context of gift-giving, and have implications for how this might be implemented through augmented reality interfaces.
The StoryBank project in the UK is exploring the application of digital storytelling technology to information sharing in the developing world. A multidisciplinary team of interaction designers, ethnographers and computer scientists are adopting a user-centered approach to the design of a system which should be useful to a specific rural community in South India. This paper discusses some of the challenges that the interaction designers met and how these shaped the design process. © 2007 Dorothy Rachovides, David Frohlich, Maxine Frank.
Do the gender differences found when men and women maintain personal relationships in person and on the phone also emerge when they use electronic mail? Alternately, does e-mail change these ways of interacting? The authors explore the types of relationships women and men maintain by e-mail, differences in their e-mail use locally and at a distance, and differences in the contents of messages they send. The findings are based on qualitative and quantitative data collected during a 4-year period. These data suggest that using e-mail to communicate with relatives and friends replicates preexisting gender differences. Compared to men, women find e-mail contact with friends and family more gratifying. Women are more likely than men to maintain kin relationships by e-mail. They are more likely than men to use e-mail to keep in touch with people who live far away. Women's messages sent to people far away are more filled with personal content and are more likely to be exchanged in intense burst. The fit between women's expressive styles and the features of e-mail seems to be making it especially easy for women to expand their distant social networks.
Frohlich D, Adams G, Tallyn E (2000) Augmenting photographs with audio, Personal and Ubiquitous Computing 4 (4) pp. 205-208
We report a user requirements study of several interfaces for the playback of sounds from photographs. The study showed that users liked listening to audiophotos when the sounds are played back from photographic prints, but as a complement to playback on a PC. When handling prints the audio needs to be invoked manually from the print with a facility to pause the audio during playback. A handheld audioprint player was then designed to fulfill these needs, based on an embedded chip in the paper. © Springer-Verlag London Ltd.
Zargham S, Calic J, Frohlich DM (2015) 4streams: An ambient photo sharing application for extended families, Proceedings of HCI 2015 pp. 165-174 British Computer Society
In this paper we describe a novel photo sharing system called 4streams. This is an ambient photo display that allows a small group of users to keep in touch through a kind of visual twitter feed of concurrent photographs from their mobile phones. The photographs of up to four users are displayed in a dynamic collage in the four quadrants of a dedicated ambient display, with photographs to each quadrant arriv- ing in real time as photographs are taken/uploaded. His- torical photos can also be browsed or played back in lock- step with each other, as a reminder of what each member of the group was doing over the same period of time. The system was trailed over seven weeks by an extended family distributed over three countries. The findings suggest that the system increases the social connection and presence be- tween children, parents and grandparents of an intergenera- tional family living apart. This was not only through ?visual status? images of family members living in different places, but also through updates of collocated members travelling away from home, and deliberately crafted images designed to elicit responses or trigger discussions in other media. The implications of these findings for theories of photo sharing are discussed.
Wong R, Poh N, Kittler J, Frohlich DM (2010) Towards inclusive design in mobile biometry, IEEE Proceedings of 3rd International Conference on Human System Interaction pp. 267-274
Institute of Electrical and Electronics Engineers (IEEE)
As mobile devices are becoming more ubiquitous, it is now possible to enhance the security of the phone, as well as remote services requiring identity verification, by means of biometric traits such as fingerprint and speech. We refer to this as mobile biometry. The objective of this study is to increase the usability of mobile biometry for visually impaired users, using face as biometrics. We illustrate a scenario of a person capturing his/her own face images which are as frontal as possible. This is a challenging task for the following reasons. Firstly, a greater variation in head pose and degradation in image quality (e.g., blur, de-focus) is expected due to the motion introduced by the hand manipulation and unsteadiness. Second, for the visually impaired users, there currently exists no mechanism to provide feedback on whether a frontal face image is detected. In this paper, an audio feedback mechanism is proposed to assist the visually impaired to acquire face images of better quality. A preliminary user study suggests that the proposed audio feedback can potentially (a) shorten the acquisition time and (b) improve the success rate of face detection, especially for the non-sighted users.
Gilbert GN, Fraser N, Wooffitt R (1990) Organising computer talk, In: Luff P, Gilbert GN, Frohlich D (eds.), Computers and conversation pp. 235-258 Academic
The problems of multi-limb coordination and environmental control are identified as important to any theory of skilled action. It is argued that these problems are well recognised yet unrelated in the research literature and would benefit from integration. Data are presented on the acquisition of bimanual coordination showing how both problems are solved together in a manipulative task. Subjects were required to steer a screen-displayed cursor along a variety of tilted tracks using two control knobs. Analysis of the knob and cursor movements used by subjects on the task shows that with practice, movement tends to become faster, more coordinated, continuous, accurate and economical; although the exact combination of these improvements depends upon individual differences in movement strategy. The implications of these findings for theories of coordination and control are discussed. © 1988.
Millions of people in developed countries routinely create and share digital content; but what about the billions of others in on the wrong side of what has been called the 'global digital divide'? This paper considers three mobile platforms to illustrate their potential in enabling rural Indian villagers to make and share digital stories. We describe our experiences in creating prototypes using mobile phones; high-end media-players; and, paper. Interaction designs are discussed along with findings from various trials within the village and elsewhere. Our approach has been to develop prototypes that can work together in an integrated fashion so that content can flow freely and in interesting ways through the village. While our work has particular relevance to those users in emerging world contexts, we see it also informing needs and practices in the developed world for user-generated content.
The paper reports a new paradigm for audiovisual information sharing in developing communities with low levels of textual and computer literacy. This was informed by ethnographic studies of a community radio station in Budikote village, India and involves the creation of audiophoto narrative stories on a mobile phone which are shared through a physical community repository (or ?Story-bank?). The paper reports the design and evaluation of the sociotechnical system in a trial, laying the foundation for subsequent work in South Africa resulting in the Com-Me community media open source toolkit: http://digitaleconomytoolkit.org/
This work was funded by the EPSRC Bridging the Global Digital Divide initiative and led by David. . The Computer Human Interaction Conference (CHI) is the premier annual conference in the field, with full paper acceptance rates of between 10 and 15%.
Frohlich DM (2004) Audiophotography: Bringing photos to life with sound, Kluwer Academic Publishers
There are many practitioner books on different branches and styles of photography (e.g. landscape, studio, American, etc). Some of these even cover digital photography, as it exists today (e.g. Chambers 2001). However, there are very few research books on the meaning and practice of domestic photography, and almost none on the potential impact of digital technology on this important and widespread behaviour. Chalfen?s (1987) book is still one of the best in the former area but is badly in need of updating. A collection of readings by Lister (1995) can be counted in the latter category, but adopts a rather abstract media studies approach that fails to describe photographic practices in any detail. A new book by Lambert (2003) addresses the possible combination of digital photographs, video and voiceover in 'digital storytelling'. But this is essentially prescriptive and not connected to existing photographic practices.
'Audiophotography' combines a detailed ?user studies? approach to photography, with consumers? own critiques of new media content they have generated themselves. It is therefore a new book about domestic photography and its possible transformation with digital technology. Although it focusses on the role of sound in photography, it does so in relation to a new theory of photography which is tested and refined by empirical research.
Such work is timely because of current interest in new media forms and the wide variety of new photography and video products and services emerging in the consumer market. It defines a new media type, audiophotos, and how it works, and should help readers to understand the possible benefits of other innovations in the digital photography industry.
Jones M, Harwood W, Bainbridge D, Buchanan G, Frohlich DM, Rachovides D, Frank M, Lalmas M (2008) "Narrowcast yourself": Designing for community storytelling in a rural indian context, DIS '08 Proceedings of the 7th ACM conference on Designing interactive systems pp. 369-378 Association for Computing Machinery (ACM)
The StoryBank project is examining technologies and practices
to allow digitally impoverished communities to take part in the
user-generated content revolution. The approach involves
combining mobile phones to create audio-visual stories and a
touch screen display situated in a community meeting place.
This paper discusses the design, evaluation and refinement of
the situated display. We consider how our experiences of
working with a rural Indian village community influenced
design processes, principles and prototypes. The work
highlights the value of community-centred design practices and
prototypes in such developing-world contexts.
From Snapshots to Social Media describes the history and future of domestic photography as mediated by technological change. Domestic photography refers to the culture of ordinary people capturing, sharing and using photographs, and is in a particular state of flux today as photos go digital. The book argues that this digital era is the third major chapter in the 170 year history of the area; following the portrait and Kodak eras of the past.
History shows that despite huge changes in photographic technology and the way it has been sold, people continue to use photographs to improve memory, support communication and reinforce identity. The future will involve a shift in the balance of these core activities and a replacement of the family album with various multimedia archives for individuals, families and communities. This raises a number of issues that should be taken into account when designing new technologies and business services in this area, including: the ownership and privacy of content, multimedia standards, home ICT infrastructure, and younger and older users of images.
The book is a must for designers and engineers of imaging technology and social media who want a better understanding of the history of domestic photography in order to shape its future. It will also be of value to students and researchers in science and technology studies and visual culture, as a fascinating case study of the evolving use of photographs and photographic technology in Western society.
Lim, C, Frohlich DM, Ahmed, A (2011) Supporting memory and identity in older people: Findings from a sandpit process.,
Frohlich DM, Eglinton K, Robinson S, Jones M, Vartiainen E (2012) Creative cameraphone use in rural developing regions, MobileHCI '12 Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services pp. 181-190 Association for Computing Machinery
In this paper we consider the current and future use of cameraphones in the context of rural South Africa, where many people do not have access to the latest models and ICT infrastructure is poor. We report a new study of cameraphone use in this setting, and the design and testing of a novel application for creating rich multimedia narratives and materials. We argue for better creative media applications on mobile platforms in this region, and greater attention to their local use. Copyright 2012 ACM.
As design practice has become more integrated in HCI research, there are on-going discussions around the role of design in research. Design research may take different forms, among which 'Research for Design' and 'Research through Design'. While, by definition, these two differ in their focus and result- The first informs the creation of a design artefact and the second aims for a contribution to knowledge-this paper presents a case study of design research in which Research for and through Design were used iteratively to gain insight into hybrid craft-an integrated physical-digital craft form. Based on our own reflections, this paper discusses what different roles these two strategies may play depending on the research topic under study; the phase in the design process; and the level of abstraction of the research activity and knowledge gained. It thus argues that using Research for and through Design together is a powerful strategy. Copyright is held by the owner/author(s).
Although numerous digital tools exist to support the capture and editing of music, less attention has been paid to supporting the creative process of music composition. In this paper we report the design of a new tool in this area, targeted specifically at collaborative composition between a composer and one or more performers. The tool is an open source ?composer?s notebook? app called Com-Note, which supports the creation and exchange of multimedia narratives on an Android smart phone. Requirements for the design of Com-Note were derived in a case study of the collaborative composition process, as assisted by a digital storytelling app called Com-Phone developed on another project. This involved the creation and performance of a new work for trumpet and string quartet entitled Albumleaves.
Conceptual and methodological problems related to Schmidt' (1975) motor schema theory are discussed. In particular, the motor schema is interpreted as representing the dynamics of the system being controlled, which may or may not be associated with a referent movement pattern. Furthermore, it is suggested that prior familiarity with a control system's dynamics is a critical but uncontrolled factor in tests of the theory, and largely accounts for their equivocal findings. These ideas are examined by two experiments in which subjects had to bimanually control the movement of a computer-displayed cursor along a track on a CRT screen. Different track orientations required different patterns of movement not entailing a single generalized motor program. Experiment 1 shows that variable track performance with a given control system, results in better transfer to novel tracks than does fixed practice. Experiment 2 demonstrates that altering the control system disrupts performance whether or not the required movements remain the same. These results indicate the need for a fundamental modification of schema theory, such that a schematic representation of effector-environment relations (effector function) is available independently of particular movement patterns used in its acquisition.
Suchman (1987) has recently drawn attention to the situated nature of human social action and its implications for the design of interactive computer systems. In particular, she has highlighted the shortcomings of globally managing human computer dialogues by matching user actions to some idealised plan for carrying out a task. In this paper we outline a scheme for the local management of dialogues based on the findings of conversation analysis. The scheme makes available a variety of communicative resources to both user and system, including the ability to give and take turns at talk, to initiate and carry out repair work, and to continue or change the topic of conversation. An implementation of the scheme in a welfare rights Advice System is described. © 1989 ACM.
Frohlich DM, Jones M, Dearden A, Dunckley L, Light A (2009) Stepping in: an outsiders guide to crossing the digital divide, User Experience Magazine 8 (3)
Golsteijn C, Van Den Hoven E, Frohlich DM, Sellen A (2012) Towards a more cherishable digital object, Proceedings of the Designing Interactive Systems Conference (DIS, 2012) pp. 655-664
Association for Computing Machinery (ACM)
As we go about our everyday routines we encounter and interact with numerous physical (e.g. furniture or clothes) and digital objects (e.g. photos or e-mails). Some of these objects may be particular cherished, for example because of memories attached to them. As several studies into cherished objects have shown, we have more difficulties identifying cherished digital objects than physical ones. However, cherishing a small collection of digital objects can be beneficial; e.g. it can encourage active selection of digital objects to keep and discard. This paper presents a study that aimed to increase understanding of cherished physical and digital objects, and beyond that, of how we perceive physical and digital objects, and their advantages and disadvantages. We identified design opportunities for novel products and systems that support the creation of more cherishable digital objects by extrapolating the advantages of the physical to the digital, exploiting the reasons for cherishing digital objects, and aiming for meaningful integrations of physical and digital. © 2012 ACM.
Direct manipulation refers to an interface design philosophy which originated in the early 1980's and now dominates the creation of modern software packages. In this chapter I update this philosophy in the light of recent studies, theories and interface innovations in this area. The main lesson of these developments is that a manual model of interaction does not always lead to direct or usable interfaces, and that conversational and mixed mode forms of interaction should be more widely considered as ways of extending the current HCI paradigm.
People capture more and more photographs leading to large personal photo collections
that require much time and effort to organize. A lack of organization can have a negative effect on photo retrieval and photo sharing. In this user-centred design case study we have explored new possibilities for organizing and sharing photographs. To organize photographs the concept Living Media was created; automatic positive selection based on which photographs are viewed more often and viewed for a longer time. These photographs are apparently more interesting and therefore they will keep their appearance; less popular photographs will slowly fade to black over time. To share Living Media away from the computer the device Pearl was designed. Pearl has an integrated pico projector that projects an interactive collage of Living Media in a living room. Interaction with the collage, such as deleting unwanted photographs from the collage, gives input to the selection procedure of Living Media. Placing Pearl at a distance creates a larger projection size, suitable for sharing photographs with a group of people. Our design is evaluated in two small user studies, where we found benefits and challenges of using a combination of positive selection and pico projectors for photowork and photo sharing.
The value and practice of recording sound with still photographs was explored in an audiocamera field trial. The findings challenge the current industry view that the value of sound capture lies in the voice labelling of photos. Instead they suggest that ambient sounds-of-themoment have far higher value as a way of bringing photos to life and improving human memory for events.
This paper describes the development and evaluation of "weegie" an audio-photography desk featuring sounds and images inspired by the Govan area of Glasgow. It was intended to be an interactive artwork that would challenge negative preconceptions about the area. The paper describes two techniques used to consider the extent to which the piece achieved these aims. The first technique is the "personal meaning map" and taken from museum studies. The second is cultural critique drawn from the arts. Building on Gaver's  strategy of using cultural commentators for 'polyphonic' assessment it considers the extent to which perspectives drawn from the humanities and the arts can be useful in evaluating design. It argues that a more rigorous understanding of critical theory is necessary to the development of interaction design criticism.
Spence J, Frohlich DM, Andrews S (2013) Performative experience design., CHI Extended Abstracts pp. 2049-2058 ACM
Luff P, Adams G, Bock W, Drazin A, Frohlich D, Heath C, Herdman P, King H, Linketscher N, Murphy R, Norrie MC, Sellen A, Signer B, Tallyn E, Zeller E (2007) Augmented Paper: Developing Relationships Between Digital Content and Paper., The Disappearing Computer 4500 pp. 275-297
Blum-Ross A, Mills J, Egglestone P, Frohlich D (2013) Community media and design: Insight Journalism as a method for innovation, Journal of Media Practice 14 (3) pp. 171-192
This article details the benefits and challenges of Insight Journalism, a community engagement and research methodology developed by the interdisciplinary Bespoke project. Based in two under-resourced urban neighbourhoods in North West England, Bespoke combined community media with participatory digital design by supporting local residents to create a series of 'old' and 'new' media outputs that were exhibited locally and used within an innovative design process. The digital designs inspired by the journalism were then built by the Bespoke team and deployed within the local area, where Insight Journalists evaluated their reception. Based on our experiences, in this article, we argue that Insight Journalism can provide a vital space for exploring salient civic and social issues, but must be understood as a process of building relationships and competencies, as well as a set of products including the mediated stories and digital designs that resulted from ongoing engagement. © 2013 Intellect Ltd Article.
The composition of music is a complex, creative and collaborative act. This is currently done with a range of tools including the editing of musical notation, the playing, recording and playback of musical phrases, and their verbal discussion. In this project we will bring these activities together in a single 'composer's notebook' app called Com-Note for a smart phone. This will be based on the trial and extension of an existing multimedia narrative app called Com-Phone, during the creation of a new work for trumpet and string quartet.
In this paper we report an empirical study of the photographic portrayal of family members at home. Adopting a social psychological approach and focusing on intergenerational power dynamics, our research explores the use of domestic photo displays in family representation. Parents and their teenagers from eight families in the south of England were interviewed at home about their interpretations of both stored and displayed photos within the home. Discussions centred on particular photographs found by the participants to portray self and family in different ways. The findings show that public displays of digital photos are still curated by mothers of the households, but with more difficulty and less control than with analogue photos. In addition, teenagers both contribute and comply with this curation within the home, whilst at the same time developing additional ways of presenting their families and themselves online that are ?unsupervised? by the curator. We highlight the conflict of interest that is at play within teen and parent practices and consider the challenges that this presents for supporting the representation of family through the design of photo display technology.
Focus groups have traditionally been used in market and design research to obtain group reactions to product concepts. In this article we outline a simple methodological extension to this format, involving a further stage of concept re-design in smaller subgroups facilitated by a professional designer. The method was developed in the context of working with groups of older people on concepts addressing memory, identity and social communication. It is illustrated with reference to the re-design of two seeded concepts and feedback from participants themselves on the experience of taking part. © 2014 Taylor & Francis.
With the expansion of digital photographic content stored online and concurrent proliferation of
capturing devices, the management and visualization of personal photo collections have become
very challenging tasks. In order to gain insight into novel ways of handling and representing large
personal photo collections, this paper presents results of a user experience study into novel
visualizations of multiple photo streams, sourced from different individuals or capture devices. A
web-based application prototype was designed and implemented offering synchronized
visualization of photo streams in a single- or multi-window display layout. An experimental study
was conducted with 20 users, and the results demonstrate high user demand for concurrent
presentation of multiple media streams as well as recommends methods for leveraging its
Durrant AC, Taylor AS, Taylor S, Molloy M, Sellen A, Frohlich DM, Swan L (2008) Speculative devices for photo display, Proceedings of the 26th Annual SIGCHI conference on Human factors in computing systems pp. 2297-2302
Association for Computing Machinery (ACM)
In this paper, we describe three purposefully provocative, digital photo display technologies designed for home settings. The three devices have been built to provoke questions around how digital photographs might be seen and interacted with in novel ways. They are also intended for speculation about the expressive resources afforded by digital technologies for displaying photos. It is hoped interactions with the devices will help researchers and designers reflect on new design possibilities. The devices are also being deployed as part of ongoing home-oriented field research.
Spence J, Frohlich D, Andrews S (2015) Performance and critical design., BCS HCI pp. 228-229 ACM
Critical design is a powerful methodology for HCI research that contributes to personal benefit and social renewal. We propose performance studies as a way of implementing and extending critical design.
Prabhu G, Frohlich D (2003) Contextual Invention, 2003, Kestone Research
Frohlich DM, Bhat R, Jones M, Lalmas M, Frank M, Rachovides D, Tucker R, Riga K (2009) Democracy, design and development in community content creation: lessons from the StoryBank project, Information Technologies and International Development 5 (4) pp. 19-35
University of Southern California, Annenberg School for Communication & Journalism
Mobile and Web 2.0 technology have the very real potential to democratize
the creation and sharing of multimedia content in developing communities,
even beyond the levels currently seen in community radio and television. In
this article, we report the ªndings of an exercise to test this potential in partnership
with a Budikote village in southern India. We show how a system
called StoryBank supported the creation of short digital stories on a text-free
camera phone, and how these stories could be shared through a community
repository and touch-screen display. Despite the success of a ªeld trial in which
137 stories were created and shared over a one-month period, various technical
and social factors meant that the devices and content were more hierarchically
managed and controlled than expected. The implications of these experiences
for rural development and community-centered design are discussed.
Frohlich D, Murphy R (2000) The memory box, Personal and Ubiquitous Computing 4 (4) pp. 238-240
A Memory Box was built to illustrate the possibility of recording and attaching stories to memorabilia kept in a box. Potential users then provided a range of ideas about what kinds of stories and objects they would keep in the box, and how they would use it. The findings confirm the value of attaching stories to souvenirs, especially in the context of gift-giving, and have implications for how this might be implemented through augmented reality interfaces. © Springer-Verlag London Ltd.
Frohlich DM, Smith, K, Blum-Ross, A, Egglestone, P, Mills, J, Smith, S, Rogers, J, Shorter, M, Marshall, J, Olivier, P, Woods, J, Wallace, J, Wood, G, Blythe M. (2011) Crossing the digital divide in the other direction: Community-centred design on the Bespoke project. Proceedings of Include 2011., Royal College of Art
Spence JC, Andrews S, Frohlich DM (2016) Collect Yourselves!: Risk, vulnerability, and intimacy in participatory performance, In: O'Grady A (eds.), Risky Aesthetics: Performance, Participation and Critical Vulnerabilities
In order to understand the effects of interaction on User Experience with a range of MP3 players, we used a Personal Construct Theory Approach (Kelly, 1955) to elicit users? anticipations and interpretations of their experience with technology. Sixteen participants rated four different MP3 players on a variety of user-generated constructs in the form of rating scales before and after interaction. The data revealed stability to be a dimension of constructs on a continuum between stable and volatile. The data also revealed qualitative aspects of the dynamics of User Experience as users transition between pre- to post-interaction. The implications of these findings for theory, methodology and design are discussed.
Drazin A, Frohlich D (2007) Good intentions: Remembering through framing photographs in English homes, Ethnos 72 (1) pp. 51-76
This paper looks at the context of materialised memories - the consumption and framing of photographs. Ethnographic work in British homes unearthed diverse ways of consuming and displaying photos. We propose that these modes of framing mirror the relationships within and surrounding the household, and locate them in short-hand time frames characteristic of the social exchanges appropriate to those relationships. Through framing, people flog their collective good intentions to conduct relationships appropriately over time, without capitulating either to the risk of over-imposing nor of neglect. As a counterpart to Gell's and Strathern's analyses of art and social efficacy, our work illustrates the capacity within British family culture to materialise intention around on efficacious social object,constructing intention as a quality of persons not objects while retaining the agent-like Properties of photographs.
This paper investigates the basis for social awareness; analysing naturalistic data to understand how people convey availability and capability to communicate in everyday interaction and how they use existing presence systems. The findings show that people in close personal relationships provide intermittent information about their activities and plans which are used to infer and negotiate future contact and communication decisions. The implications for more sophisticated cross-media communication systems are discussed.
Jones M, Frohlich DM (2008) Mobile ethics, ITNOW 50 (3)
Matt Jones and David Frohlich describe the innovative StoryBank project in a rural Indian Village.
Frohlich DM (2015) Fast Design, Slow Innovation - Audiophotography Ten Years On, pp. 1-231 Springer
As well as updating the manifesto for an audiophotography technology and practice, this book addresses issues in design history, the social shaping of technology and the management of innovation. In particular, it reveals the very different timescales over which design and innovation operate, and the way in which design ideas evolve across different research groups, companies and application areas.
The capture of photographs with sound is a simple idea, proposed 10 years ago, that
has still not become widespread. In this new edition of the seminal 2004 book on Audiophotography, the author asks ?Why?? A journey through the book?s citations and related commercial products shows considerable progress in understanding the role of sound in photography, and myriad design experiments to support audiovisual storytelling as a new media form. The book is a story in itself about the ?long nose of innovation?,
and a lesson about the need for patience and persistence in the computer industry. To reinforce this point five of the 2004 chapters are re-published in their original form. Theses describe invariant properties of ambient musical, talking and conversational photographs, and the possibility of playback from paper as well as screen.
Fast Design, Slow Innovation will be of interest to researchers and designers of new media systems and experiences, and to innovation scholars or managers looking for a ten year case study of innovation in action
A study was conducted on the exploration of possibilities of semiliterate communities using the camera as a new kind of pen and paper for creating and sharing audio-visual stories. Networking and power-management innovations and large-scale investment mean that even very remote rural locations are getting connected. But one cannot necessarily deeply in-built phone interfaces and applications for populations that do not have exposure to computing or the levels of textual literacy. The study suggests that phones and other technologies will continue to be shared resources rather than personal ones because of price sensitivity and the community orientation of life in developing communities. Western designers also should shift from a user-centered design approach to a 'community-centered design' approach, involving different elements of a community in the design of shared technology for community benefit.
Embodied interaction describes how meaning in interaction is created through engagement. With this approach as a source of inspiration for three exploratory design cases this paper explores the possibilities of embodied interaction in storing, retrieving and enriching everyday memories. Following the principles of designing for embodiment, all three design cases aim at cueing memories through visual modalities like photo and video. We discuss these case studies in light of the embodied interaction and memory theory. Our findings indicate that everyday remembering may be a suitable application area for combining it with embodied interaction, because of its abstract and personal nature. © 2011 ACM.
Spence J, Frohlich D, Andrews S (2013) Performative experience design: where autobiographical performance and human-computer interaction meet, Digital Creativity
This contribution identifies theories and practices specific to performance art for the purpose of describing a potentially fruitful area of exchange between non-representational performance and human-computer interaction (HCI). We identify three strands of current HCI research that are already working in this area of overlap, which we have termed 'performative experience design'. We then single out one of these strands, digitally augmented autobiographical performance, for further examination. Digitally augmented autobiographical performance draws on both autobiographical performance, which we see as rooted in performance and performance art, and media sharing, a field of research within HCI. Drawing on our experiences of designing a digital system for autobiographical performance, we offer a series of proposals for HCI research and applications of performative experience design. © 2013 Copyright Taylor and Francis Group, LLC.
Frohlich DM, Sarvas R (2011) HCI and innovation, ACM CHI Conference on Human Factors in Computing Systems pp. 713-728
Association for Computing Machinery, ACM Press
The user-centered design (UCD) process in HCI has
recently been criticized for not delivering breakthrough
innovations in technology. In this paper we consider
this critique through a literature review and two case
studies of innovation. Our conclusions suggest that
there is nothing wrong with the attitude of usercentered
design which has probably been present in all
major innovations down the centuries. Rather, the
practice of UCD in HCI lacks attention to business
factors and long term uptake of technology in society.
This compromises its impact on products and should be incorporated into the study of HCI itself.
Industry analysts currently disagree about the future of domestic computing. Some predict increasing sales of home PCs while others predict the break-up of the PC into a variety of information appliances. In this paper we report a study of home PC use which illuminates this issue from the perspective of existing PC-owning families. Eleven PC-owning families from the Boston area were interviewed at home about their current PC use, their attitudes to computers and the location of technology in their homes. We found that the general purpose nature of the home PC offers something for everybody in the household, and quickly becomes an established part of family life. Indeed, it was so popular in the households we visited that it had resulted in widespread competition for PC time, and had caused parents to worry about how best to control PC and internet access and influence. These behaviours and concerns led adults and children to express quite different preferences for relocating their computing experience around the house. However in both cases the needs were for better access to multifunctional extensions of the main PC. The implications of these findings for home PC and appliance evolution are discussed.
The paper reports the first study of the domestic soundscape and the ways in which it is used by British families. It culminates in a series of novel audio design ideas, which were also published in catalogue form and resulted in four granted patents owned by the University. The catalogue and patents are available as adjunct materials for this submission. The work was carried out in collaboration with Microsoft Research Cambridge who subsequently prototyped and tested several concepts
In the past few years a branch of sociology, conversation analysis, has begun to have a significant impact on the design of human*b1computer interaction (HCI). The investigation of human*b1human dialogue has emerged as a fruitful foundation for interactive system design.****This book includes eleven original chapters by leading researchers who are applying conversation analysis to HCI. The fundamentals of conversation analysis are outlined, a number of systems are described, and a critical view of their value for HCI is offered.****Computers and Conversation will be of interest to all concerned with HCI issues--from the advanced student to the professional computer scientist involved in the design and specification of interactive systems.
Social media products and services have the potential to address issues of social isolation in later life, when social contact often declines. However, issues of accessibility, functionality and control appear to deter the use of existing systems by some parts of the older population. In this paper, we describe a literature review and co-design exploration to understand and address these issues. Using a methodology we call Focusgroup+, we presented new product concepts to both digitally engaged and digitally unengaged groups of older people for critique and re-design. The concepts were based on familiar devices and included a Photo Phone concept for multimedia communication, a TV Talk concept for social TV, and a Twitter Well concept for broadcast text messaging. Findings from the re-design exercise show that groups responded differently to the same concepts based on their existing skills and equipment, and took them in different design directions to accommodate common preferences for meaningful communication with relatively small groups of key contacts. This led to a diversity of both appliances and apps that better reflected the diversity of participants themselves.
The possibility of linking paper to digital information is enhanced by recent developments in printed electronics. In this article we report the design and evaluation of a local newspaper augmented with capacitive touch regions and an embedded Bluetooth chip working with an adjunct device. These allowed the interactive playback of associated audio and the registration of manual voting actions on the web. Design conventions inherited from paper and the web were explored by showing four different versions of an interactive newspaper to 16 community residents. The diverse responses of residents are described, outlining the potential of the approach for local journalism and recommendations for the design of interactive newsprint.
The exponential growth of digital photo collections, combined with the legacy of printed photographs, is leading families to experience difficulties in remembering and finding photographs. Paradoxically this creates new opportunities for the re-discovery of forgotten images. This paper reports a new study in this area, based on interviews and creative activities with ten families in the south east of England. The study found that many triggers for photo re-use were either speculative or accidental, and led people to reinterpret the meaning of photographs in the light of subsequent experience and social discussion. This suggests a need to support serendipitous browsing of photographs and a more fluid and provisional approach to the semantic tagging of personal media.
Viewpoint is a public voting device developed to allow residents in a disadvantaged community to make their voices heard through a simple, lightweight interaction. This was intended to open a new channel of communication within the community and increase community members' perception of their own efficacy. Local elected officials and community groups were able to post questions on devices located in public spaces, where residents could vote for one of two responses. Question authors were subsequently required to post a response indicating any actions to be taken. Following a two-month trial, we present our experiences and contribute guidelines for the design of public democracy tools and dimensions impacting their effectiveness, including credibility, efficacy and format.
It has been 24 years since the publication of Wellner?s (1993)
digital desk, demonstrating the augmentation of paper
documents with projected information. Since then there have
been many related developments in computing; including the
world wide web, e-book readers, maturation of the augmented
reality paradigm, embedded and printed electronics, and the
internet of things. In this talk I draw on some of my own design
explorations of augmenting paper with sound over the years, to
illustrate the value of ?audiopaper? but also the way these
explorations were rooted in the applications and technology of
the day. I show that two key technologies have been important
to the implementation of audiopaper over the years, and that the
bigger opportunity is in connecting paper to the web. This
culminates in a vision for two future generations of paper which
communicate and interact with the digital devices around them
Collect Yourselves! is a technologically mediated system that opens up the transformational possibilities of performance to small groups of non-professionals sharing their own digital photos and the stories behind them. Remarkably, their performances achieve moments of emotional and aesthetic power, but these require the performers to take risks, make themselves vulnerable, and establish connections with their audiences. We discuss the framework and methodology of our interdisciplinary approach to designing these performances (Performative Experience Design), then contextualise our discussion within recent work on the subjective experience of risk in the performance literature, from both the performer?s point of view and the audience?s. Our experiences with Collect Yourselves! argue for risk as a necessary component for rewarding and potentially transformational experiences of intermedial autobiographical performance.
We introduce `PaperClip' - a novel digital pen interface for semantic editing of speech recordings for radio production. We explain how
we designed and developed our system, then present the results of a
contextual qualitative user study of eight professional radio producers that compared editing using PaperClip to a screen-based interface
and normal paper. As in many other paper-versus-screen studies, we
found no overall preferences but rather advantages and disadvantages
of both in different contexts. We discuss these relative benefits and
make recommendations for future development.
Radio production involves editing speech-based audio using tools
that represent sound using simple waveforms. Semantic speech editing systems allow users to edit audio using an automatically generated
transcript, which has the potential to improve the production workflow. To investigate this, we developed a semantic audio editor based
on a pilot study. Through a contextual qualitative study of five professional radio producers at the BBC, we examined the existing radio
production process and evaluated our semantic editor by using it to
create programmes that were later broadcast.
We observed that the participants in our study wrote detailed notes
about their recordings and used annotation to mark which parts they
wanted to use. They collaborated closely with the presenter of their
programme to structure the contents and write narrative elements.
Participants reported that they often work away from the office to
avoid distractions, and print transcripts so they can work away from
screens. They also emphasised that listening is an important part
of production, to ensure high sound quality. We found that semantic speech editing with automated speech recognition can be used to improve the radio production workflow, but that annotation, collaboration, portability and listening were not well supported by current
semantic speech editing systems. In this paper, we make recommendations on how future semantic speech editing systems can better
support the requirements of radio production.
It is now commonplace to capture and share images in photography as triggers for memory. In this paper we explore the possibility of using sound in the same sort of way, in a practice we call audiography. We report an initial design activity to create a system called Audio Memories comprising a ten second sound recorder, an intelligent archive for auto-classifying sound clips, and a multi-layered sound player for the social sharing of audio souvenirs around a table. The recorder and player components are essentially user experience probes that provide tangible interfaces for capturing and interacting with audio memory cues. We discuss our design decisions and process in creating these tools that harmonize user interaction and machine listening to evoke rich memories and conversations in an exploratory and open-ended way.
Digital stories are short personal films made up of a series of still images with voiceover, music and text. The technical barriers to creating such stories are falling with the use of mobile apps which make it easy to assemble story elements as audiophoto narratives on a smartphone or tablet. In this case study, we explored the potential of mobile digital storytelling in a care home context. It was used for four weeks as form of multimedia communication between formal and informal carers inside and outside the home, and a care home resident suffering from dementia. The home was located in São Carlos, Brazil as part of a larger international project called Time Matters (UK and Brazil), in which Time stands for ?This is me?. Fifteen digital stories were made by participants in the trial, which is about one for every visit of the researchers to the care home. Stories focused mainly on the resident; capturing aspects of everyday life discussed in Visit conversations (4), documenting Social events (3) inside or outside the home, recording Therapy sessions (3) with the resident or Health reports (3) by professional carers, and forming Media albums (2) of the residents? art or life. In general, the technology was most useful for facilitating richer conversations with the resident and other participants, and stimulating greater expressivity and creativity in the resident herself. The desire to document the resident?s current life and interests in the home for later reminiscence by their family, stands in contrast to conventional reminiscence therapy and related digital systems. These use media artefacts to stimulate reminiscence of residents? past life outside the home.
Jackson Philip, Plumbley Mark D, Wang Wenwu, Brookes Tim, Coleman Philip, Mason Russell, Frohlich David, Bonina Carla, Plans David (2017) Signal Processing, Psychoacoustic Engineering and Digital Worlds: Interdisciplinary Audio Research at the University of Surrey,
At the University of Surrey (Guildford, UK), we have brought together research groups in different disciplines, with a shared interest in audio, to work on a range of collaborative research projects. In the Centre for Vision, Speech and Signal Processing (CVSSP) we focus on technologies for machine perception of audio scenes; in the Institute of Sound Recording (IoSR) we focus on research into human perception of audio quality; the Digital World Research Centre (DWRC) focusses on the design of digital technologies; while the Centre for Digital Economy (CoDE) focusses on new business models enabled by digital technology. This interdisciplinary view, across different traditional academic departments and faculties, allows us to undertake projects which would be impossible for a single research group. In this poster we will present an overview of some of these interdisciplinary projects, including projects in spatial audio, sound scene and event analysis, and creative commons audio.
Marquez Reiter R., Frohlich D. (2019) A pragmatics of intimacy, In: Xie Chaoqun, Yus F., Haberland H. (eds.), Internet pragmatics. Theory and Practice.
John Benjamins Publishing Company
The use of mobile technologies appears to be in line with the strategic goals in education besides facilitating and promoting learning anywhere and anytime. However, despite the complete and advance mobile infrastructure in the developed world, the digital divide still exists in developing countries. This paper discussed the students? behaviour and responds towards digital devices and mobile learning through interview sessions held with the school administrator and teachers. The paper defines the various perceptions of the use of mobile technology for teaching and learning by reflecting the positive opinions from the school administrator and the teachers. The different perceptions and acceptance towards technology between the aboriginal and non-aboriginal students are also reviewed in this paper.
Frohlich David M., Corrigan-Kavanagh Emily, Bober Mirek, Yuan Haiyue, Sporea Radu, Le Borgne Brice, Scarles Caroline, Revill George, Van Duppen Jan, Brown Alan W., Beynon Megan (2019) The Cornwall a-book: An Augmented Travel Guide Using Next Generation Paper, The Journal of Electronic Publishing 22 (1)
Electronic publishing usually presents readers with book or e-book options for reading on paper or screen. In this paper, we introduce a third method of reading on paper-and-screen through the use of an augmented book (?a-book?) with printed hotlinks than can be viewed on a nearby smartphone or other device. Two experimental versions of an augmented guide to Cornwall are shown using either optically recognised pages or embedded electronics making the book sensitive to light and touch. We refer to these as second generation (2G) and third generation (3G) paper respectively. A common architectural framework, authoring workflow and interaction model is used for both technologies, enabling the creation of two future generations of augmented books with interactive features and content. In the travel domain we use these features creatively to illustrate the printed book with local multimedia and updatable web media, to point to the printed pages from the digital content, and to record personal and web media into the book.
Being socially connected is related to well-being, and one way of avoiding social isolation is to deepen existing
relationships. Even though existing relationships can be reinforced by regular and meaningful communication, state-of-the-art
communication technologies alone do not increase the quality of social connections. Thus, there is a need for the involvement of
a trained human facilitator in a network of older adults, preferably for a short period, to promote the deepening of their relationships.
This study aimed to evaluate the hypothesis that a human-facilitated, media-sharing social networking system can
improve social connection in a small group of older people, who are more vulnerable to social isolation than most, and deepen
their relationships over a period of a few weeks.
We conducted the design and evaluation of Media Parcels, a novel human-facilitated social networking system.
Media Parcels is based on the metaphor of a facilitator collecting and delivering parcels in the physical mail. Extending the
metaphor, the system supports a facilitator in designing time-based, dialogue requesting parcels from participants that bring out
their memories and feelings, in collecting the parcels, wrapping them in annotations that communicate the corresponding requests,
and delivering the wrapped parcel to a target person. Qualitative evaluation was carried out in 2 trials with a group of 3 people
each, one with family members (children and father; aged 55, 56, and 82 years old) and the other with a group of friends (aged
72, 72, and 74 years old), over 2 weeks. In each trial, data were collected in 3 interviews (pre-, mid-, and posttrial) and via system
Collected data indicate positive social effects for deepening and developing relationships. The parcel metaphor was
easily understood and the computational system was readily adopted. Preferences with regard to media production or consumption
varied among participants. In the family group, children preferred receiving media parcels (because of their sentimental value)
to producing them, whereas the father enjoyed both. In the friendship group, preferences varied: one enjoyed both producing and
receiving, while the other two preferred one over the other. In general, participants reported a preference for the production of
items of a certain type depending on the associated content. Apart from having a strong engagement with the system, participants
reported feeling closer to each other than usual.
For both groups, Media Parcels was effective in promoting media sharing and social connections, resulting in
deepening of existing relationships. Its design informs researchers who are attempting to promote social connection in older
In this paper we examine how the term ?Audio Augmented
Reality? (AAR) is used in the literature, and how the concept
is used in practice. In particular, AAR seems to refer
to a variety of closely related concepts. In order to gain a
deeper understanding of disparate work surrounding AAR,
we present a taxonomy of these concepts and highlight both
canonical examples in each category, as well as edge cases
that help define the category boundaries.