Affective-Interaction Design Framework for Unexpected Materiality in Art Objects

Thesis Abstract

This study investigates how affective responses and interactional engagement can be designed to reveal unexpected materiality in contemporary art objects, addressing a gap where tactile, perceptual, and emotional dimensions of materiality are inadequately supported by conventional display and interaction paradigms. The problem centers on the dissociation between viewers’ affective entrainment and the emergent properties of non-traditional materials (e.g., biodegradable polymers, responsive textiles, digitally augmented substrates) that challenge conventional aesthetics and interpretive frameworks. The aim is to develop and validate an affective-interaction design framework that orchestrates sensory, kinesthetic, and contextual cues to elicit intentional and reflective encounters with material novelty. Specific objectives include (1) delineating how material surprise modulates viewer affect and cognitive appraisal; (2) identifying interaction modalities that consistently amplify material-logic awareness across diverse audiences; (3) constructing a design framework comprising sensory prompts, affordance cues, and narrative scaffolds; and (4) evaluating framework effectiveness through iterative prototyping in gallery settings. The methodology adopts a mixed-methods research design comprising three phases. Phase 1 employs a purposive sample of 120 participants drawn from visiting publics at three contemporary art venues and 20 professional artists/curators, stratified by age, gender, and cultural background. Phase 2 implements a controlled experiment with 60 participants exposed to three interaction conditions (haptic focus, visual-kinesthetic augmentation, and multisensory integration) using artworks featuring unexpected materiality. Instruments include a standardized Affect Grid, the Self-Assessment Manikin (SAM), and a bespoke Material Surprise Intensity scale (MSI) validated through a pilot with 30 participants. Data collection in Phase 2 combines biometric measures (skin conductance, heart-rate variability) and behavioral analytics (eye-tracking metrics, dwell time) with post-experience semi-structured interviews. Phase 3 synthesizes insights from design studios with 10 semi-structured interviews of artists and curators, applying thematic analysis to distill design principles, culminating in a formalized framework. Analytical procedures couple quantitative and qualitative approaches. Regression analyses examine the relationship between MSI scores, affective responses, and engagement metrics, controlling for prior art knowledge. ANOVA tests compare interaction conditions on perceived material surprise and aesthetic appreciation. Multivariate path analysis explores how specific design cues influence affective trajectories and interpretive outcomes. Thematic analysis of interview data identifies recurrent patterns in designers’ intents, material affordances, and audience reception, with triangulation across data sources enhancing validity. The integration phase employs a design-research workshop to translate findings into a provisional framework comprising (a) cue architecture for material revelation, (b) interaction modalities aligned with audience variegation, (c) narrative scaffolding to anchor interpretive contexts, and (d) evaluative criteria for gallery deployment. Expected findings indicate that carefully calibrated multisensory and haptic cues significantly elevate affective engagement and enhance recognition of material properties that diverge from conventional expectations, with specific cues (texture irregularity, density contrast, responsive feedback latency) disproportionately shaping surprise and cognitive appraisal. The study anticipates that visual-kinesthetic augmentation more reliably sustains attention and interpretive elaboration than purely visual or tactile conditions, particularly when embedded within a coherent narrative scaffold. The contribution to knowledge lies in a transferable theoretical framework—the Affective-Interaction Framework for Materiality (AIFM)—that integrates affective computing, phenomenology of materiality, and interaction design to operationalize how artworks communicate unconventional substrates. Methodologically, the study advances mixed-methods validation of design frameworks in arts contexts and offers a replicable protocol for evaluating audience experiences with non-traditional materials. The main conclusion posits that audience engagement with unexpected materiality emerges from orchestrated multisensory cues, reflective narration, and responsive interaction, rather than material novelty alone. Recommendations include adopting the AIFM in curatorial practice and gallery design to foreground affective pathways, training for exhibition designers in multimodal scripting, and further research into cross-cultural differences in material perception. The study also suggests extending the framework to digital-physical hybrids and exploring long-term perceptual learning effects across repeated encounters with material surprises.