9,261 Hits in 2.3 sec

"Te:mos o serra cura::do, temos o ni:sa, temos o serpa do:p." Suggesting products to buy, shaping materiality and multisensoriality in shop encounters

Lorenza Mondada
2021 Calidoscópio  
in shop encounters, and involving the showing and listing of available products.  ...  Keywords: Social Interaction; Shop Encounters; Multimodality and Multisensoriality.  ...  The multimodal annotations of the data and their analyses have been developed by myself, within the same project and the next one, From multimodality to multisensoriality: Language, Body, and Sensoriality  ... 
doi:10.4013/cld.2021.192.08 fatcat:rpajbpjuwbhf3gaglhjs3g54ye

Images Don't Lie: Transferring Deep Visual Semantic Features to Large-Scale Multimodal Learning to Rank [article]

Corey Lynch, Kamelia Aryafar, Josh Attenberg
2015 arXiv   pre-print
In a large scale experiment using data from the online marketplace Etsy, we verify that moving to a multimodal representation significantly improves ranking quality.  ...  In this paper, we introduce a multimodal learning to rank model that combines these traditional features with visual semantic features transferred from a deep convolutional neural network.  ...  Given a listing document d i consisting of the title and tag words, a numerical listing id, a numerical shop id, and a listing image, we obtain a multimodal feature vector d M Mi by embedding traditional  ... 
arXiv:1511.06746v1 fatcat:dhwzfckyb5e67f7qxmzsty7tee


Patrick Ehlen, Michael Johnston
2010 International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction on - ICMI-MLMI '10  
., "bike repair shops near the golden gate bridge") users can combine speech and gesture. For example, "gas stations" + will return the gas stations along the specified route traced on the display.  ...  We provide interactive demonstrations of Speak4it on both the iPhone and iPad platforms and explain the underlying multimodal architecture and challenges of supporting multimodal interaction as a deployed  ...  For example, in Figure 1 (Left), the user pressed the 'Push to Speak' button and said "coffee shops."  ... 
doi:10.1145/1891903.1891917 dblp:conf/icmi/EhlenJ10 fatcat:ezrjjiya5vbgvcwms2mhwiplji

Model-based design of multimodal interaction for augmented reality web applications

Sebastian Feuerstack, Állan C. M. de Oliveira, Mauro dos Santos Anjo, Regina B. Araujo, Ednaldo B. Pizzolato
2015 Proceedings of the 20th International Conference on 3D Web Technology - Web3D '15  
To validate our approach, we demonstrate how a reality spanning Drag-and-Drop interaction can be modeled for an online furniture shop.  ...  Although efforts have been made to overcome these limitations, there is a clear gap between authoring environments and source code level framework approaches for creating AR interfaces for the web with multimodal  ...  As soon as the user picks up an item of the shopping list and crosses the dashed line of the shopping cart (figure 3), the online shop website site is removed from the web interface and automatically replaced  ... 
doi:10.1145/2775292.2775293 dblp:conf/vrml/FeuerstackOAAP15 fatcat:mk25fduedbdr3j3yeu7jyi37jm

SFU-Store-Nav: A Multimodal Dataset for Indoor Human Navigation [article]

Zhitian Zhang, Jimin Rhim, Taher Ahmadi, Kefan Yang, Angelica Lim, Mo Chen
2020 arXiv   pre-print
The experiment simulates a shopping scenario where human participants come in to pick up items from his/her shopping list and interact with a Pepper robot that is programmed to help the human participant  ...  The participants were provided with 4 to 8 different shopping lists and were asked to find all the items on the provided list.  ...  -This participant will repeat the study tasks, with a different shopping list, as an "oldcomer" who is familiar with the store environment. • Two-participants trial: Two participants conduct study tasks  ... 
arXiv:2010.14802v1 fatcat:ti65pv46hjalrnc5nc4syf6pmq

Towards a More Informed Multimodal Travel Shopping

Mario Scrocca, Marco Comerio, Damiano Scandolari, Irene Celino
2021 Zenodo  
This paper reports the work done for the conceptualization of offer categories and proposes a solution for enabling their usage in multimodal travel shopping.  ...  shopping flow.  ...  Fig. 1 : 1 Fig. 1: Offer Categories in the Travel Shopping process.  ... 
doi:10.5281/zenodo.6397574 fatcat:xuzls7s6mvh3bjwte4zxix6tpi

Situated and Interactive Multimodal Conversations [article]

Seungwhan Moon, Satwik Kottur, Paul A. Crook, Ankita De, Shivani Poddar, Theodore Levin, David Whitney, Daniel Difranco, Ahmad Beirami, Eunjoon Cho, Rajen Subba, Alborz Geramifard
2020 arXiv   pre-print
We provide two SIMMC datasets totalling ~13K human-human dialogs (~169K utterances) using a multimodal Wizard-of-Oz (WoZ) setup, on two shopping domains: (a) furniture (grounded in a shared virtual environment  ...  We introduce Situated Interactive MultiModal Conversations (SIMMC) as a new direction aimed at training agents that take multimodal actions grounded in a co-evolving multimodal input context in addition  ...  Only Activities with additional attributes are listed below. D API Call List Tab. 8 shows the list of all APIs supported in our SIMMC datasets.  ... 
arXiv:2006.01460v2 fatcat:yfijtft2v5hjjkwg5nv6wvwcey

Speak4IT: Multimodal interaction in the wild

Michael Johnston, Patrick Ehlen
2010 2010 IEEE Spoken Language Technology Workshop  
., "bike repair shops near the Golden Gate Bridge") users can combine speech and gesture. For example, "gas stations" + will return the gas stations along the specified route traced on the display.  ...  We provide interactive demonstrations of Speak4it on both the iPhone and iPad platforms and explain the underlying multimodal architecture and challenges of supporting true multimodal interaction in a  ...  The results can also be viewed as a spin-able text list (Figure 1 , Right) or in a 'radar' view.  ... 
doi:10.1109/slt.2010.5700840 dblp:conf/slt/JohnstonE10 fatcat:yyxsqhcepnb6jcycxy36637lsq

Multimodal Message Incongruence on E-Commerce Websites

Jungsil Choi, Kiljae K. Lee
2015 Americas Conference on Information Systems  
Experiment 1-1 Stimuli and Procedure For experiment 1-1, we designed two types of online shopping listings for imported toothbrush, Mentadent ProCare Toothbrush.  ...  On the margin of the top and right side the listing is a mark written as "six pack." We used this original listing for one stimulus, and created another listing by modifying the number of figures.  ...  Appendix 1 Pilot test listing images Multimodal Message Incongruence on E-Commerce Websites Twenty-first Americas Conference on Information Systems, Puerto Rico, 2015  ... 
dblp:conf/amcis/ChoiL15 fatcat:7duvruymqzdyriffwyiazq5ffi

Integrating Intra and Extra Gestures into a Mobile and Multimodal Shopping Assistant [chapter]

Rainer Wasinger, Antonio Krüger, Oliver Jacobs
2005 Lecture Notes in Computer Science  
In this paper we describe a user interface that integrates multimodal input on a handheld device with external gestures performed with real world artifacts.  ...  We also discuss the underlying components required in handling these extended multimodal interactions and present an implementation of our ideas in a demonstrator called the Mobile ShopAssist.  ...  N-best result lists and their associated confidence values play an essential role in the disambiguation of multimodal input [11] .  ... 
doi:10.1007/11428572_18 fatcat:geugs3ccjzdnddvsvujd5tnf2a

Innovative Retail Laboratory — Investigating Future Shopping TechnologiesInnovative Retail Laboratory — Erforschung von Technologien für das Einkaufen von morgen

Antonio Krüger, Lübomira Spassova, Ralf Jung
2010 it - Information Technology  
The range varies from personalized shopping assistants to "talking" products and intelligent shopping carts, which plan and show the way through the store according to your shopping list.  ...  The relation between the store and its customers begins way before the shopping trip itself takes place.  ...  an appropriate shopping list for his next shopping tour.  ... 
doi:10.1524/itit.2010.0580 fatcat:ghwzzv3kcjdkplqelnc2dgeyie

Losing Its Touch: Understanding User Perception of Multimodal Interaction and Smart Assistance

Margarita Esau, Veronika Krauß, Dennis Lawo, Gunnar Stevens
2022 Designing Interactive Systems Conference  
So far, it is unclear how the potential of a multimodal experience is realized by designers and appropriated by users.  ...  , which is also a smartphone shopping list app, the corresponding shopping list feature of REWE's application, and Amazon's own feature.  ...  Finally, for organizing shopping lists, we used the skill Bring!  ... 
doi:10.1145/3532106.3533455 fatcat:d44pdzyb4rb6jk7mrnvay7dmxy

Novel Functional Technologies for Age-Friendly E-commerce [chapter]

Xiaohai Tian, Lei Meng, Siyuan Liu, Zhiqi Shen, Eng-Siong Chng, Cyril Leung, Frank Guan, Chunyan Miao
2017 Lecture Notes in Computer Science  
In this paper, we present an age-friendly E-commerce system with novel assistive functional technologies, aiming at providing a comfortable online shopping environment for the elderly.  ...  First, to improve the searching experience, we design a multimodal product search function, which accepts image, speech, text and the combination of them as inputs to help the elderly find products easily  ...  In [12] , we also designed three agefriendly functions, crowd-improved speech recognition, multimodal search and personalized speech feedback, to improve the elderly's online shopping experience.  ... 
doi:10.1007/978-3-319-58536-9_13 fatcat:rbyze7tqdfgb7gqqnhullkwmpa

IT2Rail: Information Technologies for Shift to Rail

Stefanos Gogos, Xavier Letellier
2016 Transportation Research Procedia  
(shopping, ticketing, and tracking) through its travel-companion.  ...  services for planning, one-stop-shop ticketing, and real-time re-accommodation.  ...  The final objective is to allow the Traveler to access all multimodal services (shopping, booking, ticketing and tracking) with special attention to mobility constraints.  ... 
doi:10.1016/j.trpro.2016.05.265 fatcat:5zhol7b675hvhezlr6gyysvasa

Attract me to Buy: Advertisement Copywriting Generation with Multimodal Multi-structured Information [article]

Zhipeng Zhang, Xinglin Hou, Kai Niu, Zhongzhen Huang, Tiezheng Ge, Yuning Jiang, Qi Wu, Peng Wang
2022 arXiv   pre-print
Recently, online shopping has gradually become a common way of shopping for people all over the world. Wonderful merchandise advertisements often attract more people to buy.  ...  These advertisements properly integrate multimodal multi-structured information of commodities, such as visual spatial information and fine-grained structure information.  ...  INTRODUCTION Nowadays, online shopping has become one of the main ways for people to shop, such as Taobao, Amazon. The product advertisement is often an important factor in people's shopping.  ... 
arXiv:2205.03534v1 fatcat:t5gq3buvn5hdrmu5z5f3u6cwyi
« Previous Showing results 1 — 15 out of 9,261 results