AI/ML Multimodal Methods for Video Data Analytics
Prof. Xueming Luo
Charles Gilliland Distinguished Chair Professor of Marketing
Professor of Strategic Management | Professor of Management Information Systems
Fox School of Business | Temple University
Video data, comprising interdependent text, image, and audio modalities that collectively characterize the same source, offer a wealth of information for business researchers. However, the challenge is to how to comprehensively account for within- and between-modality interdependencies, when highlighting the vital role of both verbal and nonverbal cues embedded in video data. My talk tackles this challenge by automating video data analytics with advanced deep learning transformers, multimodal data fusion, and explainable Artificial Intelligence (XAI) methods. Through empirical demonstrations of measuring emotion dynamics in entrepreneur pitches and trustworthiness of sellers in live streaming commerce on Tik Tok, we underline the crucial role of interpersonal interactions in the success of startups and microenterprises. By bridging business research with cutting-edge computational AI/ML techniques, we provide practitioners with actionable strategies for enhancing communication effectiveness and fostering trust-based business relationships. We provide access to our data and algorithms to research that leverages video datasets in other contexts.
Xueming Luo is the Charles Gilliland Distinguished Chair Professor of Marketing, Professor of Strategy, and Professor of MIS, and Founder/ Director of the Global Institute for Artificial Intelligence & Business Analytics in the Fox School of Business at Temple University. Xueming’s research is quantitative in nature, and he is an interdisciplinary thought-leader in leveraging AI/ML algorithms, text/audio/image/video big data, econometrical methods, and field experiments to model, explain, and optimize digital marketing, customer analytics, mobile commerce, company strategies, platform economy, social media analytics, and social responsibility. Within marketing, he has been ranked as top 9th worldwide (1st among all Chinese) regarding Author Productivity in the Premier Marketing Journals (JCR, JM, JMR, MKSC) during 2014-2023. Outside of marketing, his research has been featured by premier journals in Information Systems (ISR and MISQ), management, Strategy, and OM (MgSc, POM, SMJ, AMJ). https://www.fox.temple.edu/directory/xueming-luo-tuf35198
This is a joint seminar organized by HKU Business School’s IIM Area and Institute of Digital Economy & Innovation (IDEI).
