I. J. of Business & Management Research
Research Article | 
Short or Long Review? - Text Analytics and Machine Learning Approaches to Online Reputation
Author(s) : Xiangming Samuel Li
Publisher : FOREX Publication
Published : 10 February 2021
e-ISSN : 2347-4696
Page(s) : 28-40
Abstract
This paper first constructs a numerical text review score by applying text analytics and machine learning techniques to more than three million online text reviews collected from the Airbnb platform. Next, we employ the text review score to analyze the effect of review length on text review score and obtain insights on the interplay between the text review length and online reputation. The main contributions of this paper include: experimenting with advanced text analytics and machine learning approaches to assess online reputation; constructing an innovative text review score as a new online reputation measure; building a large knowledge-based review corpus with labels; and obtaining important insights about the effects of text review length on online reputation. Further, it has managerial and business implications for all internet platform markets and the sharing economy players seeking to build more effective online reputation systems.
Keywords: Internet platform , Sharing economy , Online trust and reputation systems, Text review score, Review length, Text analytics, AI, Machine learning, Machine learning.
Dr. Xiangming Samuel Li ,Department of Management Sciences, University of Waterloo, Ontario, Canada , Email: samuel.li@ucanwest.ca
AUTHOR’S BIOGRAPHY : Dr. Xiangming Samuel Li is a business professor at University Canada West and a PhD candidate in Management Sciences, University of Waterloo, Canada. He has received over 23 years of intensive management experiences in global ICT multinationals such as Nortel, Nokia, Motorola, Saveje, BTI, Anhub, and Linaro; and he is also actively engaging in academic research and teaching roles at University Canada West, University of Waterloo, University of Toronto, Hangzhou Dianzi University, and Zhejiang University of Technology. He holds an MBA degree from University of Toronto, a Master's degree of System Design Engineering from University of Waterloo, and a Bachelor' degree in Computer Sciences.
[1] G. Parker, M. Alstyne, S. Choudary (2016) Platform Revolution: How Networked Markets are Transforming the Economy and How to Make them Work for You. W.W. Norton & Company, Inc., New York, NY.
[2] A. Sundararajan (2016) The Sharing Economy: The End of Employment and the Rise of Crowd-based Capitalism. The MIT Press, Cambridge, MA.
[3] R. Wyonch (2017) Bits, bytes, taxes: VAT and the digital economy in Canada. C.D. Howe Inst. Commentary, 487, 1–28.
[4] M. Luca (2017) Designing online marketplaces: trust and reputation mechanisms. Innov. Pol. Econ. University of Chicago Press Journals, 17, 77–93.
[5] S. Tadelis (2016) Reputation and feedback systems in online platform market. Annu. Rev. Econ., 8, 321–340.
[6] C. Dellarocas (2003) The digitization of word of mouth: promise and challenges of online feedback mechanisms. Manage. Sci., 49 (10), 1407–1424.
[7] A. Fradkin, E. Grewal, D. Holtz (2018) The determinants of online review informativeness: evidence from field experiments on Airbnb. SSRN Electron. J.
[8] G. Zervas, D. Proserpio, J (2017) Byers, The rise of the sharing economy: estimating the impact of Airbnb on the hotel industry. J. Market. Res., 54 (5), 687–705.
[9] P. Racherla, D. Connolly, N Christodoulidou (2013) What determines consumers’ ratings of Service providers? an exploratory study of online traveler reviews. J. Hosp. Market. Manag., 22 (2), 135–161.
[10] P.A. Pavlou, A. Dimoka (2006) The nature and role of feedback text comments in online marketplaces: implications for trust building, price premiums, and seller differentiation. Info. Syst. Res., 17 (4), 392–414.
[11] G. Bolton, B. Greiner, A. Ockenfels (2013) Engineering trust: reciprocity in the production of reputation information. Manage. Sci., 59 (2), 265–285.
[12] T. Hennig-Thurau, K. Gwinner, G. Walsh (2004) Electronic word-of-mouth via consumer-opinion platforms: what motivates consumers to articulate themselves on the internet? J. Interact. Market., 18 (2), 51–47.
[13] R. King, P. Racherla, V. Bush (2014) What we know and don’t know about online word-of-mouth: a review and synthesis of the literature, J. Interact. Market., 28 (3), 167–183.
[14] I. Cabral. A. Hortacsu (2016) The dynamics of seller reputation: evidence from eBay. J. Ind. Econ., 58 (1), 54–78.
[15] J.A. Chevalier, D Mayzlin (2006) The effect of word of mouth on sales: Online book reviews. J. Market. Res., 43 (3), 345–354.
[16] W. Jabr, Z Zheng (2014) Know yourself and know your enemy: an analysis of firm recommendations and consumer reviews in a competitive environment. MIS Quart., 38 (3), 635–U423.
[17] P. Resnick, R. Zeckhauser (2002) Trust among strangers in internet transactions: empirical analysis of eBay’s reputation system. Econ. Internet E-Commer., 11, 127–157.
[18] Q. Ye, M. Xu, M. Kiang, W. Wu, F. Sun (2013) In-depth analysis reputation and price premium relationship: a comparison between eBay US and Taobao China. J. Electron. Commer. Res., 14 (1), 1–10.
[19] A. Filippas, J. Horton, J. Golden (2018) Reputation Inflation, Proce. 2018 ACM Conf. Econ. Comput., Pages 483–484.
[20] D. Proserpio, W. Xu, G. Zervas (2018) You get what you give: theory and evidence of reciprocity in the sharing economy. Quant. Market. Econ., 16 (4), 371–407.
[21] N. Hu, P. Pavlou, J. Zhang (2017) On self-selection biases in online product reviews. MIS Quart, 41 (2), 449–471.
[22] S.M. Mudambi, D. Schuff, What makes a helpful online review? a study of consumer reviews on Amazon.com, MIS Quart. 34 (1) (2010) 185–200.
[23] N. Hu, N. Koh, S. Reddy (2014) Ratings lead you to the product, reviews help you clinch it? The mediating role of online review sentiments on product sales. Decis. Support Syst., 57, 42–53.
[24] N. Archak, A. Ghose, PG. Ipeirotis (2011) Deriving the pricing power of product features by mining consumer reviews. Manag. Sci., 57 (8), 1485–1509.
[25] S. Eslami, M. Ghasemaghaei, K. Hassanein (2018) Which online reviews do consumers find most helpful? A multi-method investigation. Decis. Support Syst., 113, 32–42.
[26] J. Otterbacher (2009) Helpfulness in Online Communities: A Measure of Message Quality, Chi2009: Proce. 27th Annu. Chi Conf. Hum. Fact. Comp. Syst., 1 (4), 955–964.
[27] P. Chen, Y. Hong, Y. Liu (2018) The value of multidimensional rating systems: evidence from a natural experiment and randomized experiments. Manag. Sci., 64 (10), 4629–4647.
[28] N. Hu, P. Pavlou, J. Zhang (2017) On self-selection biases in online product reviews. MIS Quart., 41 (2), 449–471.
[29] S. Moon, Y. Park, Y. Kim (2014) The impact of text product reviews on sales. Euro. J. Market., 48 (11-12), 2176–2197.
[30] B. Liu (2012) Sentiment Analysis and Opinion Mining, Morgan & Claypool Publishers.
[31] B.Q. Liu, E. Karahanna (2017) The dark side of reviews: the swaying effects of online product reviews on attribute preference construction, MIS Quart., 41 (2), 427–448.
[32] E. Teso, M. Olmedilla, M. Martínez, S. Toral (2018) Application of text mining techniques to the analysis of discourse in eWOM communications from a gender perspective. Technol. Forecast. Soc., 129, 131–142.
[33] D. Masterov, U. Mayer, S. Tadelis (2015) Canary in the e-commerce coal mine: detecting and predicting poor experiences using buyer-to-seller messages. In: Proce. of the Sixteenth ACM Conference on Econ. Comput. EC ’15, New York ACM, pp. 81–93.
[34] Q. Wahab, J. Bentahar, H. Qtrok, A. Moural (2015) A survey on trust and reputation models for Web services: single, composite, and communities. Decis. Support Syst., 74, 121–134.
[35] P. Domingos (2015) The Master Algorithm: How the quest for the ultimate learning machine will remake our word, ISBN-10:0465094279, Basic Books.
[36] P. Tan, M. Steinbach, V. Kumar (2013) Introduction to data mining, Addison Wesley.
[37] M. Taboada, J. Brooke, M. Tofiloski, K. Voll (2011) Lexicon-based methods for sentiment analysis. Comput. Linguist., 37 (2), 267–307.
[38] M. Salehan, D. Kim (2016) Predicting the performance of online consumer reviews: A sentiment mining approach to big data analytics. Decis. Support Syst., 81, 30-40.
[39] Q. Gan, B. Ferns, Y. Yu (2017) A text mining and multidimensional sentiment analysis of online restaurant reviews. J. Qual. Assurance Hosp. Tour., 18 (4), 465–492.
[40] J. Jin, Y. Liu, P. Ji (2019) Review on recent advances in information mining from big consumer opinion data for product design. J. Comp. Info. Sci. En., 19 (1), Article: 010801.
[41] I. Witten, E. Frank, M. Hall, C. Pal (2016) Data Mining: Practical Machine learning Tools and Techniques, Morgan Kaufmann Publishers, San Francisco, CA, ISBN: 0-12-088407-0.
[42] O. Tsur, A. Rappoport (2009) A fully unsupervised algorithm for selecting the most helpful book reviews. Proce. Third International ICWSM Conf. 154–161.
[43] A. Ghose, P. Ipeirotis (2011) Estimating the helpfulness and economic impact of product reviews: mining text and reviewer. IEEE T. Knowl. Data En., 23 (10), 1498–1512.
[44] O. Netzer, R. Feldman, J. Goldenberg, M. Fresko (2012) Mine your own business: market-structure surveillance through text mining. Market. Sci., 31 (3), 521–643.
[45] R. Piryani, D. Madhavi, V. Singh (2017) Analytical mapping of opinion mining and sentiment analysis research during 2000-2015.Inform. Process. Manag., 53 (1), 122–150.
[46] D. Das, M. Chen (2007) Yahoo! for Amazon: sentiment extraction from small talk on the web. Manage. Sci., 53 (9), 1375–1388.
[47] R. Rivas, N. Montazeri, N. Le (2018) Automatic classification of online doctor reviews: evaluation of text classifier algorithms. J. Med. Internet Res., 20 (11) e11141.
[48] C. Hutto, E. Gilbert (2014) VADER: a parsimonious rule-based model for sentiment analysis of social media text, Proce. Eighth International AAAI Conf. Weblogs Soc. Media. Association for the Advancement of Artificial Intelligence.
[49] M. Luca, G. Zervas (2016) Fake it till you make it: reputation, competition, and Yelp review fraud. Manage. Sci., 62 (12).
[50] T. Ikkala, A. Lampinen (2015) Monetizing network hospitality: hospitality and sociability in the context of Airbnb, Proce. CSCW ‘15 Proce. 18th ACM Conf. Comp. Supported Cooperative Work Soc. Comput., 1033–1044.
[51] I. Ladegaad (2018) Hosting the comfortably exotic: cosmopolitan aspirations in the sharing economy. Socio. Rev., 66 (2), 381–400.
[52] M. Hu, B. Liu (2004) Mining opinion features in customer reviews. Am. Assoc. Artif. Int. 4, 755–760.
[53] B. Kumar, V. Ravi (2016) A survey of the applications of text mining in financial domain. Knowl-Based Sys. 114, 128–147.
[54] F. Ribeiro, M. Araujo, P. Goncalves (2010) A benchmark comparison of state-of-the-practice sentiment analysis methods, ACM Trans. Embedded Comput. Syst., 9 (4), 39.
[55] T. Nguyen, H. Meng, S. Sandeepe (2018) Twitter-derived measures of sentiment towards minorities and associations with low birth weight and preterm birth in the United States. Comp. Hum. Behav., 89, 308–315.
[56] S. Baccianella, A. Esuli, F. Sebastiani (2010) SENTIWORDNET 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. 7th Internat. Conf. Lang. Res. Eval. (LREC), Valletta, Malta, 17–23.
[57] C. Cortes, V. Vapnik (1995) Support-vector networks, Mach. Learn. 20, 273–297.
[58] I. Vessey, D. Galletta (1991) Cognitive fit: an empirical study of information acquisition. Info. Sys. Res. 2 (1), 63–84.
[59] N. Korfiatis, E. Garcia-Bariocanal, S. Sanchez-Alonso (2012) Evaluating content quality and helpfulness of online product reviews: The interplay of review helpfulness vs. review content. Electron. Commer. Res. App., 11 (3), 205–217.
[60] B. Stringam, J. Gerdes (2010) An analysis of word-of-mouth ratings and guest comments of online hotel distribution sites. J. Hosp. Market. Manage. 19 (7), 773–796.
[61] N. Naveed, T. Gottron, S. Staab (2013) Feature sentiment diversification of user generated reviews: the FREuD approach. Proce. 7th AAAI Conf.
[62] Z Jiang, I. Benbasat (2007) Investigating the influence of the functional mechanisms of online product presentations. Info. Sys. Res. 18 (4), 454–470.
[63] B. Rime, C. Finkenauer, O. Luminet, E. Zech, P. Philippot (1998) Social sharing of emotion: new evidence and new questions, Eur. Rev. Soc. Psychol. 9 (1), 145–189.
[64] B. Rime (2009) Emotion elicits the social sharing of emotion: theory and empirical review. Emot. Rev. 1(1), 60–85.
[65] M. Zeelenberg, R. Pieters (2004) Beyond valence in customer dissatisfaction: a review and new findings on behavioral responses to regret and disappointment in failed services. J. Busi. Res. 57 (4), 445-455.
[66] T. Verhagen, A. Nauta, F. Feldberg (2013) Negative online word-of-mouth: Behavioral indicators or emotion release? Computers Hum. Behav. 29 (4), 1430–1440.
[67] M. Ghasemaghaei, S. Eslami, K. Deal et al. (2018) Reviews’ length and sentiment as correlates of online reviews’ ratings. Internet Res., 28 (3), 544–563.
[68] D. Godes, J.C. Silva (2012) Sequential and temporal dynamics of online opinion. Market. Sci. 31 (3), 448–473.
[69] C. Forman, A. Ghose, B. Wiesenfeld (2008) Examining the relationship between reviews and sales: The role of reviewer identity disclosure in e-markets. Info. Sys. Res., 19 (3) 291–313.
[70] A. Schlosser (2005) Source perceptions and the persuasiveness of Internet word-of-mouth communication, Proce. Advances Consum. Res. Provo, UT: Association for Consumer Research, 202–203.
[71] A.C. Cameron, P.K. Trivedi (2003) Microeconometrics: Methods and Applications, New York, NY: Cambridge University Press.
Xiangming Samuel Li (2021), Short or Long Review? - Text Analytics and Machine Learning Approaches to Online Reputation. IJBMR 9(1), 28-40. DOI: 10.37391/IJBMR.090105.