Forecasting Online Game Addictiveness

Jing-Kai Lou12 , Kuan-Ta Chen2 , Hwai-Jung Hsu2 , and Chin-Laung Lei1

of Electrical Engineering, National Taiwan University of Information Science, Academia Sinica

AbstractOnline gaming has now become an extremely competitive business. As there are so many game titles released every month, gamers have become more difcult to please and ckle in their allegiances. Therefore, it would be benecial if we could forecast how addictive a game is before publishing it on the market. With the capability of game addictiveness forecasting, developers will be able to continuously adjust the game design and publishers will be able to assess the potential market value of a game in its early development stages. In this paper, we propose to forecast a games addictiveness based on players emotional responses when they are rst exploring the game. Based on the account activity traces of 11 commercial games, we develop a forecasting model that predicts a games addictiveness index according to electromyographic measures of players two facial muscles. We hope that with our methodology, the game industry could optimize the odds of successful investments and target more accurately the provision of a better entertaining experience. Keywords-Addiction, Affective Computing, Electromyography, Facial EMG, Psychology, Quality of Experience

(a) Corugattor supercilli muscle

(b) Zygomaticus major muscle

Fig. 1: Common facial muscle groups used for emotion measurements. Figure courtesy of Wikipedia (http://en.wikipedia. org/wiki/Facial electromyography). a game is primarily dependent on the game design and content. Players stay in a game if they can continuously have fun in the game, which is decided collectively by a myriad of factors. Some of the factors are measurable, such as the game server and software reliability, frequency of lags [2], and number of cheating incidents [3], while others are unmeasurable, such as the artistic design, sense of achievement provided [4, 5], and even in-game atmosphere created by the combination of all the visual and audible elements [6]. To clarify further discussion, we dene the capability that a game retains players once they join the game as the addictiveness of the game, as it quanties how probable the game can make a player addicted to it. Challenge. To evaluate an online games addictiveness before introducing it to the market is extremely difcult. In the industry, the state-of-practice approach is to base this assessment on designers intuition, experience, and the feedback from a focus group, which tends to be limited and biased. And whereas psychologically inspired methods, such as [7, 8], have been proposed, such approaches involve signicant subjective evaluations and require further support with objective evidence. Conjecture. Intuitively, players prefer entertaining games rather than boring ones [9, 10]. During gameplay, a gamer experiences a variety of emotions, such as joy, tension, excitement, which may be represented as the degree of entertainment he perceives. This intuition leads us to ask: Is the emotion a gamer arises when playing a game associated to the games addictiveness? Proposal. In psychophysiology, biological signals such as the heart rate, blood pressure, and electrical potentials of muscles can be used to estimate the emotional and mental states of human beings. We nd that the facial electromyography (EMG) approach [11], which measures the activity of certain facial muscles, is particularly useful for inferring players

I. I NTRODUCTION Online gaming is one of the most popular cyber entertainment activities in the world. Millions of people are addicted to virtual worlds rendered by online games, and billions of dollars of business are generated from such actitivties1 . There are seemingly countless game development venders competing in this market segment who continuously invest in the development of games with more fun gameplay and more attractive storylines. As an inevitable consequence, online gaming has now become extremely competitive with so many game titles released every month that compete for attention and loyalty of increasingly ckle customer-players. It is not uncommon that a game developed over several years may in the end only be popular for a few months after its release, and then quickly forgotten with its players moving on to newer game titles, long before the games investment could ever be paid off. In general, game publishers prot from an online game from two major sources: subscription fees (usually a at monthly fee) and virtual item sells [1]. Since an online games revenue is associated with the size of its player population, how to attract and retain players to a game are among the most important challenges to game publishers. To attract new players to a game involves various non-technical or even non-game factors, such as the marketing strategies, release timing (e.g., a summer vacation launch), and cultural references (e.g., Oriental or Occidental). On the other hand, to retain players after they join
Corresponding

author. http://www.

Graphs MMO Revenues. gamesindustry.com/about-newzoo/todaysgamers graphs MMO

1 GamesIndustry.com

emotions during gameplay [12]. We use the EMG potentials measured at 1) the corrugator supercilii muscle, which is located at the medial end of the eyebrow and beneath the forehead, and 2) the zygomaticus major muscle, which starts at the cheekbone and extends to the corners of the mouth, as illustrated in Figure 1. The EMG potentials measured at these two muscle groups are known to be associated with humans positive and negative emotions, respectively [11, 12]. We will employ the facial EMG approach to assess players emotions and investigate if the emotions during gameplay can be an indicator of a games addictiveness. Contribution. In this paper, we propose to forecast a games addictiveness based on players emotional responses when they are rst exploring the game. To verify our proposal, we rst quantify the addictiveness of 11 real-life games based on their account usage traces, conduct a user study which involves 84 subjects and 155 hours of emotion traces, and then analyze whether the games addictiveness is predictable based on the players emotions during gameplay. Our results indicate that such forecasting is feasible. More specically, our prediction model can forecast a games addictiveness with a reasonable accuracy given the positive and negative emotion measures from a small focus group. Our contributions in this paper are two-fold: 1) We propose an addictiveness index to quantify how addictive a game is. The index is independent of a games population and usage patterns, and thus generally applicable to all types of games. 2) We develop a regression model that takes the facial EMG measurements of players as the input and outputs for the addictiveness of a game. The remainder of this paper is organized as follows. Section II provides a review of related works, and then we discuss how to quantify a games addictiveness based on its account activity records in Section III. Next, we present our methodology for measuring the players emotions that arise during gameplay in Section IV. In Section V, we develop a model that predicts a games addictiveness based on facial EMG measure. Finally, we conclude this paper in Section VI. II. R ELATED WORKS A. Game Play Behavior Analysis Lee et al. collected a dataset which comprises the activity of 91,065 World of Warcraft avatars, where the trace included the avatars game play times and a number of attributes, such as their race, profession, current level, and in-game locations [13]. Based on this rich dataset, Tarng et al. proposed a methodology to predict whether a player will permanently leave a game in the near future or not [14]. Pittman et al. also analyzed the avatar behavior in World of Warcraft, such as how their population changes over time, how they are distributed in the virtual world, and the churn rate of players. The authors later applied the same analysis to another famous online game, Warhammer Online [15]. In [16], Chambers et al. analyzed a server trace of over 550 online games to investigate system issues that included whether the server workload is predictable and whether the

infrastructure can be shared amongst games and other interactive applications. In a later analysis of a long-term server trace of EVE Online [17], the same authors investigated the relationship between the game population and new game features. They also made an observation that the later a player joins the game, the higher the probability that the player would quit sooner. B. Facial EMG Measurement Facial EMG measurement has been adopted in various studies to measure players emotion during game play. For example, Ravaja et al. studied how gamers emotions vary in response to certain in-game events [4, 5], with their results conrming that players positive emotions are highly related to the achievements acquired, while the negative emotions are correlated with wounds and death experienced in the game [5]. In [18], Lee et al. assessed whether all computer games are equally friendly to the cloud gaming architecture by quantifying the amount of frustration experienced due to the inevitable latency in cloud gaming. To formalize players emotional states, Mandryk et al. [10] developed a fuzzy logic model to transform physiological signals into ve emotional states relevant to computer game play: boredom, challenge, excitement, frustration, and fun. In addition, Nacke et al. studied players emotions during game play with a variety of settings [6, 9, 19]. They examined how the background music and sound effects inuence the gaming experience [6]. The results indicate that music generally affects the gaming experience in a positive way, but the timing it starts and stops is critical. They also investigated how the game difculty level and players skill affect players emotion [9], and reported that the measured players emotional states can faithfully represent the gaming experience in real time. III. Q UANTIFYING G AME A DDICTIVENESS In this section, we propose an index to quantify the addictiveness of online games. We start by introducing the dataset we use and then discuss why quantifying game addictiveness is challenging. We conclude this section by formalizing and demonstrating our proposed addictiveness index using the reallife games in our dataset. A. Dataset Description Collaborating with Gamania Digital Entertainment2 , a top three game company in Taiwan, we obtained the account activity records (AAR) of 11 online games operated by the company. The format of an AAR record is simple: Each record comprises a player account and the start and end time of each game session. The 11 games include 5 role-playing games (RPG), 4 action (ACT) games, and 2 rst-person shooter (FPS) games. The games have different release dates and trace periods, with the trace period ranging from 240 days to 820 days. The number of accounts observed in the AAR of different games varies signicantly; that is, while more than
2 Gamania

Digital Entertainment, http://www.gamania.com/

TABLE I: Summary of the games from the Gamania dataset

Game ACT1 ACT2 ACT3 ACT4 FPS1 FPS2 RPG1 RPG2 RPG3 RPG4 RPG5

Publish Year 2009 2009 2009 2010 2009 2010 2009 2009 2010 2010 2010

Trace Period 240 days 730 days 773 days 609 days 732 days 556 days 385 days 323 days 486 days 732 days 820 days

# Accounts 500K+ 100K+ 500K+ 1, 000K+ 1, 000K+ 100K+ 100K+ 100K+ 100K+ 50K+ 50K+

User Rating 8.6 8.9 8.9 8.0 8.2 7.4 7.5 8.0 7.5 8.3 8.3

Presense days Subscription period

ACT2 ACT3 ACT4 FPS1 Game FPS2 RPG1 RPG2 RPG3 RPG4 RPG5

50

100 Days

150

200

250

4 million accounts are registered for the most popular game, only 50 thousand accounts are associated with the least popular one. The information about the 11 games are summarized in Table I, where the actual game titles are anonymized because of the condentiality agreement with Gamania. In the table, we also provide the average user rating (on a 110 scale) from the companys internal focus group studies. We can observe that there is no clear relationship between the game genre (ACT, FPS, and RPG), number of accounts, and user rating. B. Why Do We Need An Addictiveness Index? Given a set of AAR records for a game, one can easily compute when and how long a gamer is online playing a game. To facilitate comprehension of the terms in our further discussion, we dene the subscription period of a gamer as the time span (in days) of his rst and last game sessions, and dene the presence days as the total number of days that the gamer enters the game at least once within the subscription period. We assume that a game is more addictive if its gamers, relatively speaking, tend to play it as much as they can. However, to quantify the phenomenon of addictiveness is not a trivial matter. The players of game A, for example, may tend to play the game incontinently in the rst few weeks, but only be online sporadically afterwards. In contrast, the players of game B may not play the game unrestrainedly, but tend to play it regularly for a long time. On average, the players of the games A and B may have similar subscription periods and number of presence days, but it is hard to determine which game is more addictive. From this example, we know that both the subscription period and presence days are in themselves not good indicators of a games addictiveness. C. A General Addictiveness Index We dene a metric called the ratio of presence (RoP), which combines the subscription period and presence days by dividing the former into the latter. For example, if a player subscribes to a game for 100 days and logs in the game only on 20 days, the players RoP would be 20/100 = 0.2. As RoP quanties a gamers degree of participation in the unit of days throughout the subscription period, it should more or less reect his loyalty to the game. We depict the average subscription period, presence days, and RoP of each of the 11 games in Figure 3. From the graph, it looks like the RoP

Fig. 3: The average subscription period, presence days of the studied games. The number to the right of each bar stands for the ratio of presence (RoP) of each game. over the subscription period is not sufciently comprehensive to capture the addictiveness of a game. For example, the RoPs of ACT1, RPG1, RPG2, RPG3, and RPG5 are all beyond 0.45. On the other hand, FPS1, which has the longest subscription period and presence days, yields an RoP smaller than 0.2. This seems unreasonable because a long subscription period and a large number of presence days both suggest the addictiveness of a game. To pursue a more comprehensive index, we generalize the RoP index to include an observation period parameter as Presence days within OP , (1) OP where OP stands for the length of the observation period in days. Note that the observation period always starts from the day a player rst joins the game. For example, assuming that Alex rst joins a game on January 1st, 2012 and comes back on the 2nd, 3rd, 5th, 7th, 8th, and 9th in January, then Alexs RoP(1) is 1, RoP(5) is 4/5 = 0.8, and RoP(10) is 7/10 = 0.7. According to Equation 1, RoP is a non-decreasing function as the presence days will never increase faster than the length of the observation period. In practice, the RoP declines fast over time, since most players cannot enter a game every day even if they like the game very much. We consider that the decline rate of RoP, rather than the RoP itself, represents how addictive a game is. The rationale for this is that different games may lead to different session structures. For instance, gamers tend to play a few battles, each of which lasts less than an hour, in FPS games for a long period, say, years. On the other hand, an MMORPG encourages gamers to stick to the virtual world continuously for weeks or months, but it may no longer be that attractive after players have conquered the most interesting quests in the game. The situation is like an endurance race vs. an explosive race, which cannot be directly comparable simply by the racers pace. Thus, by focusing on the decline rate of RoP(OP), we judge the addictiveness of a game by the difference in the players participation density over time, which is independent of the player population, session structure, and game life cycles, and thus making the index comparable across games. Figure 2 shows the averaged RoP functions over different observation periods (OP) of three games in our dataset, where RoP(OP) =

1.0

1.0

R2 = 0.98

1.0

R2 = 0.99

R2 = 0.99

0.8

0.8

Ratio of presence (RoP) 0.4 0.6

Ratio of presence (RoP) 0.4 0.6

3/5

3/5

Ratio of presence (RoP) 0.4 0.6

RoP = 1.13 OP0.38

0.8

RoP = 1.20 OP0.50

RoP = 1.40 OP0.65

6/20 7/35 9/50 10/65

4/20 5/35 6/50 6/65 6/80

0.2

0.2

10/80

11/95

0.2

7/95

0.0

0.0

20

40 60 Observation period in days (OP)

80

100

20

40 60 Observation period in days (OP)

80

100

0.0 0

20

40 60 Observation period in days (OP)

80

100

(a) RPG1

(b) RPG2

(c) FPS2

Fig. 2: The RoP curves of three games in the Gamania dataset. The numbers above the curves denote the presence days (the numerator) and the observation period (the denominator). TABLE II: The addictiveness index of the games
Game ACT1 ACT2 ACT3 ACT4 FPS1 FPS2 0.44 0.49 0.37 0.43 0.45 0.65 R2 1.00 1.00 1.00 1.00 0.99 0.99 Game RPG1 RPG2 RPG3 RPG4 RPG5 0.38 0.50 0.50 0.58 0.43 R2 0.98 0.98 0.99 1.00 0.99
Beta 0.55 0.45 cor = 0.68 Beta 0.55 0.45 0.65 6 cor = 0.85

0.65

ACT1 ACT2 ACT3 ACT4

FPS1 FPS2 RPG1 RPG2

RPG3 RPG4 RPG5

20 40 60 80 Average session count per user cor = 0.66 Beta 0.55 0.45 Beta 0.55 0.45

8 10 12 14 16 Average presence days

OP ranges from 1 to 100 days3 . We nd that since the RoP curves follow a power-law relationship with OP, they can be modeled by RoP(OP) a OP + b, (2) where a and b are constants, and represents the decline rate of the RoP curve. Since our RoP curves decline over time, must be negative with a smaller corresponding to a more quickly declining RoP curve. Figure 2 shows the RoP curves of the games (denoted by the green cross marks) and their approximated curves (denoted by the red lines) derived using the ordinal linear regression (Equation 2). According to Figure 3, we can see that the players of RPG1 and RPG2 have similar subscription periods, presence days, and overall RoPs (0.45 and 0.47). However, as shown in Figure 2(a) and Figure 2(c), the RoP curve of RPG2 declines faster than that of RPG1, which indicates that the players of RPG2 tend to play the game less actively over time. This phenomenon is well captured by our addictiveness index . The of RPG1 and RPG2 are -0.38 and -0.50 respectively, which suggests that RPG1 is more addictive than RPG2. We summarize the addictiveness index and the R2 from the linear regression modeling of all the 11 games in Table II. The R2 column indicates that all the RoP curves can be modeled using the power-law function (Equation 2) extremely well. D. Addictiveness Index Explored Figure 4 illustrates the relationship between and three relevant factors: 1) The average session count, as the average number of sessions made by each gamer throughout
3 The maximum observation period, 100 days, is an arbitrary choice as we nd that RoPs with OP in [1, 100] are sufcient for RoP curve modeling. Similar results will be obtained if the observation period is extended beyond this range.

0.65

0.65

cor = 0.35 7.5 8.0 8.5 User score from focus group

20 50 100 200 500 Average online time per user (hours)

Fig. 4: The relationships between and four relevant factors. his subscription period; 2) the average online time, as the average total game play time of each gamer; and 3) the average user rating from a focus group. We can see that is positively correlated with the three factors with a moderate to strong coefcient 0.68, 0.66, and 0.35, respectively. This observation establishes that is not only reasonably related to a variety of measures about players involvement to a game, but also provides a general, population- and genre-independent approach to quantify the addictiveness of online games. IV. M EASURING P LAYER E MOTION In this section, we present our methodology for measuring players emotion when they are rst playing the games under investigation. We rst describe our experiment setup and then discuss our approach for quantifying the strength of players positive and negative emotions. To monitor players emotional states during gameplay, we setup an environment for facial EMG measurements. Our devices included the PowerLab system, BioAmp signal amplier, and LabChart. After a subject sat down at a computer, we attached two pairs of electrodes at the corugator supercilli and zygomaticus major muscle groups on the subjects face (c.f. Figure 1). Each subject was asked to play 1 to 3 games that the subject had never experienced. This requirement

0.60

cor = 0.03

0.45

ZM EMG (mV) 0.40 0.45 0.50

Beta 0.55

Beta 0.55

0.45

0.55

0.65

0.35

cor = 0.20 0.6 0.7 0.8 0.9 CS (mV) 1.0 1.1

0.65

cor = 0.38 0.30

ACT1 ACT2 ACT3 ACT4 FPS1 FPS2

RPG1 RPG2 RPG3 RPG4 RPG5

ACT1 ACT2 ACT3 ACT4

FPS1 FPS2 RPG1 RPG2

0.30

RPG3 RPG4 RPG5

0.40 0.50 ZM (mV)

0.60

0.6

0.7

0.8 0.9 CS EMG (mV)

1.0

1.1

Fig. 5: The relationship between the subjects average negative emotion (CS) and positive emotion (ZM) during gameplay. TABLE III: The average strength of subjects negative emotion (CS) and positive emotion (ZM) during gameplay.
Game ACT1 ACT2 ACT3 ACT4 FPS1 FPS2 CS 0.80 0.92 0.80 0.82 0.59 1.01 ZM 0.48 0.28 0.36 0.60 0.52 0.42 Game RPG1 RPG2 RPG3 RPG4 RPG5 CS 1.15 0.86 0.86 0.90 0.83 ZM 0.59 0.44 0.49 0.41 0.59

Fig. 6: The relationship between CS and and that between ZM and . in Table III and depict them in Figure 5. From the graph, we can see that CS and ZM do not possess any particular form of correlation (with a Pearson coefcient close to zero), which indicates that the subjects positive and negative emotions can be independently evoked by the games. V. F ORECASTING G AME A DDICTIVENESS In this section, we develop a prediction model of the addictiveness index, , based on CS and ZM derived from facial EMG measurements (Section IV). With the use of this model, game designers and operators can then objectively assess the addictiveness of a game with the help of a small focus group. We start by investigating the relationship between a games addictiveness index, , and the strength of emotion it evoked in the user study. Figure 6 represents the relationship between CS and and between ZM and , respectively. We nd that CS and has a negative correlation (with a coefcient 0.2) while ZM and has a positive correlation (with a coefcient 0.38), which is reasonable given that negative emotion (CS) should decrease a games addictiveness and positive emotion (ZM) should increase a games addictiveness. The reason why CS has a weaker correlation with than ZM may be because gamers can also be entertained when they feel a release from the negative emotional responses [4]. We dene an additional factor, ES (emotion strength), as the sum of CS and ZM, to denote the combined emotion strength that emerges during gameplay. By using CS, ZM, and ES, we develop a linear regression model to predict , as presented in Table IV. As shown in this table, all the factors except CS:ES, which denotes the interaction between CS and ES, are signicant at the level 0.05. Intuitively, the coefcient of ZM should be positive since a higher ZM causes a higher addictiveness; however, it turns out not to be the case because the inclusion of the interaction terms CS:ZM and ZM:ES. The adjusted R2 of our model is 0.94, which indicates a high goodness-of-t. To validate the effectiveness of our model, we perform cross-validation using the leave-one-out approach. That is, we pick one test game (out of 11) and predict its addictiveness based on a model trained using the remaining 10 games. The procedure is executed for 11 times so that each game serves as the test game once. The scatter plot of the actual and predicted of the games is shown in Figure 7. The Pearson correlation

is important so that we can assess the subjects rst-time experience with the games. We require each game session to be continuous without any interruptions and no shorter than 45 minutes, which did not include pre-game procedures such as avatar creation. During each session, we recorded the electrical potentials measured at the corugator supercilli and zygomaticus major muscles with a 1,000 Hz sampling frequency. We recruited a total of 84 subjects from an Internet community. The subjects comprised 74 males and 10 females with ages ranging from 19 to 34 years. In total, we obtained 192 EMG traces (corresponding to 192 game sessions) with an overall duration of 155 hours, where each game was played by 15 to 19 subjects. Since different subjects tend to have different levels of skin conductance, the electrical potential measures cannot be used directly. Instead, we compute the variability of the electrical potentials by taking the absolute differences of successive EMG samples. More concretely, assuming that P = {p1 , p2 , . . . , pn } is the time series of electrical potential samples, we dene a function f of P to quantify the strength of a players emotion as f(P ) = mean(abs(p2 p1 ), abs(p3 p2 ), . . . , abs(pn pn1 )), where mean() and abs() denote the arithmetic mean and the absolute value function, respectively. Note that n tends to be large since the EMG samples are taken at 1,000 Hz, so a 45-minute trace comprises a time series of length 45 60 1, 000 = 2, 700, 000. We compute f of the EMG samples measured at the corugator supercilli muscle as CS and denote it as the strength of the negative emotion; similarly, f of the EMG samples measured at the zygomaticus major muscle is used to represent the positive emotion and denoted as ZM. We list the average CS and ZM for each of the 11 games

0.2

R EFERENCES
[1] V. Lehdonvirta, Virtual item sales as a revenue model: identifying attributes that drive purchase decisions, Electronic Commerce Research, vol. 9, pp. 97113, 2009. [2] P.-H. Tseng, N.-C. Wang, R.-M. Lin, and K.-T. Chen, On the battle between online gamers and lags, in Proceedings of IEEE CQR 2011, May 2011. [3] K.-T. Chen, J.-W. Jiang, P. Huang, H.-H. Chu, C.-L. Lei, and W.-C. Chen, Identifying MMORPG bots: A trafc analysis approach, EURASIP Journal on Advances in Signal Processing, 2009. [4] N. Ravaja, T. Saari, M. Salminen, J. Laarni, and K. Kallinen, Phasic emotional reactions to video game events: A psychophysiological investigation, Media Psychology, vol. 8, no. 4, pp. 343367, Nov. 2006. [5] N. Ravaja, M. Turpeinen, T. Saari, S. Puttonen, and L. Keltikangas-J rvinen, The psychophysiology of james bond: a Phasic emotional responses to violent video game events. Emotion, vol. 8, no. 1, pp. 114120, 2008. [6] L. E. Nacke, M. N. Grimshaw, and C. A. Lindley, More than a feeling: Measurement of sonic user experience and psychophysiology in a rst-person shooter game, Interacting with Computers, 2010. [7] H. Desurvire, M. Caplan, and J. A. Toth, Using heuristics to evaluate the playability of games, Proceedings of ACM CHI04, Apr. 2004. [8] P. Sweetser and P. Wyeth, Gameow: a model for evaluating player enjoyment in games, Computers in Entertainment (CIE), vol. 3, no. 3, Jul. 2005. [9] L. Nacke and C. A. Lindley, Flow and immersion in rstperson shooters: measuring the players gameplay experience, in Proceedings of the 2008 Conference on Future Play, ser. Future Play 08, 2008, pp. 8188. [10] R. L. Mandryk and M. S. Atkins, A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies, International Journal of HumanComputer Studies, 2007. [11] J. T. Cacioppo, G. G. Berntson, and J. T. Larsen, The psychophysiology of emotion, Handbook of emotions, pp. 119 142, 2000. [12] A. Achaibou, G. Pourtois, S. Schwartz, and P. Vuilleumier, Simultaneous recording of EEG and facial muscle reactions during spontaneous emotional mimicry, Neuropsychologia, vol. 46, no. 4, pp. 11041113, Jan. 2008. [13] Y.-T. Lee, K.-T. Chen, Y.-M. Cheng, and C.-L. Lei, World of warcraft avatar history dataset, in Proceedings of ACM Multimedia Systems 2011, Feb 2011. [14] P.-Y. Tarng, K.-T. Chen, and P. Huang, An analysis of WoW players game hours, in Proceedings of ACM NetGames 2008, 2008. [15] D. Pittman and C. GauthierDickey, Characterizing virtual populations in massively multiplayer online role-playing games, Advances in Multimedia Modeling, 2010. [16] C. Chambers, W.-c. Feng, S. Sahu, and D. Saha, Measurementbased characterization of a collection of on-line games, in Proceedings of the 5th ACM SIGCOMM conference on Internet Measurement. USENIX Association, 2005. [17] W. Feng, D. Brandt, and D. Saha, A long-term study of a popular MMORPG, in Proceedings of NetGames07, 2007, pp. 1924. [18] Y.-T. Lee, K.-T. Chen, H.-I. Su, and C.-L. Lei, Are all games equally cloud-gaming-friendly? an electromyographic approach, in Proceedings of IEEE/ACM NetGames 2012, Oct 2012. [19] A. Drachen, L. E. Nacke, and G. Yannakakis, Correlation between heart rate, electrodermal activity and player experience in rst-person shooter games, in Proceedings of the 5th ACM SIGGRAPH Symposium on Video Games, 2010, pp. 4954.

0.6

Predicted Beta 0.5 0.4

0.3

0.7

ACT1 ACT2 ACT3 ACT4

FPS1 FPS2 RPG1 RPG2

RPG3 RPG4 RPG5

0.7

0.6

0.5 0.4 Actual Beta

0.3

0.2

Fig. 7: A scatter plot of actual and predicted addictiveness index according to our prediction model using a leave-oneout cross-validation approach. TABLE IV: The factors and their coefcients in the addictiveness prediction model.
Variable (constant) CS ZM CS:ZM CS:ES ZM:ES Coef. 4.30 4.19 11.59 3.53 0.21 4.89 Std. Err 0.43 0.51 1.04 1.06 0.24 0.66 t 9.87 8.18 11.07 3.31 0.87 7.37 Pr > |t| 0.00018 0.00044 0.00010 0.02119 0.42263 0.00072

coefcient between the actual and predicted is 0.86, the Kendal-tau correlation coefcient is 0.78, and the average error rate is only 11%. All these gures indicate that our model is effective in forecasting a games addictiveness simply based on a small set of facial EMG measurements during gameplay. VI. C ONCLUSION In this paper, we have proposed a methodology to forecast a games addictiveness based on players emotional responses when they rst explore a game. Based on the account usage records of 11 commercial online games, we have shown that our model can accurately forecast a games addictiveness according to facial EMG measures from a focus group. We believe that our forecast model will be helpful in several ways. For example, for game development rms, the model can be used to ensure that a games design is on the right track in its early development stages. In addition, the model can help game operators in assessing the potential market value of a game before publishing it. All in all, we hope that with our methodology, the game industry can optimize the odds of successful investments and be able to more accurately target the provision of a better entertaining experience. ACKNOWLEDGMENTS This work would not have been possible without the support from Gamania Digital Entertainment. The authors are much indebted to our collaborators and supporters at Gamania, Andy Liu, Ivy Huang, Karl Hsu, and Albert Liu, among others. The authors also wish to thank the anonymous referees for their constructive criticisms. This work was supported in part by the National Science Council under the grant NSC100-2628E-001-002-MY3.