Research results: Measuring reader engagement

Can we measure and predict reader engagement? Twipe set out to answer this question, along with Mediahuis and two research groups from KU Leuven. In the two years since this Digital Reader Engagement (DRE) project began, we have learned what happens in the body while reading and turned this into our Google DNI-backed product EngageReaders which gives newsrooms actionable insights on a daily basis.

Members of the KU Leuven analytics research groups have continued on the project of digital reader engagement, with the following publications:

  • Nelissen, K., Snoeck, M., vanden Broucke, S., Baesens, B. “Swipe and Tell: Using Implicit Feedback to Predict User Engagement on Tablets”, ACM Transactions on Information Systems, submitted
  • Nelissen, K., vanden Broucke, S., Baesens, B., Snoeck, M. “Using Consumer Interaction Behavior from Repeated Online Service Experiences to Improve Predictions of Satisfaction and Intention-to-recommend”, International Journal of Information & Management, submitted
  • De Koninck, P., Nelissen, K., Baesens, B., vanden Broucke, S., Snoeck, M., De Weerdt, J. “An approach for Incorporating Expert Knowledge in Trace Clustering” International Conference on Advanced Information Systems Engineering (CAiSE 2017)

Professor of Analytics Bart Baesens and PhD Student Klaas Nelissen, researchers at KU Leuven, sat down with us to discuss their findings and what lessons the media industry can learn from them.

Finding the treasures in your data

One key finding that both researchers wanted to highlight is how many in the media industry are ignoring, or not even aware of, the potential treasures hidden in the vast amounts of data they collect from readers.

Klaas Nelissen emphasized the need for the news industry to invest in understanding how people are reading in new digital formats. Instead of simply relying on page views equaling engagement, the DRE research project allowed for a clear understanding of what happens in the body while reading a digital newspaper, achieved through observing sixty readers while they read the tablet version of two Belgian dailies, De Standaard and Het Nieuwsblad. (An article discussing the findings of this experiment was recently published in the Journal of the Chartered Institute of Journalists.)

3 steps to get to know your readers

The first step in getting to know your readers is to understand where you are in terms of business analytics maturity. Take stock of your data awareness, do you collect reader surveys regularly? Have you instrumented your apps so that you have an understanding of reader behaviour?

Then in the second step, news organizations without much hard data already extracted from their digital publications or reader surveys can begin with qualitative experiments. By observing how your readers interact with your edition, you will begin to develop a general sense of your readers and their behavior. 

Klaas Nelissen explained that during the qualitative portion of his research, observing the readers of two different newspapers clearly showed that there were clear differences between the two groups of readers. The differences were not only in how they talked about their experience with the newspaper, but also in broader ways, such as how they looked at the world in general.

Then news organizations can move to the third step, implementing a behavioural tracking aspect. This will give the newsroom clear insights to act on. To implement this behavioral tracking, it is important to first decide what level of analysis to conduct. Klaas Nelissen looked at how the level of analysis affects the research of reader engagement, moving from one reading session to an interaction with one article. By changing the level of analysis to one article, he was surprised to see that swipe actions were one of the most reliable predictor of engagement. 

Ensuring privacy in data collection

Privacy is sure to be a growing concern in 2018, due in part to the looming General Data Protection Regulation affecting all companies collecting data of European Union residents. But this should not deter news organizations from developing data awareness and insights, thanks to Klaas Nelissen’s finding that swipe patterns are the best predictor of reader engagement. As such, behavioural tracking can serve as a privacy-preserving way to understand your readers.

Leading successful innovation

Tackling the question of digital reader engagement is no easy feat. Bart Baesens credits their success to two factors, the complementary team of researchers and Twipe’s dedication to innovation. By having a team of researchers that all had their own specific expertise, they were able to work together and cover more ground. As for Twipe’s dedication to innovation, he explained:

Next steps in digital reader engagement

The next stage in this multi-year research project is to link the findings from the biosensor data to specific swipe patterns. Klaas Nelissen will study how to connect the measurable impact of reading in the body with the swipe patterns of engaged readers, in order to predict reader engagement without needing to monitor what is happening in the body. By putting together the knowledge learned from how the body reacts when a reader is more engaged and the swipe patterns learned from the qualitative experiments, he hopes to be able to expand from small samples of readers to scaling their insights to potentially all readers of a newspaper, through behavioural tracking. We will be sure to keep you posted on future developments in digital reader engagement.
 
 

Mary-Katharine Phillips
Business Development @ Twipe