ToonNote

Improving communication in computational notebooks through interactive data comics

Keywords
Interactive data comics, Data storytelling, Multi-level interfaces
Members
Daye Kang, Tony Ho, Nicolai Marquardt, Bilge Mutlu, Andrea Bianchi
My contribution
Lead Researcher & Designer
Research framing, formative research, system and interaction design, development, and user evaluation
Publication
ACM CHI 2021
Read the paper →
ToonNote computational notebook and interactive data comic interface

Background

Computational notebooks are widely used by data scientists because they combine code, notes, tables, and visualizations in one working document, making it easier to document, analyze, and share a complete workflow. However, the resulting notebook is often long, loosely structured, and filled with intermediate work that obscures the author’s main story.

Collaborators may need different levels of detail. A data scientist may want to inspect code and provenance, while a manager or domain expert may only need the central findings. Existing notebooks make both audiences move through the same dense, vertical document.

Why comics?

Computational notebooks already communicate key findings through visualizations and annotations, but their long stream of code, markdown, and outputs makes the story difficult to follow. Data comics are sequential visual narratives that combine data visualizations and annotations to communicate insights. They can help address these challenges in three ways:

01

Guide the reader

Comic panels arrange insights in a deliberate sequence, helping readers follow the author’s intended narrative instead of navigating an unstructured document.

02

Reduce reading effort

Frames divide complex information into memorable chunks and place annotations beside visuals, keeping related insights together while reducing scrolling.

03

Reach broader collaborators

A visual overview helps people unfamiliar with the dataset grasp the key findings, while ToonNote preserves the notebook, code, and interactive outputs for deeper inspection.

Design question

How might data comics make computational notebooks easier to understand and share?

Formative Study

We compared three representations of the same COVID-19 analysis: a concise curated notebook, a detailed notebook, and a static data comic. Twelve participants with data-science backgrounds evaluated how each format supported navigation, understanding, and sharing.

Curated notebook, detailed notebook, and comic document used in the ToonNote formative study
Figure 2. Three document formats used in the formative study. A is a curated notebook with one final output and no intermediate steps; B is a detailed notebook with the same markdown and code plus intermediate steps; C is a comic assembled from their stories and images. D marks markdown cells, E code cells, and F outputs generated by code.
Purple survey charts comparing preferences for curated, detailed, and comic documents in the formative study
Figure 3. Formative-study survey results. Half of the 12 participants wanted both curated and comic documents to be shared; participants also identified comics as most appropriate for collaborators unfamiliar with the dataset.

Participants reported that the comic was more welcoming, easier to understand, and required less effort, while the curated notebook retained useful detail and interactive plots. They did not want to lose the notebook’s analytical detail or interactive graphs. This finding led to a multi-level interface that preserves the notebook and adds a Comic View readers can enter or leave at any time.

System Design

JupyterLab is a browser-based workspace for creating and running Jupyter computational notebooks, which organize executable code, explanatory markdown, and generated outputs in cells. ToonNote is a JupyterLab extension that lets an author tag selected markdown and output cells as comic content. Those cells become a compact sequence of frames, while unselected cells remain available in the original Notebook View.

System design of ToonNote showing how selected notebook cells become comic frames and examples of annotated COVID-19 data-comic frames
Figure 1. ToonNote turns a traditional Notebook View into a high-level Comic View while preserving access to the full notebook. Authors select markdown (A) and outputs (B), then combine them into single or multiple comic frames (C). The examples at right show how annotations and visual outputs form a linear data story; readers can toggle back to Notebook View whenever they need code or additional detail.

Design goals

The following design goals were developed based on the formative study results.

01

Integrate overview + detail

Comic View communicates the high-level story while Notebook View preserves the full analytical process.

02

Support exploration in context

Readers can reveal relevant code and explore an output without leaving the Comic View.

03

Preserve the author’s view

Readers can interact with a visualization, then restore the visual state recorded by the author.

A ToonNote comic view showing charts, annotations, and a data table in three frames
Figure 4. A sample Comic View created with the Netflix dataset. The top-left frame shows a bar chart; the top-right zooms into a specific portion of the same chart; the bottom frame demonstrates that Comic View can also display tabular output, not only graphs.

Core Interactions

These interactions let readers move between overview and detail, inspect the code behind a frame, and explore visualizations without losing the author’s intended view.

1

Toggle views

Move between Comic View and Notebook View to shift from a curated narrative to the complete analytical document.

2

Peek at code

Reveal the code behind one comic frame without leaving the story, supporting quick checks of how an output was produced.

3

Undo / reset view

Explore an interactive chart, then restore the visualization to the state the author recorded for that frame.

Evaluation

We ran a within-subjects study with 12 experienced data analysts. Participants used both standard and ToonNote-enabled notebooks to understand COVID-19 and Netflix datasets, answer seven comprehension questions, and evaluate the reading experience.

Standard notebook and ToonNote comic-view study materials for COVID-19 and Netflix datasets
Figure 5. Study materials paired standard notebooks with ToonNote-enabled versions of the COVID-19 and Netflix datasets.

Findings

2.1×

Faster high-level understanding

Participants answered the study questions in 7.83 minutes with ToonNote versus 16.31 minutes with a standard notebook.

−69%

Lower task load

NASA-TLX scores fell from 69.86 to 21.67, indicating a substantially less demanding reading experience.

5.83

Clearer authorial intent

Participants rated understanding of the author’s intention 5.83/7 with ToonNote versus 2.41/7 with the standard notebook.

6.08

More engaging to read

Enjoyment and engagement both averaged 6.08/7, compared with 2.58 and 2.08 for the standard notebook.

Charts comparing standard notebooks and ToonNote for time, accuracy, task load, intention, comprehension, enjoyment, engagement, and sharing
Figure 6. Study results compare standard notebooks and ToonNote across comprehension, task load, authorial intent, reading experience, and sharing measures.

ToonNote did not significantly improve overall comprehension among expert analysts, who were already skilled at reading conventional notebooks. Its value was in making the author’s narrative faster to grasp, less cognitively demanding, and more engaging while preserving a path back to the underlying analysis.

Read the full ToonNote paper →

← Back to projects