Discovery Gap //Case study · Ena
A product case study · independent, not affiliated with Spotify


Lesser-known artists get a fair first listen. They just don't get a second one.

9:41●●● ▮
First listen · played on its own
Moja
Dlala Thukzin, Zeh McGeba, MK Productions
1 of 5
0:00Press play
A new artist
Played to the end, not skipped
Problem

A liked first listen of a lesser-known artist usually leads nowhere. About 8 in 10 aren't heard again within two weeks, and listeners rarely go back on their own.

Still played 30–90 days later
12% vs 19%
Lesser-known vs big artists
Solution

Second Listen. After two quiet weeks, bring the artist back once, with a different song, in the radio or mix where the listener first heard them.

10 of 10
listeners show the gap · very unlikely to be chance

Loading the Spotify player…

Five songs: two of Ena's picks and three lesser-known artists from the sample. Skip one in under 30 seconds and the phone marks it as a skip, the way this study counts one. Phones and logged-out visitors hear a preview, so Full song ↗ opens the whole track in Spotify.

1.44MPlays analysed
10Listeners' exports
4Interviews
30Artists checked by hand
A1//ApproachFour hypotheses

The hunch that failed.

I expected popularity bias: big artists pushed harder, lesser-known ones skipped more. The data pointed somewhere else.

Spotify exports10 friends, shared with consent1.68M plays · 1.44M since Oct 2021
CleanPodcasts droppedIP addresses never loadedSpellings merged
Size artistsLast.fm listenersRanked within genreDeezer fans as a check
Define momentsSkip: under 30s, or "next"Played on by itself vs pickedLiked, lost, stuck
CompareWithin each listenerRe-checked 10,000 ways (bootstrap)Still true without any one listener

Two terms used throughout: a lean-back listen is a song that played on by itself (radio, autoplay, or a playlist carrying on) rather than one the listener picked. Lesser-known means in the bottom third of artists in the same genre (or under 100,000 Last.fm listeners when the genre isn't known).

A finding about the data itself

Open music databases undercount African artists.

357/412

Afrobeats artists one global Last.fm cut-off would call lesser-known. Burna Boy came out "mid".

3.5×

How much Last.fm undercounts African artists against Western ones, checked by hand against Spotify for 30 artists

0.91

Rank correlation: the order is still right within a genre, so ranking artists within their own genre fixes most of it

H1

A lesser-known artist's first listen is skipped more

Not supported
H2

Spotify's lean-back introductions lean towards big artists

Not supported
H3

Lesser-known artists stick less after a first listen

Supported · 10 of 10
H4

Listeners go back on their own to new artists they liked

Rarely · 1–2%

The question changed from "is discovery unfair?" to "why does a fair introduction lead nowhere?"

A2//Finding 1No penalty

A fair first listen.

Add everyone's plays together and lesser-known artists seem to win by 10 points. Look inside each listener and the advantage mostly disappears.

Lean-back first listens that were skipped
First time a listener heard an artist, on a song that played on by itself · L01–L10 are the 10 listeners, anonymised
Lesser-knownBig

Gap = big minus lesser-known skip rate, in percentage points (pts). A plus means big artists were skipped more.

"Would even give me more reason to go."

An interviewee, on an artist with very few monthly listeners.

"I don't equate quality music to more famous songs."

Another interviewee, asked whether they check an artist's monthly listener count. All four said a small count doesn't put them off.

A3//Finding 2The headline

They don't stick.

"Stuck" means still being played, not skipped, 30–90 days after a lean-back first listen. For every single listener, big artists stuck more often.

Artists still played 30–90 days later
One row per listener (L01–L10, anonymised), sorted by gap
Lesser-knownBig

Gap = big minus lesser-known, in percentage points (pts). For L04, 25.2% of big artists stuck against 8.2% of lesser-known ones: a gap of about 17 points, shown as +16.9 because it uses the unrounded rates. A plus means big artists stuck more, and every listener is a plus.

A bouncy, stripped-back pop track made from the data. Each listener gets one bar: the stabs are their lesser-known stick rate, and the lead bends up into their big-artist rate. Higher stick rate, higher note. Notes snap to a minor scale, so L06's tiny 0.6-point gap sounds level. The other nine all climb.

12% vs 19%

Lesser-known vs big artists that stuck, everyone's plays added together

8.8pts

Typical gap for a single listener (median)

10/10

Listeners show it. Odds of that by chance: about 1 in 500 (p = 0.002)

5.9–9.3

The gap when any one listener is removed. It never disappears.

A4//Finding 3Liked but lost

Liked, then lost.

Follow 1,000 first listens the listener liked: played through, not skipped. Step through what happens next.

Lesser-known artists1,000
Big artists1,000

These figures leave out the one listener whose background listening makes "liked" unreliable. Under the proposed trigger rules they are 3.3% against 7.1%. Checked listener by listener, the gap shows up for all 10 (typically 5 points; about a 1-in-500 chance of that by luck). This is correlation, not proof: that's what the experiment is for.

1.0%

of liked lesser-known first listens got a click back from the listener (1.9% for big)

17.4/21.5

points of lean-back returns were the same song replaying

7.5% vs 24%

Even when lesser-known artists came back, few reached a different song

"Another popular" one.

A self-described loyal listener, on what they want after a popular song. A lead, not evidence: I'd raised popularity bias myself.

"At the very least, I'm likely to click on it."

On a new artist framed as similar to one they love. Also a lead, answering an example I gave.

B1//ProposalNo new screens

Second Listen.

When a liked lesser-known artist hasn't come back after two weeks, bring them back once, with a different song, in the radio, autoplay or mix where the listener first heard them.

Radio · after a song you played
Song one
A lesser-known artist
Played to the end

Drag through the 90 daysDay 0
First listenDay 0 · liked, played on by itself
LostDays 1–14 · no play
Second ListenDays 14–30 · one boost, a different song
ReadoutDays 30–90 · does another song get played?
Trigger
  • A lean-back first listen of a lesser-known artist, played to the end
  • No play of that artist in the next 14 days
Excluded
  • Sleep and background contexts
  • Songs artists paid to promote (Discovery Mode)
  • Unverified artists, or 1–2 songs only
Limits
  • One try per artist, at most 2 a week
  • Fewer for loyal listeners
  • "Hide" removes the artist
v2, if v1 works
  • A reason line: "You listened to X two weeks ago"
  • An anchor: "with Y"
  • Test in Discover Weekly
B2//MeasurementA/B test

Testing it.

Half of listeners get Second Listen, half don't, chosen at random. Success means more listeners go on to play a different song by the artist 30–90 days later. Today that happens 3.3% of the time.

What would it take, and what would it be worth?
Some will be skipped past, or never reached in a session.
+100% means the primary metric doubles, from 3.3% to 6.5%.
–

Listeners needed in each group of the test (one group gets Second Listen, one doesn't)

–

Extra times a month a listener goes on to a second song by a new artist, per 1 million listeners like the typical one here

These are rough units, not a forecast: the 10 listeners here listen far more than most people. Technical detail: from sizing.py, 1.2 triggers per listener a month, baseline 3.26%, 80% power, intra-class correlation planned at 0.02. The 90 days of waiting, not the number of users, set the timeline.

TypeMetric
Primary
the main success measure
A different song by the triggered artist, played and not skipped, in days 30–90. The re-introduced song doesn't count.
Leading · 30 days
an early sign, before day 90
Something the re-introduction can't produce by itself: a return the listener starts, a save, or a follow.
Guardrails
must not get worse
Listening time per session, skip rate on re-introduced tracks, hide rate. Reported separately for loyal listeners.
Counter-metric
checks for side effects
Whether other artists in the same radio, autoplay and mixes lose out.
Decision ruleShip if the primary metric rises and no guardrail breaks. Iterate on timing or song choice if only the leading metric moves. Stop if re-introductions are skipped more than the surface's normal rate.
B3//WorkflowThree phases

Rollout & options.

Most ideas for helping small artists act on the first listen. The first listen is already fair, so they add introductions to the same leak.

1. Offline replay
  • Trigger volumes on Spotify's own data
  • Separate autoplay from own playlists
  • Check day 30 predicts day 90
2. A/B test
  • Radio and autoplay first
  • One month enrolment
  • 90-day readout
3. Expand
  • Mixes next
  • Test the v2 reason line
  • Test timing: 1, 2 or 4 weeks
OptionActs onImpactDecision
A. Re-introduce liked-but-lost artists with a different songThe gapHighBuild and test
B. More lesser-known artists in first exposureThe first listenLowNo: more introductions, same leak
C. Hide monthly listener countsThe first listenLowNo: interviewees already ignore them
D. Genre tags on tracksThe first listenLowNo: 1 of 4 interviewees wanted them
E. Album-based mixes instead of artist radioRelevance in generalMediumBacklog: not specific to small artists
F. "Follow this artist?" prompt after a liked listenThe gapLowNo: clicks back are rare
B4//ReflectionLimits

What I learned

  • The most useful moment was the hypothesis failing. Following the data past the first listen gave a sharper, more buildable problem.
  • Adding everyone's plays together nearly misled me. My first draft headlined "skipped less: 7.9% vs 17.8%". A peer review showed that mostly reflects who listens. Now every comparison is within listeners first.
  • Measurement took most of the time. Ranking within genre, checked by hand against Spotify, stopped Burna Boy from counting as "mid".
  • Interviews need neutral questions. Where I raised "popularity bias" myself, the answer isn't used as evidence.

Limits

  • 10 friends, mostly heavy listeners in Nigeria and the UK. One has 28% of the plays.
  • "Lean-back" can't tell Spotify's radio and autoplay apart from the listener's own playlists. "Liked" means not skipped.
  • A "first listen" is the first in the export. Big artists may have been heard before.
  • Size data undercounts African artists. Checked by hand against Spotify for 30 artists, Last.fm undercounts African artists about 3.5× compared with Western ones. It still ranks them in the right order within a genre, so ranking within genre fixes most of it. But artists with no genre tag (71% of lesser-known first listens that played on by themselves) fall back to one fixed Last.fm cut-off, where some African artists may be called lesser-known when they aren't. Deezer, the second check, rates African genres bigger than Last.fm does, which fits that undercount.
  • Spotify's export only shows what people played. It can't show recommendations they saw but skipped past, or artists they found elsewhere, like TikTok, radio or Shazam. A song found on Shazam and then played on Spotify just looks like a song the listener picked.
//In one line

Fair first listen.
No second one.
Build the second.

Spotify already sells artists a way to reach listeners who met them passively. Second Listen does it organically, for every lesser-known artist, in the two weeks that matter.

See the SQL and method on GitHub ↗

IntroDiscovery Gap
0 / 8