Remember how Chris Stapleton’s powerful video for “Fire Away” knocked viewers off their feet despite the country star barely appearing in the clip? Then say hello to “Think I’m in Love With You,” the singer’s jubilant new music video that depicts an afterlife full of family reunions and disco dancing — and features clever, blink-and-you’ll-miss-them cameos by Stapleton and his wife and singing partner, Morgane Stapleton.

Directed by Running Bear and featuring choreography from JaQuel Knight, the video stars The Wire’s Andre Royo as a recently...