“Two Black Bottles” (1927)
Read in 2017.
Remarkable only in its extensive—for Lovecraft—use of the Christian deities: a satanist villain for whom “God was too strong”, as opposed to Lovecraft’s indifferent novel deities. Other than such vilification of an unsociable loner, the kind you might find anywhere, it’s just a regular ghost story.
References here: “The Dreams in the Witch House” (1933).