My heart doth oft to idols cleave

My heart doth oft to idols cleave, (Hosea 4:17, Ezek. 14:3)
(With shame, O God, I own)
Yet do not thou the sinner leave,
Yet let me not alone: (Hosea 4:17)
Rather thy froward child reprove, (Prov. 3:12, Heb. 12:6)
’Till with my sins I part,
Withdraw from earthly things my love, (Col. 3:2, Matt. 6:20-21)
And give thee all my heart.

Hymnal/Album: Originally titled “Ephraim is joined to idols: let him alone.”—[Hosea] iv. 17. Introduced in Charles Wesley, Short Hymns on Select Passages of the Holy Scriptures, Vol. 2 (Bristol: Farley, 1762). Published in The Poetical Works of John and Charles Wesley, Collected and Arranged by G. Osborn, Vol. 10 (London: Wesleyan-Methodist Conference Office, 1870), page 76.
Publishing: Public Domain