Here is the deal. The title of the Dusty Springfield hit is "I Only Want To Be With You." The title of the Hootie song is "Only Want To Be With You." It was composed by Mark Bryan, Bob Dylan, Dean Felber, Darius Rucker, and Jim Sonefeld, according to Wikipedia: https://en.wikipedia.org/wiki/Only_Wanna_Be_with_You. That's the source of the confusion. The Wikipedia article even starts with a warning about possible confusion between these two songs!