Once you have a couple of thousand songs on your iPhone it's going to take a second or two more to open the application but that shouldn't be a problem.
Restarting you iPhone from time to time is also a good way to clear up memory and make things faster.
Also, make sure you have updated to the latest iOS 4.2 which helps make the iPhone 3G faster.