On your home screen, hold down on any app icon for a few seconds and they will begin to wiggle.
You'll also notice an "x" icon appear on the top-right corner of each app icon. Tap that to permanently remove any app of you choice.
When you're done sorting through your apps, hit the home button to return to the normal home screen view.