Peptic ulcers are the most common cause of non-variceal upper gastrointestinal bleeding. Other common causes include erosive gastritis, Mallory-Weiss tears, reflux esophagitis, and angiodysplasia.