Ulcers are caused when there is an imbalance between the digestive juices produced by the stomach and the various factors that protect the lining of the stomach. Symptoms of ulcers may include bleeding. On rare occasions, an ulcer may completely erode the stomach wall. The most common symptom is a burning pain in the stomach, especially between meals or at night.