If you are close to the desert you probably don't have forests though. Tree need a lot of water, as things get dryer the land transitions to grassland before desert.
Of course mountains are often a factor. There are deserts at the base of forested mountains. The mountain takes all the rain.
