Black Olive Tree Indoor. Prune back olive trees in spring when new growth begins. They only grow to 6 feet (1.8 m.) tall, and you…