Sustainability is a subject that has gained growing importance in the disciplines of human-computer interface (HCI) and machine learning (ML). While previous work has often focused on the end-user of a system or the system itself, we would like to emphasize the developer's role in making more sustainable decisions across the entire ML life-cycle. We outline selected articles briefly before moving on to discuss relevant aspects that developers should consider at each stage to make more sustainable decisions. With this paper we hope to contribute to a broader discussion on building and developing a more sustainable future.