Agarwal et al. introduce MitoSpace, a self-supervised model trained on 4D lattice light-sheet microscopy data. The model resolves drug-induced mitochondrial phenotypes without labels, predicts membrane potential from morphology and dynamics, generalizes to unseen perturbations and lung organoids, and shows that representation quality improves progressively from 2D to 4D.