Liu et al. develop Oncoformer, a multimodal transformer that reads routine laboratory tests and chest X-rays already collected in everyday care. Across more than 3.6 million individuals, it detects cancer, infers tumor stage, and stratifies treatment response and recurrence risk, pointing toward risk-adapted cancer care built on data already in hand.