A 50-gene subtype predictor called PAM50 was developed to predict breast cancer prognosis and chemotherapy benefit by classifying cancer as luminal A, luminal B, or others. We propose a machine-learning pipeline analyzing H&E stained TMA images to discriminate between luminal A and luminal B subtypes in a way that removes the closely-associated tumor-grade effects.