Neoepitopes arising from amino acid substitutions due to single nucleotide polymorphisms are targets of T cell immune responses to cancer and are of significant interest in the development of cancer vaccines. However, understanding the characteristics of rare protective neoepitopes that truly control tumor growth has been a challenge, due to their scarcity as well as the challenge of verifying true, neoepitope-dependent tumor control in humans. Taking advantage of recent work in mouse models that circumvented these challenges, here, we compared the structural and physical properties of neoepitopes that range from fully protective to immunologically inactive. As neoepitopes are derived from self-peptides that can induce immune tolerance, we studied not only how the various neoepitopes differ from each other but also from their wild-type counterparts. We identified multiple features associated with protection, including features that describe how neoepitopes differ from self as well as features associated with recognition by diverse T cell receptor repertoires. We demonstrate both the promise and limitations of neoepitope structural analysis and predictive modeling and illustrate important aspects that can be incorporated into neoepitope prediction pipelines.