QMRFs for mutagenicity modelsThe QSAR Model Reporting Format (QMRF) documents for mutagenicity models.http://hdl.handle.net/10967/2432024-03-28T21:33:58Z2024-03-28T21:33:58ZDaga, P. ADMET Predictor - Bacterial mutagenicity model (MUT_Risk). 2020.http://hdl.handle.net/10967/2552021-09-02T21:24:42Z2021-09-02T14:45:00ZMUT_Risk
Abstract
The Ames bacterial mutagenicity test is an important regulatory screen for potential carcinogenicity. In silico prediction of Ames positivity plays two important but somewhat distinct roles in the discovery and development of biologically active compounds. A positive Ames test does not necessarily derail development of an active ingredient (AI) because some bacterial mutagens are not carcinogenic. As a practical matter, however, demonstrating non-carcinogenicity is challenging enough that having a robust predictive model for Ames mutagenicity is a very cost-effective alternative to automatically testing every active compound, especially since the model can be used to help decide which particular compounds to synthesize or purchase. In addition, regulatory guidance now allows the use of in silico predictions of mutagenicity to help justify waiving Ames testing requirements for impurities; ADMET Predictor®’s MUT_Risk qualifies as a “statistical model” under ICH M7. Its inputs are the predictions from a set of 11 artificial neural net ensemble (ANNE) models, two for each of five standard genetic backgrounds (S. typhimurium strain TA98, TA100, and TA1535; S. typhimurium strain TA97 or TA1537; or S. typhimurium TA102 or E. coli WP2 uvrA) with or without metabolic activation in S9 cell fractions as well as one trained on data obtained from a collaboration with Japan’s NIHS (Honma et al. 2019; doi 10.1093/mutage/gey031). Models for metabolically activated samples are designated “MUT_mXXX”, where the XXX indicates the genetic background(s) for the data upon which the model is based, e.g., MUT_m100. The corresponding models for samples assayed without activation are designated “MUT_XXX”, e.g., MUT_100. The model based on the NIHS data combines results from all 5 standard strains with and without metabolic activation; it is designated “MUT_NIHS”. A QMRF is available for each individual model. The overall MUT_Risk score is obtained as a weighted sum wherein each positive prediction from a model based on NIHS data or an individual strain other than S. typhimurium TA98 or TA100 contributes 0.6; positive predictions for TA98 or TA100 only contribute 0.3 to reflect the observed high correlation between experimental positives in these two genetic backgrounds. The MUT_Risk rules are formulated such that a positive prediction for either a MUT_XXX model or for the corresponding MUT_mXXX model or for both increments the overall MUT_Risk score by the same amount – i.e., the risk rule syntax prevents double counting. By default, an out-of-scope prediction increments the score by 50% of the weight of a positive prediction irrespective of whether the prediction is positive or negative. The MUT_Risk score itself is suitable for prioritizing compounds for Ames testing or deprioritizing them for synthesis. The default threshold of concern in a regulatory context (e.g., ICH M7) is a MUT_Risk > 1, which accommodates the rather low inter-lab reproducibility (85% or less; see Hansen et al. 2009; doi 10.1021/ci900161g) of the experimental data upon which the models are based. Confidence estimates (doi 10.1186/1758-2946-6-34) are provided for each contributing model’s in-scope prediction, and thresholds have been set low out of an abundance of caution. Hence some positive predictions have quite low confidences, which users should take into consideration when the MUT_Risk score exceeds 1. About 15% of the compounds in a 2260-drug reference subset of the World Drug Index have a MUT_Risk score > 1.0 and 10% have a MUT_Risk score > 1.25.
2021-09-02T14:45:00ZDaga, P. ADMET Predictor - Bacterial mutagenicity model (MUT_NIHS). 2020.http://hdl.handle.net/10967/2542021-09-02T21:24:37Z2021-09-02T14:44:33ZMUT_NIHS
The Ames bacterial mutagenicity test is an important regulatory screen for potential carcinogenicity. In silico prediction of Ames positivity plays two important but somewhat distinct roles in the discovery and development of biologically active compounds. A positive Ames test does not necessarily derail development of an active ingredient (AI), because some bacterial mutagens are not carcinogenic. As a practical matter, however, demonstrating non-carcinogenicity is challenging enough that having a robust predictive model for Ames mutagenicity is a very cost-effective alternative to automatically testing every active compound, especially since the model can be used to help decide which particular compounds to synthesize or purchase. In addition, regulatory guidance now allows the use of in silico predictions of mutagenicity to help justify waiving Ames testing requirements for impurities; ADMET Predictor®’s MUT_Risk qualifies as a “statistical model” under ICH M7. MUT_NIHS is one of the 11 models that provide input to MUT_Risk. It is an artificial neural network ensemble (ANNE) classification model built on literature data for 1716 positive examples and 10020 negative examples from the 5 standard Ames test strains (S. typhimurium strain TA98, TA100, and TA1535; S. typhimurium strain TA97 or TA1537; or S. typhimurium TA102 or E. coli WP2 uvrA) with and without metabolic activation. Of those, 342 and 2006, respectively, were set aside as an external test set for which the sensitivity was 0.780 and the specificity was 0.757 with an overall concordance of 0.760. The corresponding training set performance statistics were 0.719, 0.767, and 0.760, respectively. Predictions for any compounds for which any descriptor falls more than 10% outside the range of that descriptor seen in the training data are flagged as out-of-scope, and statistically rigorous confidences (doi 10.1186/1758-2946-6-34) are provided for all in-scope predictions.
2021-09-02T14:44:33ZDaga, P. ADMET Predictor - Bacterial mutagenicity model (MUT_m1535). 2020.http://hdl.handle.net/10967/2532021-09-02T21:24:33Z2021-09-02T14:44:12ZMUT_m1535
The Ames bacterial mutagenicity test is an important regulatory screen for potential carcinogenicity. In silico prediction of Ames positivity plays two important but somewhat distinct roles in the discovery and development of biologically active compounds. A positive Ames test does not necessarily derail development of an active ingredient (AI), because some bacterial mutagens are not carcinogenic. As a practical matter, however, demonstrating non-carcinogenicity is challenging enough that having a robust predictive model for Ames mutagenicity is a very cost-effective alternative to automatically testing every active compound, especially since the model can be used to help decide which particular compounds to synthesize or purchase. In addition, regulatory guidance now allows the use of in silico predictions of mutagenicity to help justify waiving Ames testing requirements for impurities; ADMET Predictor®’s MUT_Risk qualifies as a “statistical model” under ICH M7. MUT_1535 is one of the 11 models that provide input to MUT_Risk. It is an artificial neural network ensemble (ANNE) classification model built on literature data for 290 positive examples and 1763 negative examples from Ames tests run using Salmonella typhimurium strain TA1535 with metabolic activation by S9 cell fractions. Of those, 45 and 366, respectively, were set aside as an external test set for which the sensitivity was 0.867 and the specificity was 0.852 with an overall concordance of 0.854. The corresponding training set performance statistics were 0.824, 0.884, and 0.875, respectively. Predictions for any compounds for which any descriptor falls more than 10% outside the range of that descriptor seen in the training data are flagged as out-of-scope, and statistically rigorous confidences (doi 10.1186/1758-2946-6-34) are provided for all in-scope predictions.
2021-09-02T14:44:12ZDaga, P. ADMET Predictor - Bacterial mutagenicity model (MUT_m102+wp2). 2020.http://hdl.handle.net/10967/2522021-09-02T21:25:14Z2021-09-02T14:43:46ZMUT_m102+wp2
The Ames bacterial mutagenicity test is an important regulatory screen for potential carcinogenicity. In silico prediction of Ames positivity plays two important but somewhat distinct roles in the discovery and development of biologically active compounds. A positive Ames test does not necessarily derail development of an active ingredient (AI), because some bacterial mutagens are not carcinogenic. As a practical matter, however, demonstrating non-carcinogenicity is challenging enough that having a robust predictive model for Ames mutagenicity is a very cost-effective alternative to automatically testing every active compound, especially since the model can be used to help decide which particular compounds to synthesize or purchase. In addition, regulatory guidance now allows the use of in silico predictions of mutagenicity to help justify waiving Ames testing requirements for impurities; ADMET Predictor®’s MUT_Risk qualifies as a “statistical model” under ICH M7. MUT_m102+wp2 is one of the 11 models that provide input to MUT_Risk. It is an artificial neural network ensemble (ANNE) classification model built on literature data for 124 positive examples and 679 negative examples from Ames tests run using S. typhimurium TA102 or E. coli WP2 uvrA with metabolic activation by S9 cell fractions. Of those, 18 and 143, respectively, were set aside as an external test set for which the sensitivity was 0.889 and the specificity was 0.811 with an overall concordance of 0.820. The corresponding training set performance statistics were 0.802, 0.828, and 0.824. Predictions for any compounds for which any descriptor falls more than 10% outside the range of that descriptor seen in the training data are flagged as out-of-scope, and statistically rigorous confidences (doi 10.1186/1758-2946-6-34) are provided for all in-scope predictions.
2021-09-02T14:43:46Z