Implementation of preemptive DNA sequence–based pharmacogenomics testing across a large academic medical center: The Mayo-Baylor RIGHT 10K Study
Abstract
Purpose
The Mayo-Baylor RIGHT 10K Study enabled preemptive, sequence-based pharmacogenomics (PGx)-driven drug prescribing practices in routine clinical care within a large cohort. We also generated the tools and resources necessary for clinical PGx implementation and identified challenges that need to be overcome. Furthermore, we measured the frequency of both common genetic variation for which clinical guidelines already exist and rare variation that could be detected by DNA sequencing, rather than genotyping.
Methods
Targeted oligonucleotide-capture sequencing of 77 pharmacogenes was performed using DNA from 10,077 consented Mayo Clinic Biobank volunteers. The resulting predicted drug response–related phenotypes for 13 genes, including CYP2D6 and HLA, affecting 21 drug–gene pairs, were deposited preemptively in the Mayo electronic health record.
Results
For the 13 pharmacogenes of interest, the genomes of 79% of participants carried clinically actionable variants in 3 or more genes, and DNA sequencing identified an average of 3.3 additional conservatively predicted deleterious variants that would not have been evident using genotyping.
Conclusion
Implementation of preemptive rather than reactive and sequence-based rather than genotype-based PGx prescribing revealed nearly universal patient applicability and required integrated institution-wide resources to fully realize individualized drug therapy and to show more efficient use of health care resources.
Keywords
- Clinical translation
- Implementation
- Individualized medicine
- Pharmacogenomics
- Pre-emptive clinical DNA sequencing
Introduction
Pharmacogenomics (PGx) is the study of genetically determined variation in individual response to drugs.1,
,
PGx variants may affect either pharmacokinetics, processes such as drug metabolism or transport that influence the concentration of a drug reaching its target, or pharmacodynamics, variation in the target itself or processes downstream of the target.
,
Although many DNA sequences are known to influence drug response,
,
,
PGx has not yet achieved broad clinical implementation. More recently, there have been multiple efforts to move toward that goal, from studies conducted by single institutions
to those involving multiple institutions and multiple countries such as the Ubiquitous Pharmacogenomics Consortium that extends across the European community.
There are numerous reasons for this slow pace of implementation, including a requirement to educate providers, limited insurance reimbursement in the United States, and a relative lack of prospective comparisons of preemptive test results vs reactive testing.
Numerous entities such as the Pharmacogenetics Knowledgebase (PharmGKB)6 and Pharmacogene Variation Consortium (PharmVar)
have been established to serve as database repositories to collect PGx variants and provide underlying information, including allele frequencies, metabolic pathways, and the strength of associations between variants and clinical effects. Further resources, including the Clinical Pharmacogenetic Implementation Consortium (CPIC),
the Dutch Pharmacogenetic Working Group (DPWG),
and others, are dedicated to the establishment of peer-reviewed clinical dosing guidelines based on diplotype-driven predictions of resulting drug response phenotypes. Various government entities such as the US Food and Drug Administration (FDA)
both publish dosing guidelines and exercise regulatory authority over testing and return of results. All of these databases catalog genomic variants that are relatively common, where there is sufficient data to support statistically robust conclusions as to their effect. However, over the past decade, it has been shown that rare variants are both greater in number and often show larger effect sizes than many common variants.
A number of studies aimed at genes known to be involved in PGx also show that both common and rare variants are prevalent and influence clinical outcomes and that variants and allele frequencies vary across populations, suggesting that individual use of these data might have a broad and significant effect on drug prescribing practices worldwide.
A number of health care systems have begun to integrate alerts for PGx drug–gene pairs into their electronic health records (EHRs).12,
,
Those alerts have sometimes been designed to inform the prescriber of the availability of PGx testing for the drug being prescribed, as is the case at the Mayo Clinic for a subset of drug–gene pairs (Table 1). However, this reactive approach requires that the prescriber order the PGx test and then wait for the result, a delay that could be avoided if genomic information for that patient had already been deposited in the EHR. Ideally, a preemptive test would integrate PGx seamlessly into the clinical workflow, would only fire alerts for patients whose genomes carry the variant(s) of interest, would avoid delays in the initiation of drug therapy, and would provide the prescriber with information for all sequence variants in the gene(s) of interest rather than merely a small number of commonly genotyped single nucleotide variants (SNVs) or structural variants such as insertions or deletions and copy number variants.
Table 1Drug–gene pair alerts implemented in the Mayo Clinic EHR by year of implementation
DrugGene(s)Year implementedAbacavirHLA-B∗57:012013AzathioprineTPMT and NUDT15a2013CarbamazepineHLA-B∗15:02 and HLA-A∗31:01
2013CodeineCYP2D62013MercaptopurineTPMT and NUDT15
2013TamoxifenCYP2D62013ThioguanineTPMT and NUDT15
2013TramadolCYP2D62013AllopurinolHLA-B∗58:012014ClopidogrelCYP2C192014SimvastatinSLCO1B12014WarfarinCYP2C9 and VKORC12014CitalopramCYP2C192015EscitalopramCYP2C192015FluvoxamineCYP2D62015FluoxetineCYP2D62015ParoxetineCYP2D62015VenlafaxineCYP2D62015TacrolimusCYP3A52016CapecitabineDPYD2017FluorouracilDPYD2017
A subset of these alerts were designed to fire in a reactive fashion, ie, recommending PGx testing in response to all initial prescriptions, which are as follows: TPMT and NUDT15 for thiopurines (mercaptopurine, azathioprine, and thioguanine), HLA-B∗57:01 for abacavir, HLA-B∗15:02 and HLA-A∗31:01 for carbamazepine in patients of Asian descent, HLA-B∗58:01 for allopurinol in patients of Asian or African decent, and CYP2D6 for tamoxifen. This was done to avoid physician alert fatigue that might have occurred if all of the alerts had been reactive. All other alerts currently fire only for patients who already have PGx information in the EHR. Between March 2015 and December 2018, these alerts fired a total of 6620 times. No comparable data are available after December 2018 because of Mayo Clinic’s implementation of a new EHR.
EHR, electronic health record; PGx, pharmacogenomics.
a NUDT15 added in 2018 and assayed by genotyping.
b HLA-A∗31:01 added in 2018.
As a feasibility test and to identify challenges associated with the application of this approach to the clinical implementation of PGx guidance and—eventually—as a tool to study the clinical utility and economic benefit of preemptive sequence-based PGx, the Mayo Clinic and the Baylor College of Medicine Human Genome Sequencing Center (BCM-HGSC) collaborated to generate DNA sequence data for 77 known or candidate pharmacogenes using a capture panel and DNA from 10,077 patients who received their health care from the Mayo Clinic. Specifically, drug response phenotypes predicted for gene variants included in drug–gene pairs for which alerts currently fire at the Mayo Clinic, were deposited in the EHR to determine whether preemptive sequence-based PGx testing might represent a step toward the broader incorporation of this aspect of clinical genomics into patient care. The DNA sequence information was generated under College of American Pathologists (CAP) and Clinical Laboratory Improvement Amendments (CLIA) standards. This effort was also designed to make it possible to stimulate PGx research studies by taking advantage of clinical drug response information present in the Mayo Clinic EHR. Table 1 lists the 21 drug–gene pairs for which PGx alerts fired across the Mayo Clinic system during the study as well as the year of their implementation. The 77 pharmacogenes that were sequenced for this study are listed in Table 2, with genes highlighted for which gene-related predicted phenotype status (eg, poor metabolizer) were deposited preemptively in the EHR. We chose to clinically implement the data for only those drug–gene pairs that had already undergone rigorous internal peer review for clinical utility—as described subsequently in the Materials and Methods—with the remaining genes being available for inclusion in future research studies to assess their potential clinical utility. The Mayo-Baylor RIGHT 10K Study also made it possible to identify significant institutional infrastructural and educational challenges associated with the implementation of this important aspect of clinical genomics.
Table 2Lists of 77 pharmacogenes that were sequenced for the Mayo-Baylor RIGHT 10K Study
ABCB1CYP2B6DPYDGSTP1KCNH2RYR2SULT1A1ABCC4CYP2C8DRD2HLA-A (∗31:01)KIF6SCN1ATP53ABCG2CYP2C9DRD3HLA-B (∗15:02, ∗57:01, ∗58:01)LDLRSCN5ATPMTADRB2CYP2C19DRD4HMGCRLEPSLC19A1TYMSANKK1CYP2D6EGFRHNF1ALEPRSLC22A1UGT1A1CES1CYP2E1F5HNF4AMTHFRSLC22A2UGT1A3-10 exon1aCFTRCYP2J2FAAHHTR2ANAT2SLC6A4UGT2B15COMTCYP3A4G6PDHTR2COPRM1SLCO1B1UGT2B7CYP1A2CYP3A5GGCXIFNL3 (IL28B)PON1SLCO2B1VEGFACYP2A6CYP4F2GRIK4IGFBP7RYR1SOD2VKORC1
The boldfaced genes symbols are those for which predicted drug metabolism–drug response phenotype data were deposited in the Mayo Clinic EHR for RIGHT 10K subjects.
EHR, electronic health record.
a Please note that multiple UGT1 splice isoforms have been included and that results for CYP1A2, CYP3A4, and UGT1A1 were deposited to the EHR but are not yet part of drug–gene pair alerts at the Mayo Clinic.
Materials and Methods
Study participants
The 10,077 Mayo-Baylor RIGHT 10K Study participants were volunteers who had donated biospecimens and health information to the Mayo Clinic Biobank for research purposes. Details regarding the design of the study have been described elsewhere.15 Demographic information for the study cohort is provided in Table 3.
Table 3Characteristics of the RIGHT 10K participants
Characteristicn (%) N = 10,077Sex Female6146 (61.0) Male3931 (39.0)Age on January 1, 2016, y 18-2458 (0.6) 25-34647 (6.4) 35-44824 (8.2) 45-541299 (12.9) 55-642067 (20.5) 65-743215 (31.9) 75+1967 (19.5)Race White9475 (94.0) Non-White523 (5.2)Black50Asian91AIAN16NHPI0Other and mixed366 Unknown79 (0.8)Ethnicity Non-Hispanic9959 (98.8) Hispanic112 (1.1) Unknown6 (0.1)Self-reported education at time of Biobank Consent (2009-2017) High school graduate or GED or less1261 (12.5) Some college or associates degree (including community college)2935 (29.1) Four-year college graduate (Bachelor’s degree)1991 (19.8) Graduate or professional school3845 (38.2) Unknown45 (0.4)
AIAN, American Indian or Alaska Native; GED, General Educational Development; NHPI, Native Hawaiian or Pacific Islander.
DNA sequencing
Blood was collected and genomic DNA was extracted at the Mayo Clinic for target-enriched capture sequencing at the BCM-HGSC Clinical Laboratory. A new PGx capture reagent (PGx-seq) was designed, constructed, and validated to CAP-CLIA standards for clinical testing. This reagent targeted a combination of complete coding sequences for 77 pharmacogenes and variants present on both the Affymetrix DMET Plus (Affymetrix/Thermo Fisher Scientific) and Illumina VeraCode ADME (Illumina) array genotyping platforms not already addressed by the capture, together with supplementary known PGx and fingerprinting SNVs, as well as regional capture of the CYP2D6 locus that incorporated both of its nearby pseudogenes. In the development of both gene targets and software analysis, a previously characterized cohort of 512 samples was used to validate performance. Those analyses suggested that tag SNVs designed to identify the 4 HLA region allele-types of interest underperformed for 1 allele-type and therefore, Omixon HLA Explore software (Omixon Biocomputing Ltd) was tested and adopted for these loci. For CYP2D6, a software solution designed to identify structural and copy number variants was developed by the Mayo Clinic Personalized Genomics Laboratory (PGL) and implemented for these samples. The resulting average sample sequencing depth was greater than 490. See Supplemental Methods for further details.
Drug–gene pair alerts and clinical decision support
The Mayo Clinic Pharmacogenomics Task Force selected the drug–gene pair alert rules on the basis of peer-reviewed published guidelines from CPIC, the Dutch Pharmacogenetic Working Group, the Pharmacogenetics Knowledgebase, and the FDA as well as advice from intramural clinical specialists. This Task Force also developed the clinical decision support tools required to translate PGx assay results into EHR alerts.
Information technology
The BCM-HGSC and the Mayo Clinic PGL collaborated to identify and 'force call' (override variant caller software to return a locus-specific genotype regardless of conflict with the human reference) 310 potential variant sites defining currently known actionable alleles and developed translation lookup tables specifying drug response–related predicted phenotypes for all reportable genes except CYP2D6. For this gene, software developed in the Mayo Clinic PGL, CNVAR, was used to determine final CYP2D6 predicted phenotypes or, in rare cases, to refer samples for further testing and/or manual review. Software at Baylor was used to filter the Omixon software output to identify relevant HLA allele-types. Further scripts and modifications of existing data pipelines specific to the project were implemented at both institutions. See Supplemental Methods for further detail.
Results
Introduction
The Mayo-Baylor RIGHT 10K Study was designed to test the long-term hypothesis that ready access at the point-of-care to prescribing recommendations on the basis of a patient’s genetic composition would help to optimize that individual’s prescription drug therapy both short and long-term. We also sought to assess the rate of occurrence of rare variants within the PGx genes of participants and the added value of using DNA sequencing, rather than genotyping, for clinical testing. We anticipated that increases in drug efficacy and reduction in the rate of adverse events would result in better patient outcomes and enhanced health care economics as we accumulate cohort outcomes data moving forward. The clinicians caring for the 10,077 participants in the study, predominately primary care physicians, had not ordered PGx testing, and therefore, educational programs had to be designed for all health care team members as well as processes for the return of PGx results to both the health care team and to participating subjects.
Study participant PGx DNA variants
Targeted DNA sequencing for the 10,077 participants in the study, as anticipated, identified a large number of currently clinically actionable PGx variants as well as currently unclassified rare variants in the genomes of every patient (Table 4)—for all 77 genes and for the 13 genes for which alerts fired in the Mayo Clinic EHR during the study. The targeted genomic regions of all but 55 of the 10,077 participants included a clinically actionable variant in at least 1 of the 13 pharmacogenes included in the 21 drug–gene pair alerts (Table 1), whereas 79% of the participants had clinically actionable variants in 3 or more of those 13 genes, as depicted graphically in Figure 1. Therefore, all but 0.6% of the participants, depending on the drugs prescribed by their clinician, would potentially have benefited from PGx information for just these 13 pharmacogenes.
Table 4The total and average number of SNVs/indels in the sequenced samples (N = 10,077)
All CallsDeleterious Callsa: CADD/SIFT
/IntersectionTotal CountsNovel CountsTotal CountsNovel CountsSNVs Number of SNVs10,205,5469,997316462,915/360,310/190,311426,384/346,108/176,148 SNVs/sample1012.8992.145.9/35.8/18.942.3/34.4/17.5 Number of SNVs1,388,8551,219,76093,875/92,352/44,61473,987/80,835/33,136 SNVs/sample137.8121.09.3/9.2/4.47.3/8.0/3.3Indels Number of indels620,215576,06811,749/0/01697/0/0 Indels/sample61.657.21.2/0/00.2/0/0 Number of indels69,78756,3465509/0/00/0/0 Indels/sample6.95.60.6/0/00/0/0
CADD, Combined Annotation Dependent Depletion; CPIC, Clinical Pharmacogenetic Implementation Consortium; Indel, insertion or deletion; SIFT, Sorting Intolerant From Tolerant; SNV, single nucleotide variation.
a Novel counts are total SNV/Indel variant counts excluding those included in the 133 CPIC actionable variants included in the Mayo drug–gene pair alerts along with stop gain, stop loss, and frameshift variants. For this analysis, deleterious has been defined as having CADD score > 20
and/or SIFT score < 0.05.
b SIFT output is limited to frameshift/nonframeshift for indels.
Sequencing vs genotyping
We chose a targeted DNA sequence–based assay for this project to ensure that we tested all target genes comprehensively. The alternative DNA genotyping arrays currently available are, of necessity, designed to only detect variants that have been previously identified. Consequently, available arrays generally represent relatively more common variation and, conversely, fail to represent less common genomic variants, which could—in aggregate—have significant clinical relevance.16
As a proxy for a comparison with the collection of variants available on arrays, we filtered our DNA sequence results to remove common variants already categorized by CPIC as clinically actionable (Table 4). After filtering, on average, each participant carried 127 additional SNVs and insertions or deletions variants for the 13 genes listed in Table 1. Computer analysis (eg, Combined Annotation Dependent Depletion [CADD] and Sorting Intolerant From Tolerant [SIFT]) scores17,
identified an average of 7.3 and 8.0 CADD and SIFT variants, respectively, and 3.3 variants when intersected in each participant as probably deleterious, suggesting a potential clinical impact. A recent report of functional testing by deep mutational scanning in a separate cohort, combined with functional validation of the results, found that 19 of 109 CYP2C9 and 36 of 121 CYP2C19 variants that had been identified by sequencing the genomes of large populations displayed severely damaging phenotypes with protein expression that was <25% of that present for wild-type alleles.
CYP2C9 and CYP2C19 are pharmacogenes that play important roles in variable clinical response to drugs that include warfarin, clopidogrel, and a number of psychiatric drugs. In total, 6 of the subjects included in this study carried functionally severely damaging variants in CYP2C9 other than those that are usually genotyped, whereas the genome of 1 subject carried 2 such variants. The genomes of 25 of our participants included 1 functionally severely damaging variant in their CYP2C19 gene beyond those that are usually genotyped, whereas 1 subject carried 2 such variants. All of these cases would have been missed if only standard genotyping methods had been applied. Variants and alleles with unknown function were evaluated using a modification of American College of Medical Genetics and Genomics variant interpretation criteria. Predicted phenotypes for variants of uncertain significance were expressed as a range (Supplemental Methods).
Application to current therapy
As a first step toward implementation, clinicians caring for patients who were already prescribed medications influenced by variants in genes included in the Mayo Clinic drug–gene pair alerts were informed whenever these initial results suggested that a patient’s drug therapy could potentially be improved by dose adjustment or alternative therapy. If Mayo Clinic pharmacists concluded that the PGx test results indicated either a semiurgent (ie, the drug had the potential to cause serious harm) or a clinically actionable (ie, the drug had the potential to cause an adverse reaction or significantly altered efficacy) need to inform the prescriber, e-consults were sent to the primary care provider. Semiurgent e-consults were sent for 61 patients. The drugs involved were clopidogrel for 41 of the 61 patients (67%), citalopram for 9 of the 61 patients (15%), escitalopram for 7 of the 61 patients (11%), tramadol for 2 of the 61 patients (3%), fluorouracil for 1 of the 61 patients (2%), and allopurinol for 1 of the 61 patients (2%). Providers for those patients accepted 54% of the pharmacists’ semiurgent e-consult recommendations. Viewed more globally, a total of 2782 clinically actionable e-consults were sent out to providers on the basis of the RIGHT 10K sequencing data—a figure that begins to provide insight into the potential benefit if PGx information had been available at the time that medications for those patients had initially been prescribed. Obviously, most of these patients had been on their current therapy regimen for some time, and therefore, their drug therapy might have already been altered in response to either the occurrence of an adverse reaction or lack of efficacy. In addition, the Mayo Clinic has begun collecting evidence of improvement in outcomes traced to the application of the RIGHT 10K results to participant clinical care. Among the several examples in psychiatric patients, 1 participant, found to be a CYP2C19 ultrarapid metabolizer, was switched from an ineffective combination of escitalopram supplemented with bupropion to bupropion monotherapy and is now reported to be in full remission from major depressive disorder. In another example, a participant on combination therapy was found to be a CYP2D6 poor to intermediate metabolizer, resulting in the recommendation that tramadol be replaced or eliminated, resulting in the alleviation of associated dizziness.
Pharmacists and PGx implementation
We found that a team-based approach entailing the involvement of PGx-trained pharmacists, information technology (IT) support for the development of decision support rules and alerts, and effective PGx education programs were all required for the success of this implementation effort. Specifically, the development of PGx test reports that were easily understood by clinicians was essential, along with ensuring that clinicians had access to those reports before they got displayed in patient portals. The Mayo Clinic’s Department of Pharmacy played a key role in many of these processes, but initial expertise in PGx among pharmacists was highly variable. Therefore, a train-the-trainer model21 was applied to ensure that most pharmacists across the Mayo Clinic had been trained in PGx, with early adopters serving as trainers for their colleagues. The Department also established an electronic consultation and recommendation process (the e-consults referred to earlier) to provide patient-specific PGx guidance to providers. Those efforts resulted in a total of 392 of Mayo’s 452 Minnesota licensed pharmacists being trained in PGx, the fact that the Mayo Rochester Pharmacy now includes 3 full-time–PGx specialists, the establishment of an annual Pharmacogenomics Workshop that rotates among the 3 major Mayo Clinic campuses in Minnesota, Florida, and Arizona, a post-graduate year 2 residency training program in Pharmacogenomics for Doctor of Pharmacy graduates, and the launch of an online PGx Certificate Program.
PGx education for medical staff
Previous studies have reported that clinicians often report that lack of education is a major factor limiting their ability to use PGx clinically.22,
,
,
To help address this challenge, multidisciplinary PGx educational content was developed for both practitioners
and pharmacists as outlined earlier. Furthermore, critical components of this content were incorporated into AskMayoExpert, an institutional online knowledge resource that provides Mayo clinicians with point-of-care information on a wide variety of clinical topics. A direct link to the appropriate AskMayoExpert PGx topic was integrated into each EHR drug–gene pair alert together with information on both alternative medications and reference to Mayo Clinic experts who could provide assistance. Finally, case-based education for pharmacists, nurses, and other providers was also developed.
RIGHT 10K Study and PGx research
The RIGHT 10K Study also provided a broad foundation for PGx discovery. The availability of DNA sequence information for 77 pharmacogenes joined with clinical data in the EHR created an unusual opportunity for PGx research. The sequence data were made available to Mayo Clinic investigators on the basis of the submission of a short research protocol that underwent Institutional Review Board and scientific peer review. We have approved 30 protocols that address PGx across a broad spectrum of drug therapies (Supplemental Table 1). An unforeseen bonus of this approach to access has been the fact that the investigators leading those 30 studies have often become both experts in and advocates for PGx within their individual clinical departments and divisions—a development that has assisted with the clinical acceptance and use of PGx at the Mayo Clinic.
PGx 10K participant survey
A survey designed to query knowledge of and attitudes toward PGx was sent to half of the RIGHT 10K Study participants, and 4624 (92.8%) of the invited participants returned the survey. The survey was sent to participants after they had been consented but before they had received their PGx results. Respondents felt that PGx results would help them avoid exposure to medications that might be harmful (Quite Valuable to Extremely Valuable, 94.6%), but relatively few (<18%) expected that their prescription medications or dosages would have to be changed on the basis of the PGx results. In addition, respondents reported low levels of concern regarding potential disruption of their ongoing care and 76% had no or few concerns about the ability of their physician to integrate those results into their care. A follow-up survey is planned after all participants have had an opportunity to discuss the PGx results with their care givers.
Discussion
PGx has long represented one of the most compelling avenues toward bringing DNA-based individualized medicine to clinical care.1,
,
Variability in response to medication has long been observed and expected among both providers and patients, and genetic variability underlying this phenomenon is common. Although a small number of mainly academic medical centers have adopted limited PGx testing protocols and momentum is slowing building within a number of provider networks, broad implementation remains slow for several reasons. These include lack of overall knowledge of the topic and therefore, acceptance among medical providers at all levels; challenges in translating test results to dosing recommendations in patients’ EHRs while not interrupting the clinical workflow; and in the United States, in particular, a reluctance by both private insurance and government entities to reimburse the relatively minor cost involved in testing.
The Mayo-Baylor RIGHT 10K Study represents a systematic effort to integrate preemptive DNA sequence–based PGx panel testing into clinical workflows across a large medical center incorporating a large cohort of patients. This study both builds on previous work and addresses challenges not generally taken on by others. As suggested by previous analyses of both the 1000 Genomes Project27 and, more recently, the UK Biobank
and anticipated in this study, we found that nearly all of the 10,077 study participants could potentially have benefited from preemptive PGx data and its attendant interpretation deposited in the EHR—depending on the drugs that their clinician might prescribe. Of importance, we chose to apply targeted DNA sequencing rather than genotyping to allow us to capture less common genomic variants that could by themselves, or in combination, have significant clinical relevance and did so at a cost that barely exceeded the cost of genotyping. We found that the average patient harbored at least 3 current clinically actionable variants, and a conservatively estimated 3 more variants deemed probably deleterious for only the 13 genes included in our study. The utility of the sequence data was further confirmed by the observation that 55 of 230 variants that we observed in the sequence data for CYP2C9 and CYP2C19 were recently classified as functionally significant,
although they are unlikely to be assayed using currently available genotyping arrays. While the remaining variants are currently classified as variants of uncertain significance, ongoing functional testing is likely to provide reclassification for some of those variants in the future. Clinical testing by sequencing, rather than via genotyping arrays, ensures that as a variant is reclassified, individuals can be informed of those results without the need for repeat testing with new reagents. We acknowledge a geographically driven bias in our cohort as reflected in the Northern European inheritance present for the vast majority of our samples (94%). As a result, we would anticipate that our data for uncharacterized variant frequency represents a lower boundary when these tools are applied to more diverse populations, as outlined by others.
Our study developed both reagents and data analysis software tools that allowed the successful assay and reporting of predicted phenotypes across 2 important but highly polymorphic and difficult assay targets, CYP2D6 and the human HLA region. The former is known to be involved in the metabolism or processing of up to 25% of all drugs currently marketed and the latter is known to be involved in several of the most serious adverse event episodes observed to date. There is little doubt that these loci will continue to play major roles in PGx going forward.
The RIGHT 10K Study also served to highlight a series of challenges associated with the clinical implementation of PGx. For example, we revealed the need to identify health care team interpreters, a role played in this study by Mayo Clinic pharmacists, to act as a conduit between the data, physicians, and patients. In addition, there was a critical need for IT support to build and implement the data pipelines that enable the identification of multiple DNA variant types and the translation of diplotypes to alleles as well as clinical decision support software that integrates smoothly with EHR packages. We also learned where needs existed and developed solutions within Mayo’s educational infrastructure. Approaches to address these challenges will differ depending on the local environment of individual medical institutions or provider networks, but having professional staff who can play the interpretive, evaluative, and educational role taken on by the Mayo Clinic pharmacists, such as physicians assistants, nurse practitioners, or genetic counselors in other health care institutional settings, plus the availability of clinical decision support tools, will be required to deliver PGx information to clinical staff quickly, clearly, and without requiring that they be familiar with genomic science or the underlying data.
In summary, the Mayo-Baylor RIGHT 10K Study strongly suggests that preemptive sequence-based PGx panel implementation can be useful clinically—especially if delivered at the point-of-care when drugs are being prescribed—and that it would apply to almost every patient. These results may also be helpful to other medical centers as they consider how or whether they wish to implement preemptive sequence-based PGx panels. This study also serves as an important stepping-stone in the development of the infrastructure necessary to fully use the coming incorporation of genome sequencing as opposed to targeted sequencing in helping to guide clinical care. We should point out that the FDA has voiced some concerns with regard to PGx, particularly direct to consumer PGx testing and the possible extension of the application of test results beyond supporting clinical evidence.16,
All testing described in this article was conducted in a CAP-CLIA environment with clinician supervision of every aspect of the study. Furthermore, all test interpretations rested on validated consensus-based guidelines.
,
,
,
It should also be emphasized that PGx will continue to evolve. For example, the future will almost certainly include the application of machine learning–based predictive algorithms that use both clinical and genomic information joined with other types of data that will extend well beyond genotypes for the small number of genes included in the drug–gene pair alerts listed in Table 1.
Finally, although PGx has not yet been broadly adopted in the clinic, it clearly offers the promise of ultimately becoming a standard component of clinical practice that will help the health care team optimize pharmacotherapy for all patients.
Data Availability
As outlined by Bielinski et al,15,
the RIGHT cohort is a resource for pharmacogenomic research. As stated earlier, a RIGHT Data Access Committee has been created to review data requests for use of RIGHT data. External access to the data is facilitated by the Mayo Clinic Biobank (https://www.mayo.edu/research/centers-programs/mayo-clinic-biobank/overview). All potentially damaging variants observed in this study are presented with annotation in Supplemental Table 2. The software developed in this study primarily represents output/input wrappers or filtering scripts and is described in Supplemental Methods. The privately developed CNVAR software (submitted for patent) was conceived and refined on the basis of the genomic targets specified by the PGx capture reagent (PGx-seq) and would need extensive adjustments for other captures. However, those interested in using CNVAR may contact the authors to determine whether the software could be applied to their data set. Omixon HLA Explore is commercially available, whereas the remaining underlying software is available at https://www.hgsc.bcm.edu/software.
Conflict of Interest
Liewei Wang, John Logan Black III, and Richard M. Weinshilboum are cofounders of and stockholders in OneOme, LLC, which was used only to return results to the study participants. Additionally, John Logan Black III and Mayo Clinic Ventures have applied for a patent on the CNVAR software cited in this study as well as the methodology upon which the software is based. All other authors declare no conflicts of interest.
Acknowledgments
This work was supported by the Mayo Clinic Center for Individualized Medicine; the Mayo Clinic Robert D. and Patricia E. Kern Center for the Science of Health Care Delivery; Mayo Clinic Pharmacy Services; the Augeo Foundation; the; Satter Foundation; Bernard E. and Edith B. Waterman; William G. Little; Roche Diagnostics Corporation; National Science Foundation 2041339; National Institutes of Health grants U19 GM61388 (The Pharmacogenomics Research Network), R01 GM28157, U01 HG005137, R01 GM125633, R01 AG034676 (The Rochester Epidemiology Project), and U01 HG06379 and U01 HG06379 Supplements (The Electronic Medical Record and Genomics [eMERGE] Network).
The funders/sponsors had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; or the decision to submit the manuscript for publication.
We wish to thank Duan Liu (Mayo Clinic) for his assistance with the preparation of this manuscript, and Michele J. Swift (Mayo Clinic) for her administrative assistance. Compensation was not received for their contributions.
Author Information
Conceptualization: Lie.W., S.J.B., R.M.W., R.A.G., E.B., S.E.S; Data Curation: E.V., X.Q., J.M.V.P., C.M.F., A.S.; Formal Analysis: Lie.W., S.J.B., D.M.M., S.E.S., X.Q., K.W., T.-J.W., Q.W., D.K., J.L.BIII., A.M.M., M.B.K., K.J.H., H.S., S.E.P., J.E.O., K.R.K., N.B.L., H.L., Liw.W., G.S.L., B.J.B., R.R.F., Y.Z., D.J.J., M.A.H., S.M.A., M.E.M., R.J.; Funding Acquisition: R.M.W., R.A.G.; Investigation: S.J.B., R.M.W., D.M.M., S.E.S., J.L.BIII., A.M.M., T.B.C.; Methodology: Lie.W., S.J.B., M.W., J.L.S., R.M.W., E.B., D.M.M., S.E.S., E.V., X.Q., J.H., C.L.K., K.W., J.L.BIII., A.M.M., A.E.B., B.E.M., J.M.S., M.L.K., K.E.K., K.K., W.T.N., J.G., H.M., P.J.C., A.K., A.E., D.B., M.J.S., Ch.G., S.E., A.U., Le.W., S.C., E.A.N., S.L., M.E., S.G.P., N.P., M.F., F.S., M.P.G., I.J.K., K.N.L., R.W., J.A.A., E.T.M., J.A.W., C.M.F., R.M.E.M, J.D.Z., J.R.H., C.A.K., R.W.H., J.L.T., T.B.C., T.M.M., C.R.R.V., S.R.S.T, I.A., M.E.B., S.R.F., A.G., P.L.G., T.M.J., P.T., M.B., K.F.-S., N.R.N., A.K.R., D.M.R., J.W., R.R.S.; Project Administration: Lie.W., S.J.B., L.A.J., M.W., T.S., J.L.S., R.M.W., R.A.G., E.B., D.M.M., S.E.S., C.L.K., V.K., J.L.BIII., A.M.M., W.T.N., J.G., P.J.C., S.E., K.N.L., L.J.O., E.T.M., J.A.W., T.B.C., T.M.M., C.R.R.V., R.R.S.; Resources: S.J.B., H.D., R.R., S.D., W.L., G.C., L.Z., A.E.B., J.M.V.P., S.C.Z., S.B., Co.G., M.L.P., J.E.P., J.E.O., E.J.S., A.T.B., C.H.; Software: M.W., E.V., X.Q., K.W., T.-J.W., J.L.BIII., K.J.H., H.S., S.E.P., J.M.V.P., J.S., A.S., T.H.K., J.L.R., M.G.H., K.B., B.R., I.S.; Supervision: Lie.W., S.J.B., L.A.J., M.W., T.S., J.L.S., R.M.W., R.A.G., E.B., D.M.M., S.E.S., E.V., J.H., K.W., H.D., R.R., W.L., J.L.BIII., A.E.B., K.K., W.T.N., H.M., P.J.C., M.E., S.G.P., N.P., M.F., F.S., M.P.G., I.J.K., K.N.L., R.W., L.J.O., T.B.C., T.M.M., C.R.R.V., I.A., M.E.B., R.R.S., N.B.L.; Validation: D.M.M., S.E.S., E.V., X.Q., J.H., C.L.K., V.K., K.W., T.-J.W., R.R., S.D., W.L., G.C., L.Z., Q.W., D.K., J.L.BIII., M.B.K.; Writing-original draft: Lie.W., S.J.B., R.M.W., R.A.G., S.E.S., E.V., X.Q., J.H., V.K.; Writing-review and editing: Lie.W., S.E.S., S.J.B., D.M.M., L.A.J., J.L.BIII., A.M.M., J.G., R.R.S., E.T.M., J.A.W., L.J.O., W.T.N., M.W., T.S., T.B.C., C.R.R.V., T.M.M., J.L.S.S., P.J.C., K.N.L., E.V., X.Q., J.H., C.L.K., V.K., K.W., H.D., T.-J.W., R.R., S.D., W.L., G.C., L.Z., Q.W., D.K., M.B.K., K.J.H., H.S., S.E.P., A.E.B., B.E.M., J.M.S., M.L.K., K.E.K., K.K., J.M.V.P., H.M., J.A.S., A.K., A.E., D.M.B., M.J.S., Ch.G., S.E., A.U., Le.W., S.C., E.A.N., S.L., M.E., S.G.P., N.P., M.F., F.S., M.P.G., I.J.K., R.W., J.A.A., C.M.F., R.M.E.M., J.D.Z., J.R.H., C.A.K., R.W.H., J.L.T., S.R.S.T., I.A., M.E.B., S.R.F., A.G., P.L.G., T.M.J., P.T., S.C.Z., S.B., M.B., Co.G., K.F.-S., N.R.N., M.L.P., A.K.R., D.M.R., A.S., J.W., J.E.P., J.E.O., E.J.S., A.T.B., C.H., K.R.K., N.B.L., H.L., Liw. W., G.S.L., B.J.B., R.R.F., Y.Z., D.J.J., M.A.H., S.M.A., M.E.M., R.J., T.H.K., J.L.R., M.H., K.B., B.R., I.S., E.B., R.A.G., R.M.W.
Ethics Declaration
All participants in this study were recruited from the Mayo Clinic Biobank and informed consent was obtained under Mayo Clinic Institutional Review Board approval. Participants agreed to the use of their stored Biobank samples for clinical pharmacogenomic testing, deposit of pharmacogenomic results into their electronic health record for clinical use, and use of de-identified pharmacogenomic data for research. For more information on both the Biobank (https://www.mayo.edu/research/centers-programs/mayo-clinic-biobank/about/governance-oversight) and the RIGHT cohort, please see Bielinski et al.15
Supplementary Material
- Download .pdf (.18 MB)
- Help with pdf files
- Supplementary Methods, and Supplementary Table 1
- Download .xlsx (.64 MB)
- Help with xlsx files
- Supplementary Table 2
References
- Weinshilboum R.M.
- Wang L.
- Pharmacogenomics: precision medicine and drug response.
- Mayo Clin Proc. 2017; 92: 1711-1722https://doi.org/10.1016/j.mayocp.2017.09.001
- View in Article
- Scopus (127)
- PubMed
- Abstract
- Full Text
- Full Text PDF
- Google Scholar
- Wang L.
- McLeod H.L.
- Weinshilboum R.M.
- Genomics and drug response.
- N Engl J Med. 2011; 364: 1144-1153https://doi.org/10.1056/NEJMra1010600
- View in Article
- Scopus (524)
- PubMed
- Crossref
- Google Scholar
- Roden D.M.
- Van Driest S.L.
- Wells Q.S.
- Mosley J.D.
- Denny J.C.
- Peterson J.F.
- Opportunities and challenges in cardiovascular pharmacogenomics: from discovery to implementation.
- Circ Res. 2018; 122: 1176-1190https://doi.org/10.1161/CIRCRESAHA.117.310965
- View in Article
- Scopus (22)
- PubMed
- Crossref
- Google Scholar
- Marrero R.J.
- Cicali E.J.
- Arwood M.J.
- et al.
- How to transition from single-gene pharmacogenetic testing to preemptive panel-based testing: a tutorial.
- Clin Pharmacol Ther. 2020; 108: 557-565https://doi.org/10.1002/cpt.1912
- View in Article
- Scopus (24)
- PubMed
- Crossref
- Google Scholar
- van der Wouden C.H.
- Cambon-Thomsen A.
- Cecchin E.
- et al.
- Implementing pharmacogenomics in Europe: design and implementation strategy of the Ubiquitous Pharmacogenomics Consortium.
- Clin Pharmacol Ther. 2017; 101 (Published correction appears in Clin Pharmacol Ther. 2017;102(1):152.): 341-358
- https://doi.org/10.1002/cpt.602
- View in Article
- Scopus (199)
- PubMed
- Crossref
- Google Scholar
- Barbarino J.M.
- Whirl-Carrillo M.
- Altman R.B.
- Klein T.E.
- PharmGKB: a worldwide resource for pharmacogenomic information.
- Wiley Interdiscip Rev Syst Biol Med. 2018; 10: e1417https://doi.org/10.1002/wsbm.1417
- View in Article
- Scopus (174)
- PubMed
- Crossref
- Google Scholar
- Gaedigk A.
- Ingelman-Sundberg M.
- Miller N.A.
- et al.
- The Pharmacogene variation (PharmVar) consortium: incorporation of the human cytochrome P450 (CYP) allele nomenclature database.
- Clin Pharmacol Ther. 2018; 103: 399-401https://doi.org/10.1002/cpt.910
- View in Article
- Scopus (277)
- PubMed
- Crossref
- Google Scholar
- Relling M.V.
- Klein T.E.
- Gammal R.S.
- Whirl-Carrillo M.
- Hoffman J.M.
- Caudle K.E.
- The clinical pharmacogenetics implementation consortium: 10 years later.
- Clin Pharmacol Ther. 2020; 107: 171-175https://doi.org/10.1002/cpt.1651
- View in Article
- Scopus (165)
- PubMed
- Crossref
- Google Scholar
- Swen J.J.
- Nijenhuis M.
- van Rhenen M.
- et al.
- Pharmacogenetic information in clinical guidelines: the European perspective.
- Clin Pharmacol Ther. 2018; 103: 795-801https://doi.org/10.1002/cpt.1049
- View in Article
- Scopus (59)
- PubMed
- Crossref
- Google Scholar
- Table of pharmacogenomic biomarkers in drug labeling. US Food and Drug Administration.
- (Updated August 18, 2020.)
- https://www.fda.gov/drugs/science-and-research-drugs/table-pharmacogenomic-biomarkers-drug-labeling
- (Accessed January 29, 2020.)
- View in Article
- Google Scholar
- Lupski J.R.
- Belmont J.W.
- Boerwinkle E.
- Gibbs R.A.
- Clan genomics and the complex architecture of human disease.
- Cell. 2011; 147: 32-43https://doi.org/10.1016/j.cell.2011.09.008
- View in Article
- Scopus (283)
- PubMed
- Abstract
- Full Text
- Full Text PDF
- Google Scholar
- O’Donnell P.H.
- Wadhwa N.
- Danahey K.
- et al.
- Pharmacogenomics-based point-of-care clinical decision support significantly alters drug prescribing.
- Clin Pharmacol Ther. 2017; 102: 859-869https://doi.org/10.1002/cpt.709
- View in Article
- Scopus (63)
- PubMed
- Crossref
- Google Scholar
- Hicks J.K.
- Stowe D.
- Willner M.A.
- et al.
- Implementation of clinical pharmacogenomics within a large health system: from electronic health record decision support to consultation services.
- Pharmacotherapy. 2016; 36: 940-948https://doi.org/10.1002/phar.1786
- View in Article
- Scopus (88)
- PubMed
- Crossref
- Google Scholar
- Caraballo P.J.
- Bielinski S.J.
- St Sauver J.L.
- Weinshilboum R.M.
- Electronic medical record-integrated pharmacogenomics and related clinical decision support concepts.
- Clin Pharmacol Ther. 2017; 102: 254-264https://doi.org/10.1002/cpt.707
- View in Article
- Scopus (60)
- PubMed
- Crossref
- Google Scholar
- Bielinski S.J.
- St Sauver J.L.
- Olson J.E.
- et al.
- Cohort profile: the right drug, right dose, right time: using genomic data to individualize treatment protocol (RIGHT protocol).
- Int J Epidemiol. 2020; 49: 23-24khttps://doi.org/10.1093/ije/dyz123
- View in Article
- Scopus (32)
- PubMed
- Crossref
- Google Scholar
- Clinical Pharmacogenetics Implementation Consortium
- FDA and pharmacogenomics. Clinical Pharmacogenetics Implementation Consortium. August 2, 2019.
- https://cpicpgx.org/wp-content/uploads/2019/08/fda-and-pgen-2019.pdf
- Date accessed: April 27, 2020
- View in Article
- Google Scholar
- Kircher M.
- Witten D.M.
- Jain P.
- O’Roak B.J.
- Cooper G.M.
- Shendure J.
- A general framework for estimating the relative pathogenicity of human genetic variants.
- Nat Genet. 2014; 46: 310-315https://doi.org/10.1038/ng.2892
- View in Article
- Scopus (4018)
- PubMed
- Crossref
- Google Scholar
- Kumar P.
- Henikoff S.
- Ng P.C.
- Predicting the effects of coding non-synonymous variants on protein function using the SIFT algorithm.
- Nat Protoc. 2009; 4: 1073-1081https://doi.org/10.1038/nprot.2009.86
- View in Article
- Scopus (5192)
- PubMed
- Crossref
- Google Scholar
- Zhang L.
- Sarangi V.
- Moon I.
- et al.
- CYP2C9 and CYP2C19: deep mutational scanning and functional characterization of genomic missense variants.
- Clin Transl Sci. 2020; 13: 727-742https://doi.org/10.1111/cts.12758
- View in Article
- Scopus (24)
- PubMed
- Crossref
- Google Scholar
- Lopes J.L.
- Harris K.
- Karow M.B.
- et al.
- Targeted genotyping in clinical pharmacogenomics: what is missing?.
- J Mol Diagn. 2022; 15 (:S1525-1578(22)00006-X. https://doi.org/10.1016/j.jmoldx.2021.11.008)
- View in Article
- Google Scholar
- Formea C.M.
- Nicholson W.T.
- Vitek C.R.
- et al.
- Implementation of a pharmacogenomics education program for pharmacists.
- Am J Health Syst Pharm. 2018; 75: 1939-1946https://doi.org/10.2146/ajhp170771
- View in Article
- Scopus (14)
- PubMed
- Crossref
- Google Scholar
- Stanek E.J.
- Sanders C.L.
- Taber K.A.
- et al.
- Adoption of pharmacogenomic testing by US physicians: results of a nationwide survey.
- Clin Pharmacol Ther. 2012; 91: 450-458https://doi.org/10.1038/clpt.2011.306
- View in Article
- Scopus (335)
- PubMed
- Crossref
- Google Scholar
- St Sauver J.L.
- Bielinski S.J.
- Olson J.E.
- et al.
- Integrating pharmacogenomics into clinical practice: promise vs reality.
- Am J Med. 2016; 129: 1093-1099.e1https://doi.org/10.1016/j.amjmed.2016.04.009
- View in Article
- Scopus (56)
- PubMed
- Abstract
- Full Text
- Full Text PDF
- Google Scholar
- Johansen Taber K.A.
- Dickinson B.D.
- Pharmacogenomic knowledge gaps and educational resource needs among physicians in selected specialties.
- Pharmgenomics Pers Med. 2014; 7: 145-162https://doi.org/10.2147/PGPM.S63715
- View in Article
- Scopus (112)
- PubMed
- Crossref
- Google Scholar
- Haga S.B.
- Burke W.
- Ginsburg G.S.
- Mills R.
- Agans R.
- Primary care physicians’ knowledge of and experience with pharmacogenetic testing.
- Clin Genet. 2012; 82: 388-394https://doi.org/10.1111/j.1399-0004.2012.01908.x
- View in Article
- Scopus (208)
- PubMed
- Crossref
- Google Scholar
- Giri J.
- Curry T.B.
- Formea C.M.
- Nicholson W.T.
- Rohrer Vitek C.R.
- Education and knowledge in pharmacogenomics: still a challenge?.
- Clin Pharmacol Ther. 2018; 103: 752-755https://doi.org/10.1002/cpt.1019
- View in Article
- Scopus (32)
- PubMed
- Crossref
- Google Scholar
- Wright G.E.B.
- Carleton B.
- Hayden M.R.
- Ross C.J.D.
- The global spectrum of protein-coding pharmacogenomic diversity.
- Pharmacogenomics J. 2018; 18: 187-195https://doi.org/10.1038/tpj.2016.77
- View in Article
- Scopus (55)
- PubMed
- Crossref
- Google Scholar
- McInnes G.
- Lavertu A.
- Sangkuhl K.
- Klein T.E.
- Whirl-Carrillo M.
- Altman R.B.
- Pharmacogenetics at scale: an analysis of the UK Biobank.
- Clin Pharmacol Ther. 2021; 109: 1528-1537https://doi.org/10.1002/cpt.2122
- View in Article
- Scopus (57)
- PubMed
- Crossref
- Google Scholar
- US Food and Drug Administration
- Evaluation of automatic class III designation for The 23andMe Personal Genome Service (PGS) Pharmacogenomic reports. US Food and Drug Administration.
- https://www.accessdata.fda.gov/cdrh_docs/reviews/DEN180028.pdf
- (Accessed April 27, 2020.)
- View in Article
- Google Scholar
- Athreya A.P.
- Neavin D.
- Carrillo-Roa T.
- et al.
- Pharmacogenomics-driven prediction of antidepressant treatment outcomes: a machine-learning approach with multi-trial replication.
- Clin Pharmacol Ther. 2019; 106: 855-865https://doi.org/10.1002/cpt.1482
- View in Article
- Scopus (63)
- PubMed
- Crossref
- Google Scholar
- Bielinski S.J.
- Olson J.E.
- Pathak J.
- et al.
- Preemptive genotyping for personalized medicine: design of the right drug, right dose, right time-using genomic data to individualize treatment protocol.
- Mayo Clin Proc. 2014; 89: 25-33https://doi.org/10.1016/j.mayocp.2013.10.021
- View in Article
- Scopus (229)
- PubMed
- Abstract
- Full Text
- Full Text PDF
- Google Scholar
- Article info
- Publication history
- Published online: March 21, 2022
- Accepted: January 26, 2022
- Received in revised form: January 25, 2022
- Received: December 23, 2021
- Footnotes
- Liewei Wang, Steven E. Scherer, and Suzette J. Bielinski contributed equally.
- Eric Boerwinkle, Richard A. Gibbs, and Richard M. Weinshilboum are co–final authors.
- Identification
- DOI: https://doi.org/10.1016/j.gim.2022.01.022
- Copyright
- © 2022 American College of Medical Genetics and Genomics. Published by Elsevier Inc.
- User license
- Elsevier user license |
- How you can reuse
- ScienceDirect
- Access this article on ScienceDirect
- Figures
- Figure 1Percentage of study subjects harboring clinically actionable PGx variants. The figure shows the number of genes that contained clinically actionable genomic variants for the 13 genes included in the drug–gene pair alerts listed in Table 1 that were observed in each of the 10,077 RIGHT 10K Study subjects and the percentage of study subjects included in each group. A. The pie chart shows these data graphically, whereas the table in (B.) lists the information upon which the pie chart is based.
- Tables
- Table 1Drug–gene pair alerts implemented in the Mayo Clinic EHR by year of implementation
- Table 2Lists of 77 pharmacogenes that were sequenced for the Mayo-Baylor RIGHT 10K Study
- Table 3Characteristics of the RIGHT 10K participants
- Table 4The total and average number of SNVs/indels in the sequenced samples (N = 10,077)
- Related Articles
- A model-based cost-effectiveness analysis of pharmacogenomic panel testing in cardiovascular disease management: preemptive, reactive, or none?
- Zhu et al.
- Genetics in Medicine
- Preview
- Full-Text
- Open Access
- Preemptive pharmacogenetic testing: exploring the knowledge and perspectives of US payers
- Keeling et al.
- Genetics in Medicine
- Preview
- Full-Text
- Open Archive
- OP041: Implementation of 2019 ACMG technical standards for the interpretation and reporting of constitutional CNVs: Experiences from an academic reference laboratory
- Zhao et al.
- Genetics in Medicine
- Preview
- Full-Text
- Open Archive
- Participant-perceived understanding and perspectives on pharmacogenomics: the Mayo Clinic RIGHT protocol (Right Drug, Right Dose, Right Time)
- Olson et al.
- Genetics in Medicine
- Preview
- Full-Text
- Open Archive
- Implementing digital systems to facilitate genetic testing for hereditary cancer syndromes: An observational study of 4 clinical workflows