Journal List > Korean Circ J > v.43(7) > 1017057

Lee, Flammer, and Lerman: The Decline Effect in Cardiovascular Medicine: Is the Effect of Cardiovascular Medicine and Stent on Cardiovascular Events Decline Over the Years?

Abstract

The term decline effect is referred to a diminution of scientifically discovered effects over time. Reasons for the decline effect are multifaceted and include publication bias, selective reporting, outcomes reporting bias, regression to the mean, scientific paradigm shift, overshadowing and habituation, among others. Such effects can be found in cardiovascular medicines through medications (e.g., aspirin, antithrombotics, proton pump inhibitor, beta-blockers, statins, estrogen/progestin, angiotensin converting enzyme inhibitor etc.), as well as with interventional devices (e.g., angioplasty, percutaneous coronary intervention, stents). The scientific community should understand the various dimensions of the decline effects, and effective steps should be undertaken to prevent or recognize such decline effects in cardiovascular medicines.

Introduction

In the 1930s, the term of 'decline effect' was first discovered, statistical significances of purported evidence for psychic ability declined as studies were repeated within parapscychology. Jonathan Schooler defined that 'decline effect' refers to scientifically discovered effects published in the literature which diminish with time and/or when tests are repeated.1) In other scopes, several scientific results were rigorously proven and acceptance levels decreased in later studies.2) It mean decline effect size statistically over time. Issues arose from Jonah Lehrer's article on decline effects, while many scientists pointed out meaningful implications to medicines, especially for cardiovascular medicines. Because pharmaceutical drugs and interventional devices in cardiovascular diseases (CVDs) cannot ignore declining effects, controversial debates on the application of drugs and devices continued.
This effect is originated from more complicated and multi-dimensional causes. The most likely explanation for the decline regression suggests that some scientists attribute decline effects to initial self-corrected exaggerated outcomes. If early results are reported when errors were combines to magnify the apparent effects, then published studies are likely to indicate systematic bias towards the initially exaggerated findings, which are subsequently self-corrected.1) Such tendency of the scientists knowing the ideal results may influence the possible results received. Replicated tests are probably corrections of these flaws. If results of falsification are written in textbooks, it cannot be proven.
Academic incentive modifications after the scientific paradigm repositions will disapprove the theory. After a new paradigm is proposed, the peer review process will be tilted toward positive results.
In a consecutive experiment by Jonathan Schooler, he called such phenomenon of verbal overshadowing and habituation. Joseph Bank Rhine called this decline effect which diminished over time through his experiments on sensory perception ability tests. And he also tested a parapsychological phenomenon known as precognition.
Jennions and Theodore Sterling commented that decline effect is majority of publication bias, selective reporting, and outcome reporting bias.3)4)
Publication bias also plays key role in the decline effect. Tendencies of scientists and scientific journals indicate preference of positive data over null results. Publication bias can distort the available evidence on research questions, which leads to misleading inferences within reviews and meta-analysis.5) Palmer6) reported that smaller sample sizes were not random at all but skewed heavily towards positive results, and selective reporting was one of the subtle omissions and unconscious misperceptions, as researchers struggle to make sense of their results. Ioannidis claimed that selective reporting is rooted in fundamental cognitive flaws, similarly in situations where we tend to prove ourselves right and avoid the facts of being wrong, especially when related to our careers. Other explanation for decline effects include unreported aspects of methods.1) If exclusive results were reported first, then the next researcher may use rigorous methodologies in the later study, and thus resulting errors due to experimental bias and failures of replicated study.
John Crabbe performed a series of experiments and addressed that many extraordinary scientific data are nothing but noise.7) The decline effect is actually a decline of illusion.

Cardiovascular Medicine

Ioannidis found that forty-one percent had either been directly contradicted or had their effect sizes significantly downgraded in the evaluation study for original clinical search studies in 3 major general clinical journals and high-impact-factor specialty journals in 1990-2003 and have been cited more than 1000 times in the literature.8) The trials with contradicted or initially strong effects had significantly smaller sample sizes and tended to be older than those with replicated or unchallenged findings.
The cardiovascular fields are worth noting within this report. Subjects of his study included 49 highly-cited original clinical research studies in which 31 (63.3%) were of cardiovascular fields. From the 31 eligible highly cited studies with efficacy claims, 5 (16.1%) were contradicted by subsequent research, and another 4 (12.9%) were found to have initially stronger effects. In all these 9 cases, subsequent studies were either larger or better controlled. The results of 13 highly cited articles (41.9%) were replicated and 6 (19.4%) had remained unchallenged.8)
Initial cohort study and small randomized trials on the estrogen/progestin reported a 44% relative risk reduction9) and major beneficial effects10) in coronary heart disease (CHD), but large randomized trials found that estrogen and progestin significantly increased the relative risk of coronary events by 29% among postmenopausal women11) with refuting results.12)
In case of vitamin E, initial studies reported significant associations with decreased risk of coronary artery disease (CAD)13)14) and a 47% relative risk reduction for cardiovascular deaths or CHD,15) however large randomized clinical trials (RCTs) showed no beneficial effects of vitamin E for CAD.16) The early study results showed that immediate angioplasty achieved a 58% relative risk reduction for death or reinfarction,17) but a subsequent studies suggested that the benefit is probably much smaller (30%) and does not show any sizeable benefit.18) Two randomized trials showed that stents can reduce with 31% and 42% relative risk for revascularization,19)20) but next meta-analysis suggested that the benefit is probably much smaller (approximately 10%) due to unblinding designs.21) In studies of flavonoids, an effect to reduce relative risks for CAD from 68% in initial studies22) to only 20% in subsequent meta-analysis of prospective cohorts.23)

Aspirin

Aspirin for the primary preventions of CHD have always been controversial.24)25) The primary preventive application of aspirin depends on the benefit and the risk of adverse events induced by aspirin in adults at risk for CHD. The overall benefit in the reduction of CVD events with aspirin use depends on baseline CVD risks and risks for gastrointestinal bleeding.26) There were several trials and meta-analysis on the effect of aspirin to prevent CHD. They found that aspirin for primary prevention of CHD was beneficial among patients with high risk but not for clinical CVD.
In 2002, the United States Preventive Services Task Force (USPSTF) concluded that aspirin of primary prevention for high-risk patients reduces the risk of CHD by 28%, and strongly recommended that clinicians discuss aspirin preventions with adults for increased CHD risk, defined as a 5-year risk of 3% or more.27)
In 2008, a meta-analysis of about 10000 patients with stable CVD also support benefit. Thus, aspirin remains an essential part of the treatment and secondary prevention of ischemic syndromes.
The USPSTF found good evidence26) that aspirin decreases the incidence of myocardial infarction (MI). In 2011, the USPSTF recommends the use of aspirin for men aged 45 to 79 years when potential benefits due to a reduction in MIs outweighs the potential harms due to an increase in gastrointestinal hemorrhage. And the USPSTF concludes that the current evidence is insufficient to assess the balance of benefits and harms of aspirin for CVD prevention in men and women of 80 years or older. The USPSTF recommends against the use of aspirin for MI prevention for men younger than 45 years.28) Shared decision making is strongly encouraged with persons whose risk is close to these estimates of 10-year risk levels. As the potential CVD reduction benefit increases above harms, the recommendation to take aspirin should become stronger. Current guidelines do not recommend aspirin therapy in low-risk subjects. Despite these data, the role of aspirin in primary preventions continues to be investigated.29)
The debate on the optimal dose of aspirin for patients undergoing revascularization or after an acute coronary syndrome (ACS) event continues. Large scaled randomized trials were conducted after the mid-2000s.30)31) In the absence of recurrent ischemia, low-dose aspirin should be the treatment of choice for maintenance therapy within all patients following ACS, irrespective of whether an invasive of medical approach is undertaken or not.32)

Antithrombotics

Risks of antithrombotic therapies remain due to the result of multifaceted interactions among patients' co-morbidities, drug combinations, multifaceted dosing adjustments, and the complexity of the care environment despite great advances. Thus, many challenges exist in developing antithrombotic drugs. Acute care setting: treating patients early, complexity of health systems, length of stay, drug combinations, monitoring effects, interplay with invasive strategy, patient comorbidities, dosing and bleeding. Pharmacodynamics/pharmacokinetics outcomes in acute care setting: bleeding and tolerability, adherence issues and costs, events over time, patient comorbidities, monitoring effects, drug combinations, surgeries and procedures, multiple providers. Pharmacodynamics/pharmacokinetics outcomes in chronic care setting.33)
Intravenous Glycoprotein IIb/IIIa Inhibitors (GPIs) are potent antiplatelet agents that inhibit fibrinogen-mediated platelet aggregation. GPIs is recommended in cases of moderate or high-risk non-ST-segment elevation acute coronary syndromes (NSTE-ACS), especially when an early invasive strategy is planned.33)
Clopidogrel bisulfate is a thienopyridine derivative, which is adenosine diphosphate antagonist for the P2Y12 receptors. Combined therapies of clopidogrel and aspirin has become the standard adjunctive regimen in prevention of thrombotic events after intracoronary stenting.34)35) Clopidogrel is a well-known drug that has a wide inter-individual variability which is determined according to genetics, patient's characteristics, and interactions with proton pump inhibitors (PPIs), although the latter remains controversial.36) Questions of appropriate dosing, length of therapy, and use of combination therapy are the most pressing and considerable debates regarding the variability of response to antiplatelet therapy, including the definition, measurement, and clinical relevance of responsiveness. Despite of the exist controversies, antilpatelet therapy with aspirin and/or clopidogrel remains a proven and essential therapeutic tool for safe and effective management of atherothrombotic risk in specific clinical setting.37)
Despite the paradigm shift for additional therapy of clopidogrel to aspirin therapy, clopidogrel has certain limitations which are related with adverse thrombotic events for variability in patients with CYP2C19*2 genetic polymorphisms.32) New P2Y12 receptor antagonists of adenosine diphosphate (prasugrel, ticagrelor) confer greater platelet inhibitions than clopidogrel. However, greater and faster platelet inhibitory medicine like cangrelor and elinogrel comes with an increased risk of hemorrhagic complications. And P2Y12 receptor antagonists have reduced use of GPIs, which block the final pathway leading to platelet aggregation and thrombosis. A further study to determine such way into clinical use will be necessary.
Low molecular weight heparins (LMWHs) are fragments of unfractioned heparin (MW: approximately 5000 daltons) that exert their anticoagulant effects indirectly via antithrombin. There have been several studies evaluating LMWHs in the setting of additional adjunctive pharmacologic therapies,38-40) further questions remain regarding the use of LMWHs in other settings. Direct thrombin inhibitors (DTIs) act by binding to thrombin, blocking the formation of fibrin from fibrinogen by action of thrombin and the feedback activation of coagulation factors by thrombin, and inhibit the thrombin-induced components of platelet aggregation. However, LMWHs may lead to the risk of rebound because upstream prothrombotic elements may accumulate during DTI activities conceptually. Several kinds of DTIs are being examined in clinical trials which evaluate the use in deep venous thrombosis, ischemic heart disease, and atrial fibrillation (AF). The developments of effective, safe and orally available DTIs have always been a major challenge for the pharmaceutical industry.33) New anticoagulants can be divided into 3 groups based on their primary target in coagulation cascades: inhibitors of initiation of coagulation, inhibitors of the propagation of coagulation, and thrombin inhibitors. Nimjee et al.41) suggests that anticoagulation can be readily and predictably achieved and that the effects can be immediately reversed when administering an appropriately designed/matched antidote which also relies upon the aptamer technology. As new therapies are introduced, rigorous evidences will be essential to ensure improved patient care with both the current and new antithrombotics.33)

Anticoagulant with Aspirin

There are little evidences in combination warfarin-acetylsalicylic acid (ASA) therapy for the presence of both chronic fibrillation and CAD despite of its widespread use. Such combination therapy confers therapeutic benefits compared with warfarin alone, however approximately 1.5- to 2-fold increased risk for serious bleeding.42) Combination therapy should be used cautiously in selected patients who have an acute coronary event, a recent percutaneous coronary intervention (PCI) or coronary artery bypass in whom an antiplatelet drug may be of benefit to prevent acute coronary in-stent or bypass graft thrombosis. There are recent advances in anticoagulation therapy (such as rivaroxaban) after coronary interventions.
Many trials found that antiplatelet therapy with ASA and clopidogrel is less effective than oral anticoagulant therapy for the prevention of stroke, MI, or peripheral embolism in patients with AF and at high risk of thromboembolic events.43) Therefore, oral anticoagulation alone is not recommended for patients who have undergone a coronary stent procedure, because it is associated with a 50% increased risk of death or MI caused by subacute embolism in stents.44)

Proton Pump Inhibitor and Aspirin

Aspirin therapy for primary prevention depends on trade-offs between its ability to reduce nonfatal MI and its potential to increase the risk of hemorrhage in cranial and extracranial site.45) There are several kinds of evidences for mitigation and the possible reduction of gastrointestinal bleeding. Acid-suppressive therapy can reduce the risk of upper GI bleeding.36) Saini et al.46) suggested that low-cost omeprazole regimen of patients 65 years or older who are using aspirin for secondary prevention may be cost-effective.
Usage of PPIs for antiplatelet therapy is effective in addressing the problems of gastrointestinal bleeding. Earnshaw et al.47) found that adding PPI therapy does not appear to be cost-effective for those patients with low or average risks for GI bleeding but may be valuable for those with a GI bleeding risk over 4 per 1000 per year in cost-utility analysis of aspirin and PPIs for primary prevention. He found out that treatment with aspirin for CHD prevention is less costly and more effective than no treatment for men aged 45 to 55 years. The 10% CHD risks suggested that further efforts to include GI bleeding risk assessments when prescribing low-dose aspirin for CHD protection are warranted.47) Reduced clinical efficacy of clopidogrel in patients treated with PPIs remains highly controversial.48) Gurbel et al.49) suggested that the clinical efficacy of clopidogrel is reduced in PPI therapy, an effect that is caused by competitive inhibitory interactions between two drugs. The FDA50 and European Medicine Agency51) recommend that PPIs and clopidogrel should not be routinely co-administered, and the updated 2010 American College of Cardiology foundation/American College of Gastroenterology/American Heart Association expert52) consensus guideline supports this recommendation.

Beta-Blockers

For over three decades, hypertension guidelines have proposed including β-blockers as a first line therapeutic option. Beta-blockers were documented to reduce reinfarction rates and to have protective effects for a broad spectrum of cardiovascular indications such as hypertension, diabetes, angina, AF as well as perioperatively in patients undergoing surgery. However, despite lowering blood pressure, beta-blockers have never shown to reduce morbidity and mortality in uncomplicated hypertensions. Also, beta-blockers do not prevent heart failures in hypertension any better than any other antihypertensive drug classes. There are many controversies in the use of beta-blockers in CVDs.
Beta-blockers are catecolamine competitive inhibitors and act through alpha and beta adrenergic receptors blockade. The most important therapeutic effects of beta-blockers are on cardiovascular system, where they act as negative chronotropic and inotropic agents, lowering cardiac work and improving oxygen demand/supply ratio. For their anti-ischemic activity, beta-blockers are used as antianginal drugs and in acute and previous MI for preventing total and cardiovascular mortality. Beta-blockers are useful in numerous cardiovascular conditions.53)
The first compound had severe opposing effects preventing their use until propranolol was introduced. It was found effective for treatment of angina pectoris since not all patients with hypertension responded to monotherapy with a meaningful reduction of pressure.
Actually this viewpoint is becoming increasingly subjective to controversy. The recent literature indicates that the absence of sufficient data and of solid evidence does not support using of β-blockers as monotherapy or as first line treatment, especially not in the elderly population.54)
Lindholm et al.55) reported that the effect of beta-blockers is less than optimum with a raised risk of stroke in comparison with other antihypertensive drugs, and they proposed that beta-blockers should not remain as first choice in the treatment of primary hypertension and should not be used as reference drugs in future. De Caterina and Leone56) explained several causes of their mild cardioprotective effects, such as their unfavorable metabolic properties, a lack of efficacy on left ventricular hypertrophy regression and endothelial dysfunction, and reduced patient compliance. Beta blocker effects on cardiovascular morbidity and mortality in hypertensive patients remains controversial and their use in uncomplicated hypertension is currently still under debate.
However, this doesn't preclude their predominant places in complicated hypertension, after MI, congestive heart failure and in the presence of arrhythmias.54)
There is no indication in treating primary non-complicated hypertension with beta-blockers as first-line drugs. Different metabolic effects of selective and non-selective beta-blockers are actually being debated.57) Traditional β-blockers (e.g., atenolol, metoprolol, propranolol) affect only the β-adrenergic receptors, whereas carvedilol and labetalol mediate vasodilation through blockade of the α1-adrenergic receptor. Other drugs like nebivolol may exert vasodilations via stimulation of nitric oxide. Vasodilation may be important not only for blood pressure reductions, but also for tolerability.58)
Current evidence suggests that older beta-blockers, such as atenolol and propranolol, may not be preferred as antihypertensive drugs. However, newer beta-blockers, especially with vasodilatory properties (carvedilol, nebivolol), should be considered in hypertensive patients.59)
β-Blocker usages to reduce perioperative ischemia and cardiovascular complications may not benefit patients as expected and may actually be harmful to some individuals. Currently, the best evidence supports β-blocker use in two patient groups: patients undergoing vascular surgery with known ischemic heart disease or multiple risk factors, and, for patients already receiving β-blockers for known cardiovascular conditions.60)

Statins

Statins (3-hydroxy-3-methylglutaryl coenzyme A reductase inhibitors) are effective at reducing mortality and other cardiac events for patients with high risk of major adverse cardiovascular events. Statins decrease in circulating levels of low density lipoprotein-cholesterol (LDL-C) by mechanism of inhibitory actions on cholesterol biosynthesis, which translates into approximately 20% relative reduction of major vascular events and coronary mortality per mmol/L LDL reduction achieved.
Statins are the treatment of choice for managing hypercholesterolaemia because of their proven efficacy and safety profile. They also have an increasing role in managing cardiovascular risks in patients with relatively normal levels of plasma cholesterol.61)
However there is less clear evidence supporting the use of statins.62)63) Statins are efficient in preventing first cardiovascular events, but the cost-efficiency of primary prevention remains controversial. In primary preventions particularly, the pros and cons of statin therapy should be weighted by considering patient-specific life circumstances and assessing the individual cardiovascular risks, as provided by risk calculators. Since diabetes mellitus poses a high risk even in the absence of known CADs, the statin treatment is generally indicated within these patients. There is no lower LDL threshold defining the limit of treatment benefits; rather, LDL target levels should be sought according to individual cardiovascular risks. Despite recent evidences that statin treatment is associated with a small risk of incident diabetes mellitus, this disadvantage is outweighed by vascular benefits.
Statins have pleiotropic effects, such as anti-inflammatory properties,64) improved endothelial function,65) stabilize plaques,66) reduced coronary artery thrombus formation,67) and influence myocardial protection and remodeling.68) It is still debated to what extent these effects translate into cardiovascular risk reduction beyond being conferred by LDL reductions.69) Although all statins share a common mechanism of action, they differ in terms of their chemical structures, pharmacokinetic profiles, and lipid-modifying efficacy.
There is controversy over the correct dose, the time of initiation of therapy, and the utility of the treatment-to-goal approach. Many questions remain unanswered despite substantial evidences supporting early initiation of statin therapy.70)
Current guidelines recommend initiating high dose statin therapy pre-discharge regardless of the baseline LDL levels in patients with acute coronary syndromes. It is prudent to recommend low-to-moderate-dose statin therapy as the most appropriate choice for achieving cardiovascular risk reduction in the majority of individuals without incurring adverse effects, whereas intensive-dose statin therapy may be reserved for those that do not respond to low-to-moderate-dose statins.71)
In coronary syndromes, it does not confer benefits in terms of the hard clinical outcomes of MI and strokes, it is associated with increased liver and muscle-related adverse outcomes leading to increased withdrawals and suboptimal long-term adherences. The adherence rate to statin therapy in 1 year ranged from 26% to 85%, with rapid declines in adherence rates typically observed within the first few months of several cohort studies.72) Although, only 3% of patients in randomized research studies develop intolerance, clinical practices up to 15% of outpatients receiving statins have reported muscle pain. Study results on the mechanisms and treatments of statin intolerance have been limited.
The time of statin initiation varied in many researches and several results showed negative results for early statin therapy for ACS patients.73-75)
The idea that polypill therapy consisting of cholesterol-lowing (statins), antihypertensive, and antiplatelet agents together would simultaneously lower multiple risk factors has generated much controversy and debates over the past decade.76) It is an unclear and controversial topic that whether the current wide use of polypill for CVD prevention, especially during primary prevention, is a threat or opportunity to public health.76) More external validation is required regarding the benefits, risks, costs, convenience, and acceptability of the polypill because these are key practical components in implementing and sustaining interventions.

Angioplasty, Percutaneous Coronary Intervention, and Stents

Since the 1970s, coronary artery bypass grafting (CABG) is the standard revascularization choice for unprotected left main coronary artery (ULMCA) disease based on the efficacy and survival advantage of CABG in reference to medical therapy.77)78)
In 1977, the practice of PCI was introduced, and it impacted on significant changes in revascularization strategy of CADs.
Percutaneous coronary intervention has led to a viable alternative treatment for ULMCA disease, because of the anatomically easy accessibility, relatively large caliber of the left main coronary artery (LMCA), technical advances in both PCI and stent technology like radiographic imaging, stent composition, deployment, and drug-eluting stents (DES).
Mayo Clinic (2010) had divided 4 eras according to the dominant interventional strategy at the time; 1979-1989 percutanoeous transluminal coronary angioplasty, 1990-1996 early stent era. 1997-2003 the bare-metal stent (BMS), 2003-2006 contemporary practice include DES.79)
Current evidence from clinical trials and extensive off-label experiences indicates that stenting yields mortality and morbidity rates that compare favorably with CABG, by updating the current guidelines for LMCA revascularization, it might have prompted many interventional cardiologists to choose PCI with DES as a good treatment option for patients with LMCA diseases.80) There have been several studies that have cited both an increase in PCI and a decrease in CABG surgery volumes in the treatment of CAD within the United States and other countries after the developments of coronary angioplasty 3 decades ago.81)
Percutaneous coronary intervention in the setting of ACS has proven mortality benefits. Introduction of coronary stents has revolutionized the field of interventional cardiology by reducing the incidence of restenosis after balloon angioplasty.82)
Several randomized controlled trials have demonstrated that coronary stenting reduces mortality when compared to thrombolysis in ST-segment elevation myocardial infarction. Meta-analysis of RCTs has also shown a reduction of mortality in non-ST-segment elevation myocardial infarction. As a result, intracoronary stents has become the preferred treatment for eligible patients with ACS.83)84) However, controversy exists regarding the clinical impacts of early inflammatory responses on in-stent restenosis after coronary stent implantation,85) procedural choices, and particularly stent choices. Implanted stent is a strong inflammatory stimulus in which the stent facilitates arterial intimal cellular proliferation and extracellular matrix synthesis that is mediated largely by inflammatory processes.85)
Drug-eluting stents were introduced in the United States in 2003 and have been widely adopted based on profound reductions in restenosis.86)
Randomized clinical trials and population-based studies suggest that DES appear safe and more effective than BMS in the setting of acute myocardial infarction (AMI). However, DES are commonly used in AMI, there has been significant debates in the clinical community regarding their true efficacy and long-term safety. Longer follow-ups of these studies (>2 years) will be important to confirm the ongoing safety, and more data on new DES will be essential as clinical practice evolves.86)
The long-term safety and efficacy of DES for patients with AMI remain controversial because the incidences of late stent thrombosis (LST) and deaths could be higher in DES than BMS despite of DES has been shown to be associated with significant reduction in restenosis and target vessel revascularization.87)
Premature discontinuation of clopidogrel after DES is one of the most important predictors of LST. Improving compliances with dual-antiplatelet therapy and procedural practices can improve outcomes for both DES and BMS in AMI. The scientific 'battle' (for the optimal reperfusion therapy in AMI) between pharmaco-oriented and balloon-oriented cardiologists has already been ongoing for 16 years.88)
Randomized and meta-analysis studies demonstrated that PCI with DES for unprotected left main trunk diseases, when compared with BMS, could be more strongly associated with a significant reduction for target lesion revascularization needs without any additional adverse outcomes, although there are limitations on indications.89) Further investigation is needed on PCI for ULMCA diseases, along with further analysis of remote-stage outcomes of BMS.90)
The primary use of DES has become the routine clinical practice for CAD, but the use in peripheral arteries has to be further studied.91)
First-generation DES with controlled releases of sirolimus or paclitaxel from durable polymers compared with BMSs have been consistently shown to reduce the risks of repeat revascularization procedures due to restenosis. Newer generation DES have been developed with the goal to further improve upon the safety profiles of first-generation DES while maintaining efficacy. These platforms include DES with improved and more biocompatible durable polymers, DES using bio-absorbable polymers for drug releases, DES with polymer-free drug release, and fully bio-absorbable DES. This innovative concept remains an evidence for clinical applications.92)
Interventional cardiology has utilized balloon catheters, bare metal- and DES to recanalize narrowed vessels for the past 30 years. However, the quest and answer for outcome optimization is ongoing for specific lesions and patients.
Drug-eluting balloons are among the latest technologies proposed to overcome the limitations of DES, such as stent thrombosis and the dependency on long-term dual antiplatelet therapy.93)

Implication and Conclusion

Dwan et al.4) investigated that 68.8% series of cohort studies were publication biased and 31.3% of randomized controlled trials were outcome reporting biased. And they found strong empirical evidences of an association between significant results and publications;studies that report positive or significant results are more likely to be published and outcomes that are statistically significant have higher odds of being fully reported.94) Publication bias will lead to overestimation of treatment effects. Study results without statistical significances take longer to activate publication than those with significant results, thus furthering bias evidences. It is either time lag biased or pipeline biased.95)96)
Many studies tried to assess the relationship between publication and funding. Stern and Simes,97) Dickersin et al.,98) and Decullier and Chapuis99) reported that external fundings lead to a higher rate of publications. But other studies found reverse results; the probability of publications decreased when the study was commercially funded,100) government funded results were more likely to have statistical significances but no effects on publication,101) no differences in funding mechanism,94) no differences in whether data was managed by the pharmaceutical industry or federally sponsored organizations.102)
Ioannidis102) found that positive trials were published significantly more rapidly after submission than negative trials.
Selective reporting bias is defined as the selection on the basis of the results of a subset of the original variables recorded for inclusion in a publication.103) There are several kinds of selective reporting bias: examples, intention to treat analysis, per-protocol analysis, and different time points or subgroups.104) Randomized controlled trials is known as the most powerful study designed to evaluate the effectiveness of a treatment in medical research.105)106) This also can be biased by selective outcome reporting.
The bias from missing outcome data which may affect a meta-analysis are non-publications in a study level and selective for non-reporting of outcomes on an outcome level.4)
In cardiovascular medicines, there are more complicated situations on decline effects, because of technological innovation updates, new published evidences, and updated guidelines with traditional problems of studies. We should understand various dimensions of decline effect in cardiovascular medicine.
Schooler1) suggests an open-access repository for all research findings for improving and testing decline effect of results. He concluded and proposed that these database could identify the current scientific processes on how scientist design experiments, how they write, and how journals decide what to publish based on peer reviews and experimental replications, thus, succeeds in distinguishing grounded truth from unwarranted fallacy.
In systematic review of the empirical evidences on study publication bias and outcome reporting bias, authors recommend researchers to use the flow diagram as the standard for reporting of future similar studies. Such studies overlook publication bias and outcome reporting bias so that reviewers scrutinize trials with missing outcome data and contacts trialists when results are not reported. Statisticians should be involved for data extraction of more complex outcomes, develop methods to assess the robustness of conclusions, systemic reviews to outcome reporting bias, being cautious for missing data in meta-analysis, setup clinical trial registers and detailed protocols for advanced publications.4)

Notes

The authors have no financial conflicts of interest.

References

1. Schooler J. Unpublished results hide the decline effect. Nature. 2011; 470:437.
2. Lehrer J. The Truth Wears Off-is there something wrong with the scientific method? New Yorker. 2010. 12. 13.
3. Møller AP, Jennions MD. Testing and adjusting for publication bias. Trends Ecol Evol. 2001; 16:580–586.
4. Dwan K, Altman DG, Arnaiz JA, et al. Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PLoS One. 2008; 3:e3081.
5. Ioannidis JP, Trikalinos TA. The appropriateness of asymmetry tests for publication bias in meta-analyses: a large survey. CMAJ. 2007; 176:1091–1096.
6. Palmer AR. Quasi-replication and the contract of error: lessons from sex ratios, heritabilities and fluctuating asymmetry. Annu Rev Ecol Syst. 2000; 31:441–480.
7. Crabbe JC, Wahlsten D, Dudek BC. Genetics of mouse behavior: interactions with laboratory environment. Science. 1999; 284:1670–1672.
8. Ioannidis JP. Contradicted and initially stronger effects in highly cited clinical research. JAMA. 2005; 294:218–228.
9. Stampfer MJ, Colditz GA, Willett WC, et al. Postmenopausal estrogen therapy and cardiovascular disease. Ten-year follow-up from the nurses' health study. N Engl J Med. 1991; 325:756–762.
10. The Writing Group for the PEPI Trial. Effects of estrogen or estrogen/progestin regimens on heart disease risk factors in postmenopausal women. The Postmenopausal Estrogen/Progestin Interventions (PEPI) Trial. JAMA. 1995; 273:199–208.
11. Rossouw JE, Anderson GL, Prentice RL, et al. Risks and benefits of estrogen plus progestin in healthy postmenopausal women: principal results From the Women's Health Initiative randomized controlled trial. JAMA. 2002; 288:321–333.
12. Hulley S, Grady D, Bush T, et al. Heart and Estrogen/progestin Replacement Study (HERS) Research Group. Randomized trial of estrogen plus progestin for secondary prevention of coronary heart disease in postmenopausal women. JAMA. 1998; 280:605–613.
13. Rimm EB, Stampfer MJ, Ascherio A, Giovannucci E, Colditz GA, Willett WC. Vitamin E consumption and the risk of coronary heart disease in men. N Engl J Med. 1993; 328:1450–1456.
14. Stampfer MJ, Hennekens CH, Manson JE, Colditz GA, Rosner B, Willett WC. Vitamin E consumption and the risk of coronary disease in women. N Engl J Med. 1993; 328:1444–1449.
15. Stephens NG, Parsons A, Schofield PM, Kelly F, Cheeseman K, Mitchinson MJ. Randomised controlled trial of vitamin E in patients with coronary disease: Cambridge Heart Antioxidant Study (CHAOS). Lancet. 1996; 347:781–786.
16. Yusuf S, Dagenais G, Pogue J, Bosch J, Sleight P. The Heart Outcomes Prevention Evaluation Study Investigators. Vitamin E supplementation and cardiovascular events in high-risk patients. N Engl J Med. 2000; 342:154–160.
17. Grines CL, Browne KF, Marco J, et al. The Primary Angioplasty in Myocardial Infarction Study Group. A comparison of immediate angioplasty with thrombolytic therapy for acute myocardial infarction. N Engl J Med. 1993; 328:673–679.
18. Cucherat M, Bonnefoy E, Tremeau G. Primary angioplasty versus intravenous thrombolysis for acute myocardial infarction. Cochrane Database Syst Rev. 2003; CD001560.
19. Fischman DL, Leon MB, Baim DS, et al. Stent Restenosis Study Investigators. A randomized comparison of coronary-stent placement and balloon angioplasty in the treatment of coronary artery disease. N Engl J Med. 1994; 331:496–501.
20. Serruys PW, de Jaegere P, Kiemeneij F, et al. Benestent Study Group. A comparison of balloon-expandable-stent implantation with balloon angioplasty in patients with coronary artery disease. N Engl J Med. 1994; 331:489–495.
21. Brophy JM, Belisle P, Joseph L. Evidence for use of coronary stents. A hierarchical bayesian meta-analysis. Ann Intern Med. 2003; 138:777–786.
22. Hertog MG, Feskens EJ, Hollman PC, Katan MB, Kromhout D. Dietary antioxidant flavonoids and risk of coronary heart disease: the Zutphen Elderly Study. Lancet. 1993; 342:1007–1011.
23. Huxley RR, Neil HA. The relation between dietary flavonol intake and coronary heart disease mortality: a meta-analysis of prospective cohort studies. Eur J Clin Nutr. 2003; 57:904–908.
24. Steering Committee of the Physicians' Health Study Research Group. Final report on the aspirin component of the ongoing Physicians' Health Study. N Engl J Med. 1989; 321:129–135.
25. US Preventive Services Task Force. Guide to Clinical Preventive Services. Report of the U.S. Preventive Services Task Force. 2nd ed. Baltimore: Williams & Wilkins;1996.
26. Wolff T, Miller T, Ko S. Aspirin for the primary prevention of cardiovascular events: an update of the evidence for the U.S. Preventive Services Task Force. Ann Intern Med. 2009; 150:405–410.
27. U.S. Preventive Services Task Force. Aspirin for the primary prevention of cardiovascular events: recommendation and rationale. Ann Intern Med. 2002; 136:157–160.
28. U.S. Preventive Services Task Force. Aspirin for the Prevention of Cardiovascular Disease. accessed on July 17, 2013. Available from: http://www.uspreventiveservicestaskforce.org/uspstf09/aspirincvd/aspcvdrs.htm.
29. Bartolucci AA, Tendera M, Howard G. Meta-analysis of multiple primary prevention trials of cardiovascular events using aspirin. Am J Cardiol. 2011; 107:1796–1801.
30. CURRENT-OASIS 7 Investigators. Mehta SR, Bassand JP, et al. Dose comparisons of clopidogrel and aspirin in acute coronary syndromes. N Engl J Med. 2010; 363:930–942.
31. Mehta SR, Tanguay JF, Eikelboom JW, et al. Double-dose versus standard-dose clopidogrel and high-dose versus low-dose aspirin in individuals undergoing percutaneous coronary intervention for acute coronary syndromes (CURRENT-OASIS 7): a randomised factorial trial. Lancet. 2010; 376:1233–1243.
32. Yousuf O, Bhatt DL. The evolution of antiplatelet therapy in cardiovascular disease. Nat Rev Cardiol. 2011; 8:547–559.
33. Bonaca MP, Steg PG, Feldman LJ, et al. Antithrombotics in acute coronary syndromes. J Am Coll Cardiol. 2009; 54:969–984.
34. Lamotte M, Annemans L, Evers T, Kubin M. A multi-country economic evaluation of low-dose aspirin in the primary prevention of cardiovascular disease. Pharmacoeconomics. 2006; 24:155–169.
35. Bertrand ME, Rupprecht HJ, Urban P, Gershlick AH. CLASSICS Investigators. Double-blind study of the safety of clopidogrel with and without a loading dose in combination with aspirin compared with ticlopidine in combination with aspirin after coronary stenting: the clopidogrel aspirin stent international cooperative study (CLASSICS). Circulation. 2000; 102:624–629.
36. Bhatt DL, Scheiman J, Abraham NS, et al. ACCF/ACG/AHA 2008 expert consensus document on reducing the gastrointestinal risks of antiplatelet therapy and NSAID use: a report of the American College of Cardiology Foundation Task Force on Clinical Expert Consensus Documents. J Am Coll Cardiol. 2008; 52:1502–1517.
37. Faxon DP, Freedman JE. Facts and controversies of aspirin and clopidogrel therapy. Am Heart J. 2009; 157:412–422.
38. Cohen M, Théroux P, Borzak S, et al. Randomized double-blind safety study of enoxaparin versus unfractionated heparin in patients with non-ST-segment elevation acute coronary syndromes treated with tirofiban and aspirin: the ACUTE II study. The Antithrombotic Combination Using Tirofiban and Enoxaparin. Am Heart J. 2002; 144:470–477.
39. Ferguson JJ, Antman EM, Bates ER, et al. Combining enoxaparin and glycoprotein IIb/IIIa antagonists for the treatment of acute coronary syndromes: final results of the National Investigators Collaborating on Enoxaparin-3 (NICE-3) study. Am Heart J. 2003; 146:628–634.
40. Goodman SG, Fitchett D, Armstrong PW, Tan M, Langer A. Integrilin and Enoxaparin Randomized Assessment of Acute Coronary Syndrome Treatment (INTERACT) Trial Investigators. Randomized evaluation of the safety and efficacy of enoxaparin versus unfractionated heparin in high-risk patients with non-ST-segment elevation acute coronary syndromes receiving the glycoprotein IIb/IIIa inhibitor eptifibatide. Circulation. 2003; 107:238–244.
41. Nimjee SM, Rusconi CP, Harrington RA, Sullenger BA. The potential of aptamers as anticoagulants. Trends Cardiovasc Med. 2005; 15:41–45.
42. Douketis JD. Combination warfarin-ASA therapy: which patients should receive it, which patients should not, and why? Thromb Res. 2011; 127:513–517.
43. Hart RG, Pearce LA, Aguilar MI. Adjusted-dose warfarin versus aspirin for preventing stroke in patients with atrial fibrillation. Ann Intern Med. 2007; 147:590–592.
44. Leon MB, Baim DS, Popma JJ, et al. Stent Anticoagulation Restenosis Study Investigators. A clinical trial comparing three antithrombotic-drug regimens after coronary-artery stenting. N Engl J Med. 1998; 339:1665–1671.
45. US Preventive Services Task Force. Aspirin for the prevention of cardiovascular disease: U.S. Preventive Services Task Force recommendation statement. Ann Intern Med. 2009; 150:396–404.
46. Saini SD, Schoenfeld P, Fendrick AM, Scheiman J. Cost-effectiveness of proton pump inhibitor cotherapy in patients taking long-term, low-dose aspirin for secondary cardiovascular prevention. Arch Intern Med. 2008; 168:1684–1690. discussion 1691.
47. Earnshaw SR, Scheiman J, Fendrick AM, McDade C, Pignone M. Cost-utility of aspirin and proton pump inhibitors for primary prevention. Arch Intern Med. 2011; 171:218–225.
48. Gurbel PA, Tantry US. Antiplatelet therapy: Clopidogrel-PPI interaction, an ongoing controversy. Nat Rev Cardiol. 2011; 8:7–8.
49. Gurbel PA, Tantry US, Kereiakes DJ. Interaction between clopidogrel and proton-pump inhibitors and management strategies in patients with cardiovascular diseases. Drug Healthc Patient Saf. 2010; 2:233–240.
50. US Department of Health & Human services. FDA. Information for healthcare professionals: update to the labeling of clopidogrel bisulfate (marketed as Plavix) to alert healthcare professionals about a drug interaction with omeprazole (marketed as Prilosec and Prilosec OTC). 2009. accessed on July 2, 2012. Available from: http://www.fda.gov/Drugs/Drugsafety/PostmarketDrugsafetyinformationforPatientsandProviders/DrugsafetyinformationforHeathcareProfessionals/ucm190787.htm.
51. European Medicines Agency. Public statement on possible interaction between clopidogrel and proton-pump inhibitors. 2009. accessed on July 17, 2013. Available from: www.ema.europa.eu/humandocs/PDFs/ePAR/Plavix/32895609en.pdf.
52. Abraham NS, Hlatky MA, Antman EM, et al. ACCF/ACG/AHA 2010 Expert Consensus Document on the concomitant use of proton pump inhibitors and thienopyridines: a focused update of the ACCF/ACG/AHA 2008 expert consensus document on reducing the gastrointestinal risks of antiplatelet therapy and NSAID use: a report of the American College of Cardiology Foundation Task Force on Expert Consensus Documents. Circulation. 2010; 122:2619–2633.
53. Spoladore R, Fragasso G, Montanaro C, et al. [Present trends and controversies in the use of beta-blockers in cardiovascular diseases]. Recenti Prog Med. 2010; 101:429–441.
54. Corteville B, Gillebert TC. Beta-blockers in uncomplicated arterial hypertension: what is the evidence? Tijdschr Geneeskd. 2010; 66:213–221.
55. Lindholm LH, Carlberg B, Samuelsson O. Should beta blockers remain first choice in the treatment of primary hypertension? A meta-analysis. Lancet. 2005; 366:1545–1553.
56. De Caterina AR, Leone AM. The role of Beta-blockers as first-line therapy in hypertension. Curr Atheroscler Rep. 2011; 13:147–153.
57. Frohlich ED. Role of beta-adrenergic receptor blocking agents in hypertensive diseases: personal thoughts as the controversy persists. Ther Adv Cardiovasc Dis. 2009; 3:455–464.
58. Weir MR. Beta-blockers in the treatment of hypertension: are there clinically relevant differences? Postgrad Med. 2009; 121:90–98.
59. Bielecka-Dabrowa A, Aronow WS, Rysz J, Banach M. Current place of beta-blockers in the treatment of hypertension. Curr Vasc Pharmacol. 2010; 8:733–741.
60. Frishman WH, Saunders E. β-Adrenergic blockers. J Clin Hypertens (Greenwich). 2011; 13:649–653.
61. Schachter M. Chemical, pharmacokinetic and pharmacodynamic properties of statins: an update. Fundam Clin Pharmacol. 2005; 19:117–125.
62. Tonelli M, Lloyd A, Clement F, et al. Efficacy of statins for primary prevention in people at low cardiovascular risk: a meta-analysis. CMAJ. 2011; 183:E1189–E1202.
63. Briel M, Schwartz GG, Thompson PL, et al. Effects of early treatment with statins on short-term clinical outcomes in acute coronary syndromes: a meta-analysis of randomized controlled trials. JAMA. 2006; 295:2046–2056.
64. Aikawa M, Rabkin E, Sugiyama S, et al. An HMG-CoA reductase inhibitor, cerivastatin, suppresses growth of macrophages expressing matrix metalloproteinases and tissue factor in vivo and in vitro. Circulation. 2001; 103:276–283.
65. Laufs U, La Fata V, Plutzky J, Liao JK. Upregulation of endothelial nitric oxide synthase by HMG CoA reductase inhibitors. Circulation. 1998; 97:1129–1135.
66. Rosenson RS, Tangney CC. Antiatherothrombotic properties of statins: implications for cardiovascular event reduction. JAMA. 1998; 279:1643–1650.
67. Dangas G, Badimon JJ, Smith DA, et al. Pravastatin therapy in hyperlipidemia: effects on thrombus formation and the systemic hemostatic profile. J Am Coll Cardiol. 1999; 33:1294–1304.
68. Xu Z, Okamoto H, Akino M, Onozuka H, Matsui Y, Tsutsui H. Pravastatin attenuates left ventricular remodeling and diastolic dysfunction in angiotensin II-induced hypertensive mice. J Cardiovasc Pharmacol. 2008; 51:62–70.
69. Rutishauser J. Statins in clinical medicine. Swiss Med Wkly. 2011; 141:w13310.
70. Sposito AC, Santos SN, de Faria EC, et al. Timing and dose of statin therapy define its impact on inflammatory and endothelial responses during myocardial infarction. Arterioscler Thromb Vasc Biol. 2011; 31:1240–1246.
71. Morrissey RP, Diamond GA, Kaul S. Statins in acute coronary syndromes: do the guideline recommendations match the evidence? J Am Coll Cardiol. 2009; 54:1425–1433.
72. Kopecky SL. New statin intolerance clinic. Mayo Clin Cardiovasc Update . 2010; 8:6–7.
73. Zhou Z, Rahme E, Pilote L. Association between time of statin initiation after hospital discharge from acute myocardial infarction and risk of recurrence and mortality in patients > or =65 years of age. Am J Cardiol. 2006; 97:155–159.
74. Newby LK, Kristinsson A, Bhapkar MV, et al. Early statin initiation and outcomes in patients with acute coronary syndromes. JAMA. 2002; 287:3087–3095.
75. Li YH, Wu HL, Yang YH, Tsai HS, Chao TH. Effect of early versus late inhospital initiation of statin therapy on the clinical outcomes of patients with acute coronary syndrome. Int Heart J. 2007; 48:677–688.
76. Dabhadkar KC, Kulshreshtha A, Ali MK, Narayan KM. Prospects for a cardiovascular disease prevention polypill. Annu Rev Public Health. 2011; 32:23–38.
77. Chaitman BR, Fisher LD, Bourassa MG, et al. Effect of coronary bypass surgery on survival patterns in subsets of patients with left main coronary artery disease. Report of the Collaborative Study in Coronary Artery Surgery (CASS). Am J Cardiol. 1981; 48:765–777.
78. Takaro T, Peduzzi P, Detre KM, et al. Survival in subgroups of patients with left main coronary artery disease. Veterans Administration Cooperative Study of Surgery for Coronary Arterial Occlusive Disease. Circulation. 1982; 66:14–22.
79. Hilliard AA, From AM, Lennon RJ, et al. Percutaneous revascularization for stable coronary artery disease temporal trends and impact of drug-eluting stents. JACC Cardiovasc Interv. 2010; 3:172–179.
80. Park SJ, Park DW. Left main stenting. Circ J. 2011; 75:749–755.
81. Riley RF, Don CW, Powell W, Maynard C, Dean LS. Trends in coronary revascularization in the United States from 2001 to 2009: recent declines in percutaneous coronary intervention volumes. Circ Cardiovasc Qual Outcomes. 2011; 4:193–197.
82. Al Suwaidi J, Berger PB, Holmes DR Jr. Coronary artery stents. JAMA. 2000; 284:1828–1836.
83. Saito S, Hosokawa G, Tanaka S, Nakamura S. PASTA Trial Investigators. Primary stent implantation is superior to balloon angioplasty in acute myocardial infarction: final results of the primary angioplasty versus stent implantation in acute myocardial infarction (PASTA) trial. Catheter Cardiovasc Interv. 1999; 48:262–268.
84. Suryapranata H, Ottervanger JP, Nibbering E, et al. Long term outcome and cost-effectiveness of stenting versus balloon angioplasty for acute myocardial infarction. Heart. 2001; 85:667–671.
85. Li JJ, Ren Y, Chen KJ, et al. Impact of C-reactive protein on in-stent restenosis: a meta-analysis. Tex Heart Inst J. 2010; 37:49–57.
86. Sakhuja R, Mauri L. Controversies in the use of drug-eluting stents for acute myocardial infarction: a critical appraisal of the data. Annu Rev Med. 2010; 61:215–231.
87. Ejiri K, Ishihara M, Dai K, et al. Three-year follow-up of sirolimus-eluting stents vs. bare metal stents for acute myocardial infarction. Circ J. 2012; 76:65–70.
88. Widimsky P. Primary angioplasty vs. thrombolysis: the end of the controversy? Eur Heart J. 2010; 31:634–636.
89. Kadota K, Mitsudo K. Percutaneous coronary intervention with drug-eluting stent for unprotected left main trunk disease: safety and efficacy compared with bare metal stent. - Which coronary stent should be used for the left main trunk disease? BMS or DES? (DES side)-. Circ J. 2011; 75:1250–1254.
90. Kaneko H, Kijima M. Role of bare-metal stents for left main coronary artery disease in the era of drug-eluting stents. -Which coronary stent should be used for left main trunk disease? BMS or DES? (BMS-side)-. Circ J. 2011; 75:1243–1249.
91. Joviliano EE, Piccinato CE, Dellalibera-Joviliano R, Moriya T, Évora PR. Inflammatory markers and restenosis in peripheral percutaneous angioplasty with intravascular stenting: current concepts. Ann Vasc Surg. 2011; 25:846–855.
92. Räber L, Windecker S. Current status of drug-eluting stents. Cardiovasc Ther. 2011; 29:176–189.
93. Barbash IM, Waksman R. Current status, challenges and future directions of drug-eluting balloons. Future Cardiol. 2011; 7:765–774.
94. Dickersin K, Min YI. NIH clinical trials and publication bias. Online J Curr Clin Trials. 1993; Doc No 50.
95. Ioannidis J, Lau J. Evolution of treatment effects over time: empirical insight from recursive cumulative metaanalyses. Proc Natl Acad Sci U S A. 2001; 98:831–836.
96. Trikalinos TA, Churchill R, Ferri M, et al. Effect sizes in cumulative meta-analyses of mental health randomized trials evolved over time. J Clin Epidemiol. 2004; 57:1124–1130.
97. Stern JM, Simes RJ. Publication bias: evidence of delayed publication in a cohort study of clinical research projects. BMJ. 1997; 315:640–645.
98. Dickersin K, Min YI, Meinert CL. Factors influencing publication of research results. Follow-up of applications submitted to two institutional review boards. JAMA. 1992; 267:374–378.
99. Decullier E, Chapuis F. Impact of funding on biomedical research: a retrospective cohort study. BMC Public Health. 2006; 6:165.
100. von Elm E, Röllin A, Blümle A, Huwiler K, Witschi M, Egger M. Publication and non-publication of clinical trials: longitudinal study of applications submitted to a research ethics committee. Swiss Med Wkly. 2008; 138:197–203.
101. Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR. Publication bias in clinical research. Lancet. 1991; 337:867–872.
102. Ioannidis JP. Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. JAMA. 1998; 279:281–286.
103. Hutton JL, Williamson PR. Bias in meta-analysis due to outcome variable selection within studies. Appl Stat. 2000; 49:359–370.
104. Williamson PR, Gamble C, Altman DG, Hutton JL. Outcome selection bias in meta-analysis. Stat Methods Med Res. 2005; 14:515–524.
105. Kane RL, Wang J, Garrard J. Reporting in randomized clinical trials improved after adoption of the CONSORT statement. J Clin Epidemiol. 2007; 60:241–249.
106. Egger M, Smith GD, Altman DG. Systematic reviews in health care: meta-analysis in context. 2nd. London: BMJ Publishing Group;2001.
TOOLS
Similar articles