It's best to set up a template for extracting the data from the research papers you're critiquing. One way of doing this is to adapt EndNote fields for the raw data - so each summary is associated with both the citation record and the .pdf. You can export or copy the data to a spreadsheet.
It will be important to be able to present all of your data accurately and effectively, although it will have come from a (usually large) number of quantitative studies.
One way of doing this is with a Forest plot. A Forest plot is a graphical representation of the mean, range and variance of results in each study, all visually aligned so that the key range of values common to all studies is readily seen.
Figure 1. Forest plot embedded in Excel worksheet. Note the Confidence Intervals around the determined Standard Errors overlap, with a central tendency indicated by the diamond.
A review matrix and summary tables are convenient ways to summarise and quickly rearrange qualitative information and observations to achieve a draft outline.
You can easily set up a table in a word processor or spreadsheet. Aim to itemise the most important content column by column, with one article per row. The rows can be rearranged and regrouped at need or at whim, so it doesn't matter which articles you start with.
|Author/s||Publication year||Patients||Intervention & Control||Outcomes||Appraisal||Further questions|
Realist and meta-narrative syntheses, appropriately conducted, are qualitative equivalents to (quantitative) meta-analyses. They are more likely to used in reviewing health policies and guidelines rather than answering clinical questions.
Realist reviews systematically examine complex social interventions to discover and understand any factors influencing the links between an intervention and its outcomes (summed up in the question "what works, how, for whom, in what circumstances and to what extent?").
Meta-narrative reviews are similar but adapted for use when a policy-related topic has been researched in different ways by different teams, especially when differing terms and vocabularies have emerged in the literature.
The UK National Institute of Health Research has developed guidelines and standards through its RAMESES initiatives.
RAMESES publication standards: realist syntheses
BMC Medicine 2013, 11:21
For a summary see http://www.ramesesproject.org/media/RS_qual_standards_researchers.pdf
RAMESES publication standards: meta-narrative reviews
BMC Medicine 2013, 11:20
For a summary see http://www.ramesesproject.org/media/MNR_qual_standards_researchers.pdf
See also Greenhalgh, T., Wong, G., Westhorp, G., & Pawson, R. (2011). Protocol-realist and meta-narrative evidence synthesis: evolving standards (RAMESES). BMC medical research methodology, 11(1), 115.