BOLD
Educational
Software
Writing the Methodology Chapter
|
BOLD
Educational
Software |
| Writing
the Methodology Chapter |
|
| Function of the Methodology Chapter | The methodology chapter, usually chapter 3, presents all the information the reader will require to replicate the study and to understand that all steps in the scientific method were done to ensure the reliability and validity of the study. |
| Introduction | Begin the chapter with a brief introduction. Include a restatement of the purpose of the study and conclude the introductory section with a brief overview of the chapter. No need to get clever. Just write, "Chapter 3 includes a review of the research method and design appropriateness, a discussion of the population and sample. In addition, chapter 3..." (Note that "chapter" is NOT capitalized in this sentence!). The introduction should be no more than 3 paragraphs, and, per APA, should NOT include the title "Introduction". |
| Research Method and Design Appropriateness | The research design is based on the problem under investigation,
the theoretical framework of the study, and the purpose of the study. Provide
sufficient detail to suggest recommendations to answer the research questions.
The purpose of this section is to assure the reader that the type of research
design is justified and appropriate for the desired outcomes. This section should also clearly delineate and explicate the type of design used (e.g., correlational, historical, phenomenological, etc.). Any deviation from the steps necessary to fulfill the research design should be explained and fully justified; otherwise, the reader may conclude that the procedure is flawed. Provide a complete description and definition of the independent variables (IV) and dependent variables (DV). The dependent variable is the response or the criterion variable, which is caused or influenced by the independent treatment conditions. The independent variables, which are under the control of the researcher, provide the treatment or act as factors in the study. (Note: if you are doing a qualitative study, there are no IVs and DVs; if you are doing a correlational study, refer to the variables a 'research variables' rather than IV/DV) The research design establishes a logical sequence of events in the research process. The length of this section depends upon the number of tests performed and the results expected. A detailed explication of each point of each selected method is required to adequately document the study for replication. You should include these elements: 1. Provide a detailed rationale for the research method (quantitative or mixed) appropriateness, including a discussion of why the selected method was chosen instead of another. Explain why the quantitative method was selected instead of the qualitative method. 2. Provide a detailed rationale explaining why the proposed research design (experimental, quasiexperimental, nonexperimental, for example) is appropriate to the study. Do not merely list and describe a variety of research designs, but explain why the chosen design is appropriate. 3. Explain how the proposed design will accomplish the study goals and why design is the optimum choice for this specific research. |
| Research Questions | It is often useful to copy/paste the research questions and hypotheses from chapter 1. |
| Population | The population is the ENTIRE GROUP you are trying to generalize to and consists of the entire group from which you will draw your sample. Describe the population in great detail (age, gender, race/ethnicity, etc.). If you presented information about the population in previous chapters, be absolutely certain these sections are consistent. |
| Sampling Frame | Clearly describe how the sample will be chosen. In quantitative studies, random sampling is nearly ALWAYS better than trying to sample the entire population (which allows for self selection and therefore biasing of your study). See the Sample Size Calculator to determine the appropriate sample size for your population. Explain the sampling method (e.g., simple random sampling, stratified random sampling, convenience sampling) and clearly explain the parameters used. Who has been excluded from the sample and why? Over-sampling the population is recommended due to the possibility that 60% will not respond to requests to participate in the study. Note that your original sample consists of all potential participants you approach to participate; the final sample consists of those who actually DO PARTICIPATE. |
| Informed Consent and Confidentiality | Participants must give voluntary informed consent to participate in most studies. The U.S. Office for Human Research Protections (OHRP), the Code of Federal Regulations (CFR) requires that the following information must be provided to research subjects before they participate in a study: 1. Participants must be informed that they are being asked to participate in a research study, 2. Participants must be provided an explanation of the purposes of the research and the expected duration of their participation, 3. Participants must be given a description of the procedures to be followed and of any experimental procedures must be identified, 4. Participants must be given a description of any reasonably foreseeable risks or discomforts they may experience, 5. Participants must be given a description of any benefits to themselves or others that may reasonably be expected from the results of the study, 6. Appropriate alternative procedures or courses of treatment, if any, that might be advantageous to the subject of an experimental or quasiexperimental study must be disclosed 7. Participants must be given a statement describing the extent, if any, to which confidentiality of records identifying the subject/participant will be maintained 8. For research involving more than minimal risk, participants must be given an explanation about any treatments or compensation if injury occurs and, if so, what they consist of, or where further information may be obtained. (Note: A risk is considered "minimal" when the probability and magnitude of harm or discomfort anticipated in the proposed research are not greater, in and of themselves, than those ordinarily encountered in daily life or during the performance of routine physical or psychological examinations or tests). 9. Participants must be told whom to contact for answers to pertinent questions about the research and research subjects'/participants' rights, and whom to contact in the event of a research-related injury 10. Participants must be given a statement that participation is voluntary, refusal to participate will involve no penalty or loss of benefits to which the subject/participants is otherwise entitled, and the subject/participant may discontinue participation at any time without penalty or loss of benefits to which the subject/participant is otherwise entitled Note: It is essential that consent forms be written in plain language that research subjects/participants can understand. In addition, the consent form should not contain any exculpatory language. That is, subjects/participants should not be asked to waive (or appear to waive) any of their legal rights, nor should they be asked to release the investigator, sponsor, or institution (or its agents) from liability for negligence. |
| Data Collection | Describe how data will be collected, including the data coding
and input procedures. Was a tape recorder used? Was permission granted to
tape record the session? The procedures for collecting data must be thoroughly
and clearly stated. Reasons should be provided for the use of the particular
procedure of data collection. Include 1. Technique(s) used and rationale for the technique(s) selected, including a comparison to other technique(s) that could be used 2. Kind of data to be collected and rationale for the kind of data The discussion must be consistent with, and elaborate upon, the design appropriateness and the dissertation problem statement. |
| Instrumentation | If a standardized instrument is used, clearly describe
the instrument (include a copy in the appendix) and report why this instrument
is appropriate to the study. The reliability and validity coefficients
must be reported. If you created the instrument, describe how the instrument
was created and what steps were taken to ensure its reliability and validity.
|
| Validity | Validity and reliability issues are the main factors that
can weaken the power of the research study. Campbell and Stanley (1963)
identified eight factors related to internal validity of experimental and
quasiexperimental designs: (a) history, (b) maturation, (c) testing, (d)
instrumentation, (e) statistical regression, (f) differential selection,
(g) experimental mortality, and (h) selection-maturation interaction. If the instrument is unique to this study, discuss the procedures to be used to pilot test the study. Pilot test results will be presented in chapter 4 prior to presentation of the study results. |
| Reliability | The two types of reliability criteria that judge the quality
of a research study are (a) the reliability of the study and (b) the reliability
of the research instruments. “Reliability of the study is the extent
to which other researchers would arrive at similar results if they studied
the same case using exactly the same procedures as the first researcher”
(Gall, 1996, p. 572). In reference to reliability of the research instruments, reliability is the degree to which the instruments consistently measure what the instrument is designed to measure. Reliability is measured numerically. For example, a coefficient over .60 (Cronbach's alpha) would indicate an acceptable reliability. A standard error of measurement is another way to express reliability. Cronbach's alpha in the high .90s might indicate multicollinearity (the questions on an instrument are measuring EXACTLY the same thing and not different dimensions of the same variable). |
| Data Analysis | Provide a detailed data analysis plan identifying the statistical
techniques (to be) used. Include a description of why the statistical tests
are appropriate to assess each statistical hypothesis. Also include a clear explanation of why the disadvantages and advantages of parameter-free tests are justified, when chosen over parametric tests. Computer techniques are appropriate and should be well described. In the dissertation (as opposed to the proposal), it may be useful to mention any deviation from the anticipated data analyses that were offered in the proposal, along with the circumstances, justification, and resolution of the deviation. |
Need help with research
methodology, survey design, data analysis, or editing?
Contact us at editing@bold-ed.com
Copyright BOLD Educational Software 2009
Diane M. Dusick, Ph.D.
All Rights Reserved