Click to PrintPublication Date: January 2010

Step 3. Collect New Data

The three primary methods for collecting new data for a needs assessment are interviews, focus groups, and surveys. This section discusses each data collection method; sample instruments are provided in appendix B (PDF 101 KB). Make certain to obtain informed consent from people who participate in the data collection. For guidance on the protection of human subjects, refer to the Guide to Protecting Human Subjects in this series.

Interviews

Using a structured set of questions, you can conduct interviews in person or over the telephone. Face-to-face interviews allow you to observe a respondent’s nonverbal communication, which can help shape the direction of the interview. Telephone interviews can be useful when time, travel, and budget limitations prevent meeting in person.

Here are some tips for conducting an interview:

  • Talk slowly with a moderate tone. A measured pace and tone will facilitate the flow of information to and from respondents.
  • Keep the discussion focused. Because the time available for each question is limited, focus on the topic at hand. Be willing and able to rein in the conversation if it goes astray.
  • Use silence to allow for elaboration. Allowing for pauses will give respondents an opportunity to formulate their thoughts on a topic, think of additional information, and transition from one question to the next.
  • Probe for clarification. Answers to questions are not always direct and may require clarification or followup. Steer the respondent toward the issue at hand.

Focus Groups

A focus group is similar to an interview but involves talking to a group of people who have direct experience or information to share on a given topic. Focus group questions should guide the group’s discussion.

A focus group requires a lot of planning. This checklist can help you with the planning process:

check mark icon Determine the participants you will need (e.g., number, type) and generate a contact list.
check mark icon Secure a location for the meeting. Visit the site to make sure it is accessible and comfortable.
check mark icon Send an invitation letter to prospective participants that explains the purpose of the focus group, the types of questions that will be asked, that participation is voluntary, and that any information participants give will be kept confidential. Provide contact information in case the letter’s recipients have questions.
check mark icon Be sure to invite people with diverse perspectives. However, if you are aware of individuals who may have strong opinions and tend to dominate group discussions, you may want to interview them separately. It is important to ensure that the focus group itself is a comfortable environment in which people can share their different points of view.
check mark icon Hire a skilled facilitator. Select someone who has experience conducting focus groups with diverse participants and who has succeeded with previous groups in making sure the goals of the focus group are met. Meet with the facilitator beforehand to review the goals of the focus group and the focus group guide. If necessary, also hire an interpreter.
check mark icon Develop the focus group guide (e.g., script, questions). Seek feedback from the facilitator, who will need to be familiar with the guide. Develop a form to collect basic demographic information (e.g., gender, age, race).
check mark icon Identify and hire a skilled note taker for the day of the meeting.
check mark icon Send a reminder to participants. If possible, collect informed consent statements prior to the meeting. For minors (younger than age 18), secure informed assent from the minor and informed consent from a parent or guardian.
check mark icon A few days before the meeting, visit the site to make sure you have all the resources you need (e.g., projector, boards, chairs, tables). At this time, you may want to determine the types of refreshments to be served.
check mark icon On the meeting day, arrive early to set up the room to foster a positive environment.
check mark icon If you have not already obtained the appropriate forms from participants, ask them to complete the demographic information and the informed consent forms.
check mark icon Conduct your focus group meeting.
check mark icon After the discussion, give participants information about who to contact if they have more to say. Thank everyone for contributing.
check mark icon Shortly after the meeting, analyze the notes to determine if any followup is necessary.

The questions asked during the focus group should be broad enough to foster a discussion, yet structured enough to keep the discussion focused on the information you need. Using a skilled facilitator will help you to get the data you need from the meeting.

Sample focus group materials can be found in appendix B (PDF 101 KB).

Surveys

A survey is a research tool used to collect information using structured questions that are primarily closed-ended (e.g., yes/no questions, rating questions). You may also decide to include a few open-ended questions that ask respondents to explain their answers so you can obtain more information about an issue. Surveys can be administered by mail, in person, or over the telephone.

Exhibit 1 illustrates examples of questions you might ask as well as the format for different answer choices.

Exhibit 1
Sample Survey Questions and Answer Choices
Question Formats for Answer Choice
Are you familiar with the Crime Victims’ Rights Act of 2004? Circle one:

No     Somewhat     Very
  1      2      3      4       5


What outreach efforts have you used to educate the community about the Crime Victims’ Rights Act? Check all that apply:

check boxMedia campaigns
check boxSeminars and workshops
check boxNewspaper articles and newsletters
check boxOther:                                   


Does your state or local community have legislation on victims’ rights? Check one:

check boxYes
check boxNo


Please describe the difficulty you have experienced trying to enforce victims’ rights in your area. Describe:                                                                      
                                                                                     
                                                                                     

Using a combination of open- and closed-ended questions will help keep the respondent engaged and help you obtain the data you need to answer your assessment questions. Furthermore, pilot testing your survey instrument will help you ensure that the questions are asked in a way that will yield meaningful answers.

Exhibit 2 presents the pros and cons of each data collection method presented in this guide.

Exhibit 2
Collecting New Data
Method Advantages Potential Challenges Time Required To Conduct Time Required To Anlalyze Resource Intensity
In-Person Interviews You can obtain more detailed information about complex issues, ask followup questions immediately, and observe nonverbal communication that can help shape the direction of the interview. It can be more costly to conduct site visits, and you may have to limit the number of people that you interview. High High Medium
to High
Telephone Interviews You can obtain detailed information from respondents who are geographically dispersed, and you may save costs compared with in-person interviews. It may be difficult to get someone to talk to you for an extended period. Scheduling the interview may be difficult. Medium to High Medium Medium
Focus Groups You are able to convene a group of experts on your topic, and the discussion can yield insightful information generated by the discussion. Some participants may not feel comfortable sharing their true feelings or knowledge in a group setting. Medium High Medium
to High
Surveys You can solicit specific information from a larger number of people. If you mail surveys, you allow people to complete them at a time most convenient for them. You also can administer them online to increase the response rate. If administered over the telephone, it may be difficult to schedule a time to talk or to get people to talk for an extended period. If administered via mail, it may be difficult to motivate people to complete and mail in the survey, which may result in a lower response rate. Low to Medium Low Medium

Using a combination of the methods described in this section may work best for you. For example, you may decide to conduct a telephone survey and then, based on the preliminary findings, conduct a focus group to further explore what was learned from the survey. When selecting a data collection approach, remember that the ultimate goal is to collect the best information you can to help you learn about the service needs and resources available in your area.