|EXPERIMENTAL DESIGN FOR SURVEYS
A short course sponsored by the Joint Program in Survey Methodology
OCTOBER 19-20, 2017
Presented at the Bureau of Labor Statistics Conference Center
Vice President, Westat
A key tool of methodological research is the split-ballot experiment, in which randomly selected subgroups of a sample receive different questions, different response formats, or different modes of data collection. In theory, such experiments can combine the clarity of experimental designs with the inferential power of representative samples. All too often, though, such experiments use flawed designs that leave serious doubts about the meaning or generalizability of the findings. The purpose of this course is to consider the issues involved in the design and analysis of data from experiments embedded in surveys. It covers the purposes of experiments in surveys, examines several classic survey experiments in detail, and takes a close look at some of the pitfalls and issues in the design of such studies. These pitfalls include problems (such as the confounding of the experimental variables) that jeopardize the comparability of the experimental groups, problems (such as nonresponse) that cast doubts on the generality of the results, and problems in determining the reliability of the results. The course will also consider some of the design decisions that almost always arise in planning experiments — issues such as identifying the appropriate error term for significance tests and including necessary comparison groups.
WHO SHOULD ATTEND
Individuals in government, universities, business, and nonprofit organizations who must interpret and evaluate the results of survey experiments or who are involved in design and implementation of such experiments. Although the course will not be especially mathematical, some familiarity with the basics of survey estimation will be helpful.
Roger Tourangeau is a Vice President at Westat, one of the largest survey firms in the United States. Before that he was the Director of the Joint Program in Survey Research at the University of Maryland and a Research Professor at the Institute for Social Research at the University of Michigan. He received his Ph.D. in Psychology from Yale University in 1978 and has been a survey researcher for more than thirty years. Prior to coming to JPSM and the University of Michigan, Tourangeau was a Research Vice President at National Opinion Research Center, where he founded the Statistics and Methodology Center. His research interests include the psychological processes involved in survey responses, and he is the lead author (with Lance Rips and Kenneth Rasinski) of a book on that topic—The Psychology of Survey Response published by Cambridge University Press (2000). He has also conducted a number of studies on the impact of different modes of data collection on the answers to survey questions, especially questions about sensitive topics. More recently, he was the lead author (with Fred Conrad and Mick Couper) of a book on web surveys, The Science of Web Surveys. He has taught at Connecticut College, Yale, Columbia, and Northwestern Universities, at the University of Wisconsin, and at the Joint Program in Survey Methodology.
COURSE MATERIALS AND MEALS
Registrants will be provided with a course lecture notebook. JPSM group continental breakfasts, lunches and refreshments are included in the course fee.
Registrants must check-in with the JPSM onsite each day of the course.
|THURSDAY: OCTOBER 19, 2017|
|8:00 – 9:00||Registrant Check-in and Continental Breakfast|
9:00 – 10:30
|Introduction: Basic Concepts of Experimental Design; Threats to Validity|
|10:30 – 10:45||Morning Break|
|10:45 – 12:15||Some Examples; Exercise 1|
|12:15 – 1:30||Lunch|
|1:30 – 3:00||Basic Experimental Designs|
3:00 – 3:30
3:30 – 5:00
|Experimental Designs (cont’d)|
|FRIDAY: OCTOBER 20, 2017|
|7:45 – 8:45||Registrant Check-in and Continental Breakfast|
|8:45 – 10:15||Comparability and Generalizability|
|10:15 – 10:30||Morning Break|
|10:30 – 12:00||Construct Validity; Decomposing Experimental Effects|
|12:00 – 1:15||Lunch|
|1:15 – 1:30||Exercise 2|
|1:30 – 3:00||Statistical Validity|
|3:00 – 3:15||Afternoon Break|
|3:15 – 5:00||Applying the Framework; Wrap-Up|
Fees and awards are not transferrable due to nonattendance. The course fee is $670 for JPSM sponsor affiliates, $670 for full-time university students, and $900 for other participants. Sponsor Affiliate List
EARLY PAYMENT DISCOUNT
Registrants will receive a fee discount if payment is made by September 30, 2017. Please note that not all courses have a discounted rate. The early payment discounted fees are $645 for sponsors/affiliates, $645 for full-time university students and $875 for participants. Numerous agencies may use current fiscal year’s funds to pay for training in the next fiscal year if there is only one date offered and if there is a discount for early payment. Please contact your agency for details.
Online registration is required. The registration deadline is October 5, 2017. Confirmation of acceptance will be sent after the registration form has been processed. Registrants are responsible for keeping track of their registrations and course dates. Contact JPSM if you have any questions concerning the status of the registration. JPSM Short Courses
Payment by credit card is required. Payment is due October 5, 2017. Payments are course and date specific. Payment may be done online during registration. Post registration payment may be done online using the registration number or by calling 800.937.9320. Credit card payments may also be faxed to 734.764.8263.
Tax Identification Number (
Please notify JPSM as soon as possible if you need to cancel your registration. Fees and awards are not transferrable due to nonattendance. Cancellation requests should be done online. You will be fully reimbursed if you cancel by October 5, 2017. Cancellation October 6-11, 2017 will require a $100 administrative fee, the remainder will be reimbursed. Cancellation on or after October 12, 2017is subject to the full fee amount.
The Joint Program in Survey Methodology strives to increase the number of survey professionals from groups traditionally under-represented in the field. As part of this effort, a limited number of competitive fellowships are available to African-Americans, Latinos, Hispanic Americans, and Native American Indians for the short course. The registrant must be a US citizen or permanent resident. A limited number of fellowships are available for each course. The committee takes a number of factors into consideration when awarding the fellowships.
Fellowship applicants should submit:
The online registration form, essay, and letter of recommendation are due by September 21, 2017 . JPSM will evaluate the applications and inform the successful applicants by September 28, 2017. The fellowship covers the registration fee, materials to be distributed during the course and the JPSM group continental breakfasts, lunches and breaks. The essay and letter of recommendation may be faxed to 734.764.8263 or emailed to email@example.com.
BUREAU OF LABOR STATISTICS CONFERENCE AND TRAINING CENTER
Visitor Entrance: Postal Square, Building, 1st Street, NE, Washington, D.C. 20212-0001
Classroom: Conference Rooms 1-2-3, Conference Center: 202.691.6630
The course will be held at Bureau of Labor Statistics Conference and Training Center in Washington DC. Attendees are required to enter through the visitor entrance on First Street NE (between Massachusetts Avenue and G Street, NE) across from Union Station. Do not use the main entrance on 2 Massachusetts Avenue. Please note that food is not allowed in the classroom. Only drinks with caps or lids are allowed into the classroom.
ID REQUIREMENT AND SCREENING
All visitors must present a valid photo ID at the visitor’s entrance and pick up a visitor’s badge. Visitors and packages will be processed through the x-ray and metal detector screening equipment. Please arrive 10 minutes early to allow enough time to go through security. Attendees must check-in with JPSM onsite assistant at the course.
LAPTOPS AND NOTEPADS
Equipment brought into BLS requires property passes. Passes can be picked up from the receptionist either when you arrive or depart from BLS. Wi-Fi is available in the conference area.
Individuals are responsible for making their own overnight room reservations and for payment.
Union Station Information
WMATA Washington Metropolitan Area Transit Authority
WMATA Union Station
Union Station (Red Line): 701 First Street. NE, Washington, DC 20002
Entrance 1: East side of First Street., NW, (west side Union Station)
Entrance 2: Massachusetts Avenue (entrance to Amtrak Terminal)
Metro Directions: Traveling by metro is preferred. The Bureau of Labor Statistics is located across the street from Union Station. Take the Metro Red Line to Union Station. Exit the platform at the North end of the station (exit that says to Amtrak trains). There is a doorway exit to the left of the turnstiles and manager’s kiosk. Go out that door instead of taking the escalator up to Union Station and straight across the street is the visitor’s entrance to BLS.
Union Station: Amtrak, MARC and VRE
Registrants are responsible for parking fees. Parking is available in a number of commercial parking lots within a 1-4 block radius. Daily parking fees range from $14-20.
Colonial Parking: 750 1st St NE (between G Pl NE-H St NE)
Colonial Parking: 810 1st St NE (at H St NW)
Colonial Parking: 1 Massachusetts Ave NW (between F St NW – G St NW)
Colonial Parking: 25 Massachusetts Ave NW (between N Capitol Ave NW – New Jersey Ave NW)
Colonial Parking (Union Station): 30 Massachusetts Ave NE (between 1st Street NE – 2nd St NE)
Altman’s parking: 50 Massachusetts Ave NW (between N Capitol St NW -New Jersey Ave NW)
Colonial Parking: 15 F St NW (between 1st St NW-N Capitol St NW)
PMI Garage: 10 G St NE (between 1st St NE – N Capitol St NE)
Colonial Parking: 400 N Capitol St (between D St NW – E St NW)
Quimper Inc.: 777 N Capitol St NE (between G Pl NE – H St NE)
MarcParc Garage: 825 N Capitol St NW (between H St NE – K St NE)
Central Parking System Inc.: 400 New Jersey Ave NW (between D St NW – E St NW)
From the East: Follow New York Avenue (west) into the city. Turn left on First Street, N.E. The building will be on your right. The building is on the corner of Massachusetts Avenue and North Capitol Street.
From the West or North: Take Capital Beltway. Exit on New Hampshire Avenue (south). New Hampshire Avenue turns into North Capitol Street when you enter the District of Columbia. Keep driving south on North Capitol to Massachusetts Avenue. The building will be on your left at the corner of Massachusetts Avenue and North Capitol Street.
From the South: Follow I-395 north. Take Massachusetts Avenue exit. Turn right onto Massachusetts Avenue (going east). The building will be on your left at the corner of Massachusetts Avenue and North Capitol Street.
DCA- RONALD REAGAN WASHINGTON NATIONAL AIRPORT (5.4 mi)
Ground Transportation at DCA
Ronald Reagan Washington National Airport Metro Stop (Metro Blue & Yellow Line): The Washington, DC Metrorail system has an elevated Metro Rail station connected to the concourse level at Reagan National Airport. Take the Blue Line towards Largo Town. Transfer to the Red Line at Center Metro Station transfer to the Red Line. Go towards Silver Spring or Glenmont Metro. Exit at the Union Station Metro Station.
DCA Metro Access: In DCA Terminals B and C there are connecting pedestrian bridges to the metro station. If exiting from DCA Terminal A go to the street side curb. Board an “Airport Shuttle” bus. At the stops for Parking Garages B and C (bus shelter #3 and bus shelter #5) you may access an enclosed bridge which connects to the Metrorail station.
Super Shuttle: Ticket counters located in Terminal B and C baggage claim area located next to doors 4 and 9. Ticket counters are open daily from 6:00 AM to 1:00 AM. Guests arriving in Terminal A should precede outside to the Super Shuttle loading area immediately outside the Terminal A door. Call 800.258.3826 for assistance.
IAD – DULLES INTERNATIONAL AIRPORT (28.7 mi)
Ground Transportation at IAD
BWI – BALTIMORE WASHINGTON INTERNATIONAL THURGOOD MARSHALL AIRPORT (31.3 mi)
Ground Transportation at BWI
Questions for this course should be directed to the JPSM Short Course, University of Maryland, 1218 Lefrak Hall, College Park, MD 20742, Phone: 301-314-7911, Fax: 301-314-7912, Email: firstname.lastname@example.org . To unsubscribe to the JPSM Short Course Listserv List, please send an email to email@example.com the words "Unsubscribe-Short Course list" in the subject line.
JPSM Home Page: http://jointprogram.umd.edu/
Tax Identification Number (
Primary Funding for JPSM is from the Interagency Council on Statistical Policy