Data documentation

data from agencies

• Illinois Department of Human Services (IDHS): documentation link

• Illinois Department of Employment Services (IDES)

  • Individual wage records: documentation link

  • Employer data: documentation link

• Illinois Department of Corrections (IDOC) admissions: link to pdf

• IDOC exits: link to pdf

  • More details on EDUCLVL and HCLASS fields:

    • link to pdf of notes

    • link to Excel of Offense Codes

  • BIRTHPL lookup file

• HUD program data: link to pdf (note descriptions are of unaggregated data and not all fields will be included due to data use agreements)

• Parole data dictionary: link to Sheet

additional documentation

• IDHS database diagram: html, pdf

• From Chapin Hall:

  • 2000 - Outcomes for the Income Maintenance of Caseload DURING Receipt (PDF)

  • 2000 - Outcomes for the Income Maintenance of Caseload AFTER Receipt (PDF)

  • 2004 - Understanding the Food Stamp Program Participation Decisions for TANF Leavers (PDF)

  • Policy Lab - Increasing Self-Sufficiency Among IL ABAWDs (PDF)

  • Deduplication and data cleaning report for IDHS data (docx)

• More information on programs to help IL welfare recipients find stable jobs (doc)

REFERENCE Diagrams

• IDHS - IDES reference diagram: html, pdf

• IDOC - IDES reference diagram: html, pdf

• Note: Join IDOC to IDHS using the column named "ssn_hash" in:

  • IDOC: "ildoc.person", "ildoc.ildoc_admit", and "ildoc.ildoc_exit"

  • IDHS: "idhs.hh_member" and "idhs.member"

• Offenses and SPSS codes: lookup table

MODULE 1 - Agenda

Please note that the below is subject to change. All times Eastern US
Links for some of the training materials will be posted closer to the date of the sessions

Notebook zipfile

October 11, 2017: Welcome & Introduction, Core Datasets & Git

• 08:00 AM - 08:45 AM Shuttle service to Van Munching Hall (~5 minutes’ travel time)

• 08:45 AM - 09:00 AM Get settled

• 09:00 AM - 10:15 AM Welcome and program introduction (Slides)

• 10:15 AM - 11:00 AM ADRF training & data use agreements (Slides)

• 11:00 AM - 11:15 AM Break

• 11:15 AM - 11:45 AM Orientation to the ADRF

• 11:45 AM - 12:30 PM Command line & git: introduction & basics

• 12:30 PM - 01:30 PM Lunch

• 01:30 PM - 02:45 PM Git, continued

• 02:45 PM - 03:30 PM Defining & scoping data analysis projects

• 03:30 PM - 03:45 PM Break

• 03:45 PM - 05:00 PM Introduction to datasets

• 05:00 PM - 05:15 PM Feedback

October 12, 2017: SQL & Databases

• 08:00 AM - 08:45 AM Shuttle service to Van Munching Hall (~5 minutes’ travel time)

• 08:45 AM - 09:00 AM Get settled

• 09:00 AM - 09:15 AM Overview of day

• 09:15 AM - 09:45 AM Revisit git and command line

• 09:45 AM - 10:45 AM Introduction to SQL & databases

• 10:45 AM - 11:00 AM Break

• 11:00 AM - 12:30 PM Databases & SQL continued

• 12:30 PM - 01:30 PM Lunch

• 01:30 PM - 02:15 PM Guest lecture: John Thompson (slides)

• 02:15 PM - 03:00 PM PostGIS & spatial SQL

• 03:00 PM - 03:15 PM Break

• 03:15 PM - 04:30 PM Explore data

• 04:30 PM - 04:55 PM Daily recap

• 04:55 PM - 05:00 PM Feedback

• Evening: team project assignment

October 13, 2017: Python for Data Analysis

• 08:00 AM - 08:45 AM Shuttle service to Van Munching Hall (~5 minutes’ travel time)

• 08:45 AM - 09:00 AM Get settled

• 09:00 AM - 09:15 AM Overview of day

• 09:15 AM - 10:45 AM Intro to Python for data analysis

• 10:45 AM - 11:00 AM Break

• 11:00 AM - 11:30 AM Metrics: dealing with earnings data

• 11:30 AM - 12:30 PM Python data analysis continued

• 12:30 PM - 01:30 PM Lunch

• 01:30 PM - 02:15 PM Problem solving data analysis

• 02:15 PM - 02:30 PM Project scoping & goal setting

• 02:30 PM - 03:45 PM Teamwork: project discussions

• 03:45 PM - 04:00 PM Break

• 04:00 PM - 04:45 PM Closing discussion & feedback

MODULE 2 - Agenda

Please note that the below is subject to change.
Links for some of the training materials will be posted closer to the date of the sessions

Note: Since there are three timezones participating, different locations will have different start & end times to accommodate project work. We give below times noted as per locations:

Eastern Zones (UMD, NYU, and CT) eastern time noted
09:00 AM - 11:00 AM (Project Work)
11:00 AM - 05:00 PM (Sessions)
Central Zones (Chicago) central time noted
09:00 AM - 10:00 AM (Project Work)
10:00 AM - 04:00 PM (Sessions)
04:00 PM - 05:00 PM (Project Work)
Pacific Zones (UW, Seattle) pacific time noted
08:00 AM - 02:00 PM (Sessions)
02:00 PM - 04:00 PM (Project Work)

Notebook zipfile

Detailed Agenda- all times Eastern

Nov 1, 2017: Record Linkage (For local start/end times, check the beginning of this section)

WebEx recording (full day) and Dealing with earnings data recording (Julia's presentation)

• 09:00 AM - 09:30 AM (Eastern only) Dealing with earnings data (slides)

• 09:30 AM - 11.00 AM Project Time for Eastern/Central Cohort

• 11:00 AM - 11:15 AM Program recap/review (slides)

• 11:15 AM - 12:15 PM SQL & databases

• 12:15 PM - 12:30 PM Break

• 12:30 PM - 01:30 PM Introduction to Record Linkage (link to Slides)

• 01:30 PM - 02:30 PM Lunch

• 02:30 PM - 03:15 PM Guest lecture: Greg Dobler (PDF)

• 03:15 PM - 04:00 PM Record Linkage examples & exercises

• 04:00 PM - 04:15 PM Break

• 04:15 PM - 05:00 PM Record Linkage exercises (continued)

• 05:00 PM - 05:30 PM (Central/Pacific only) Dealing with earnings data (slides)

• 05:30 PM - 07:00 PM Project work time for Central/Pacific locations

Nov 2, 2017: Visualization & APIs (For local start/end times, check the beginning of this section)

WebEx recording

• 09:00 AM - 11:00 AM Project Time for Eastern/Central Cohort

• 11:00 AM - 12.15 PM Introduction to Data Visualization (Link to Slides)

• 12:15 AM - 12:30 PM Break

• 12:30 PM - 01:30 PM Continuing Data Visualization (Link to Slides)

• 01:30 PM - 02.30 PM Lunch

• 02:30 PM - 03.30 PM Introduction to APIs (Link to slides)

• 03:30 PM - 03:45 PM Break

• 03:45 PM - 05:00 PM (team choice) API exercises or project work

• 05.00 PM - 07.00 PM Project work time for Central/Pacific locations

Nov 3, 2017: Network Analysis + Projects (For local start/end times, check the beginning of this section)

WebEx recording

• 09.00 AM - 11.00 AM Project Time for Eastern/Central Cohort

• 11:00 AM - 12:00 PM Network Analysis Lecture + Interactive Introduction

• 12:00 PM - 12:15 PM Break

• 12:15 PM - 01:30 PM Interactive exercises

• 01:30 PM - 02:30 PM Lunch

• 02:30 PM - 05:00 PM Project work

• 05.00 PM - 07.00 PM Project work time for Central/Pacific locations

Sixteen teams will present projects on February 7th & 8th between 12:30 - 4:30pm Eastern. Each team will be given 20 minutes to present followed by up to 10 minutes of Q&A lead by the program directors, Rayid Ghani, Frauke Kreuter, and Julia Lane. Please see the WebEx information, below, for how to view presentations remotely.

Presentation schedule (all times are Eastern US)

February 7 (recording)

• 12:30 - UC 3: Predicting Recidivism due to Technical Violation (ppt)

• 1:00 - UMD 4: Modeling the School to Prison pipeline in Chicago, IL (ppt)

• 1:30 - NYU 4: Success, the Flip-side to the Recidivism Conversation. (ppt)

• 2:00 - UC 1: Benefits After Release: Does it make a difference?

• 2:30 - UMD 6: The TANF Ban and Criminal Activity: Evidence from IL Admin Data (pdf)

• 3:00 - CT 2: A look into Peoria and Cook County Illinois - Measuring access to wages by location (pdf)

• 3:30 - UMD 1: Predicting Future Earnings of Illinois Human Service Benefit Recipients (ppt)

• 4:00 - UW 1: Reducing Return to Welfare (ppt)

Peer review questions.

If possible please respond via this Form; however if you cannot access the form please send answers to the below to dataanalytics@umd.edu:

• Team number (eg NYU 4, UMD 2, UC 3)

• Would the approach used in this project be useful for your agency/organization? (Yes, No, Maybe, N/A)

• What did you like about the project? (short answer)

• What aspects of the project do you think could be improved? (short answer)

WebEx information

Attendee links

• February 7 attendee link

• February 8 attendee link

WebEx testing

• Test instructions from WebEx to ensure software works

• Connecting to WebEx as an Attendee: PDF

• Connecting to WebEx as a Panelist: PDF