top of page

Hazard Vulnerability Index in New Jersey

Scoping Review of Machine Learning, AI and Data Science Application in Social Work

research_diagram_high_resolution (1).png

Background
This project involves a review conducted using research papers from various publicly available databases, following the framework developed by Jung et al. (2025). Two individuals with expertise in AI, machine learning (ML), and data science thoroughly examined 59 papers selected using the PRISMA-20 framework. Additionally, we developed a review pipeline using the Gemma 4 model to imitate the human review process and assess how it performs compared to human review.  
​
Abstract
The growing interest in data science within social welfare has increased significantly. However, guidance on appropriate methods and substantive perspectives that address multidisciplinary audiences remains limited. This study evaluates the current state of AI and data science methods in social welfare and related fields by mapping the primary research topics, data sources, and analytical methods. Building on this evaluation, we assess the quality of existing data science scholarship, identify strengths and gaps in the literature, and propose a framework for developing rigorous data science research.  

​

We adopted a two-stage approach to evaluate data science/AI literature. First, we searched established social science databases, identifying 147 peer-reviewed articles published between 2018 and 2024, categorized into four areas: i) data, ii) methods, iii) substantive areas, and iv) conceptual foundations. In the second stage, we selected 59 articles based on three criteria: use of nontraditional or unstructured data, implementation of machine learning methods, and relevant social science applications. We developed an analytic framework aligned with the machine learning pipeline stages to assess each study's methodological completeness, covering data collection, preprocessing, feature engineering, model selection, tuning, training, evaluation, and policy decision-making. Additionally, our scoping review utilized both a manual approach and an LLM-powered pipeline for comparison. 

​

Nearly a third of reviewed articles (30%, 44 out of 147) engaged primarily at the conceptual or policy level, consistent with the social work profession's values-driven identity. Social work scholars notably frontload discussions around algorithmic discrimination, ethics, and fairness, critically reflecting on how the profession adopts these technologies. Substantive areas represented the second most common category at 26%, with child welfare as the dominant sub-area. Text documentation is the leading form of nontraditional data, most often utilized through administrative data linkages. Among the 59 articles examined in the second stage, social work research using data science methods consistently addressed model selection and evaluation. Supervised machine learning for risk prediction, particularly the Random Forest algorithm, was the predominant approach, and comparisons across ML algorithms were limited. Studies broadly fell short in reporting data preprocessing procedures, hyperparameter tuning, evaluation metric trade-offs, and policy evaluation beyond model predictions. 

​

Social work literature emphasizes conceptual and ethical frameworks over technical innovations like AI and data science. Predictive risk analytics in child welfare highlights the field's narrow methodological focus. There's a need to diversify topics, data sources, and methods. Future research should address underreported stages of the data science pipeline and expand policy implications beyond mere prediction. The proposed framework aims to help researchers and practitioners integrate data science methods into social work research systematically. 

​

Visualization
study_selection_flowchart_enhanced.png

Dr. Woojin Jung 

​

Assistant Professor

Rutgers, The State University of New Jersey

​

Core Faculty

Global Health Institute at Rutgers

Contact: 

120 Albany Tower One, Room 345
New Brunswick, NJ 08901 
        848-932-8079      
        wj153@ssw.rutgers.edu

Copyright © 2020 Woojin Jung. All rights reserved.

Website created by Eunice Park

bottom of page