Saturday, November 7, 2026

Qualitative Thinking and Research in Data Science

 

Why the Data Revolution Needs Qualitative Thinking

by Anissa Tanweer, Emily Kalah Gade, P.M. Krafft, and Sarah Dreier

Published on

Jul 30, 2021

Harvard Data Science Review

https://hdsr.mitpress.mit.edu/pub/u9s6f22y/release/4


In this article, we focus on a set of concepts that are intrinsically informed by particular epistemological and ontological positions common in qualitative social sciences—positions that seek to understand the contingently and subjectively constructed nature of the social world. We refer to these concepts as ‘sensibilities’ because we intend them to intervene on methodology in a sensitizing rather than prescriptive way. The three sensibilities we discuss, have certain kinds of methodological practices, and they can be coupled with multiple modes of data collection and analysis.





Sensibility


Interpretivism


Working definition

An epistemological approach probing the multiple and contingent ways that meaning is ascribed to objects, actions, and situations.


Example of related methods

Trace ethnography (Geiger & Ribes, 2011; Geiger & Halfaker, 2017)


Sensibility


Abductive reasoning

Working definition

A mode of inference that updates and builds upon preexisting assumptions based on new observations in order to generate a novel explanation for a phenomenon.

Example of related methods

Iterations of open coding, theoretical coding, and selective coding (Thornberg & Charmaz, 2013)

Sensibility


Reflexivity

Working definition

A process by which researchers systematically reflect upon their own positions relative to their object, context, and method of inquiry.

Example of related methods

Brain dumps, situational mapping, and toolkit critiques (Markham, 2017)


Abduction

Abduction is often described as “inference to the best explanation” (Douven, 2011). 

Abductive reasoning updates and builds upon preexisting assumptions (in other words, theories) based on new observations in order to generate a novel explanation for a phenomenon. As such, it demarks “a creative outcome which engenders a new idea,"

When using abductive reasoning, qualitative researchers have developed ways of addressing the relationships between prior assumptions, new observations, and newly derived explanations. This can be incorporated in data science. 


The labeling of data in qualitative methods (what qualitative researchers would instead call ‘coding’) is not a matter of mere assumption, but rather a systematic part of the theory-building process.



LinkedIn AI article

What are the most common reasoning frameworks for data science?

https://www.linkedin.com/advice/0/what-most-common-reasoning-frameworks-data-science-41fif

I made a contribution to the above article.

The above article in is decision making series

https://www.linkedin.com/pulse/topics/soft-skills-s2976/decision-making-s2506/

Jan 11, 2023

AI concepts for beginners - Exploring abductive reasoning in AI

https://indiaai.gov.in/article/exploring-abductive-reasoning-in-ai


Qualitative Data Analysis Methodologies and Methods

Last Updated : 23 Jul, 2025

https://www.geeksforgeeks.org/data-analysis/qualitative-data-analysis-methodologies-and-methods/


Leveraging LLM and Data Science Methods to Quantify Qualitative Data: A Workflow and Method Example





Making Sense of Data: AI-based NLP Tools for Education Research
by Prof.Dr.Ergul Demir | Sep 5, 2025
https://blog.eera-ecer.de/nlp-tools-for-education-research/


20 October 2023

15 Pages
Thematic Analysis of Big Data in Financial Institutions Using NLP Techniques with a Cloud Computing Perspective: A Systematic Literature Review
Full paper

Ratnesh Kumar Sharma, et al.
1
School of Computer Science, Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney 2007, Australia



A Detailed Guide about Natural Language Processing and NLP Techniques Every Data Scientist Should Know
https://medium.com/@dejanmarkovic_53716/a-detailed-guide-about-natural-language-processing-and-nlp-techniques-every-data-scientist-should-08bfc0ca7ec3

Open access
Research article
First published online November 8, 2023
Natural Language Processing Enhanced Qualitative Methods: An Opportunity to Improve Health Outcomes
R. David Parker https://orcid.org/0000-0002-1955-7445 david.parker@alaska.edu, Karen Mancini, and Marissa D. Abram



Using Natural Language Processing (NLP) to predict the future
Published
November 15, 2025·
Updated
October 13, 2026·
Alex Nikic
https://fastdatascience.com/natural-language-processing/predict-future/


Natural language processing for data analysis: an application on the well-being
Open access
Published: 10 June 2026
Volume 60, pages 18253–18287 (2026)
https://link.springer.com/article/10.1007/s11135-026-02894-9


Bringing Data Science to Qualitative Analysis
Year: 2018, Pages: 325-326
DOI Bookmark: 10.1109/eScience.2018.00076
Authors
You-Wei Cheah, Lawrence Berkeley Nat. Lab., Berkeley, CA, USA  
Drew Paine, Lawrence Berkeley Nat. Lab., Berkeley, CA, USA  
Devarshi Ghoshal, Lawrence Berkeley Nat. Lab., Berkeley, CA, USA  
Lavanya Ramakrishnan, Lawrence Berkeley Nat. Lab., Berkeley, CA, USA
https://www.computer.org/csdl/proceedings-article/e-science/2018/915600a325/17D45W2WyAq
























ud. 8.11.2026

pub. 22.11.2023