Selected Publications

Interdisciplinary exchange of ideas and tools can accelerate scientific progress. For example, findings from developmental and vision science have spurred recent advances in artificial intelligence and computer vision. However, relatively little attention has been paid to how artificial intelligence and computer vision can facilitate research in developmental science. The current study presents AutoViDev—an automatic video-analysis tool that uses machine learning and computer vision to support video-based developmental research. AutoViDev identifies full body position estimations in real-time video streams using convolutional pose machine-learning algorithms. AutoViDev provides valuable information about a variety of behaviors, including gaze direction, facial expressions, posture, locomotion, manual actions, and interactions with objects. We present a high-level architecture of the framework and describe two projects that demonstrate its usability. We discuss the benefits of applying AutoViDev to large-scale, shared video datasets and highlight how machine learning and computer vision can enhance and accelerate research in developmental science.
In CVC 2019, 2013

Recent Publications

In addition to semantic content, human speech carries paralinguistic information that conveys important social cues such as a …

Widespread sharing of data and materials (including displays and text- and video-based descriptions of experimental procedures) will …

Interdisciplinary exchange of ideas and tools can accelerate scientific progress. For example, findings from developmental and vision …

Projects

*

PLAY project

The Play & Learning Across a Year Project

databraryapi package

An R package for interacting with the Databrary.org API.

Databrary.org

An open, secure data library for sharing video.

Datavyu.org

An open source tool for video annotation.

Proximal Emotional Environment Project (PEEP)

What is the emotional environment really like?

Experience

 
 
 
 
 
June 2016 – Present

Co-Principal Investigator

The Play & Learning Across a Year (PLAY) Project

 
 
 
 
 
January 2013 – Present
New York

Co-Founder/Co-Director

Databrary.org

Co-founded the first open data library specialized for storing, streaming, and sharing video data.
 
 
 
 
 
July 2004 – Present
Pennsylvania

Associate Professor

The Pennsylvania State University

 
 
 
 
 
July 1997 – June 2004
Pennsylvania

Assistant Professor

The Pennsylvania State University

Recent & Upcoming Talks

Recent Posts

More Posts

Psychology is in part, a science of behavior. Mental experience – thoughts and feelings – are also common targets of …

Several years ago, Florian Raudies, Swapnaa Jayaraman and I published a paper where we simulated the optic flow that infants would …

I’ve been ‘sketching’ out conceptual models for some time without realizing that there is an entire field of analysis where these sorts …

Last night, my friend Mike (N3LI) and I made our first-ever CW QSOs. In ham-speak, that means we chatted using Morse code. It …

For I don’t remember how many years I’ve wanted a lab logo. I thought that designing a logo was something that some student …

Teaching

I teach the following courses:

I have also helped lead the following R workshops:

Contact