The Audio/Visual Emotion Challenge and Workshop (AVEC 2016) “Depression, Mood and Emotion” will be the sixth competition event aimed at comparison of multimedia processing and machine learning methods for automatic audio, visual and physiological depression and emotion analysis, with all participants competing under strictly the same conditions. The goal of the Challenge is to provide a common benchmark test set for multimodal information processing and to bring together the audio, video and physiological emotion recognition communities, to compare the relative merits of the three approaches to depression and emotion recognition under well-defined and strictly comparable conditions and establish to what extent fusion of the approaches is possible and beneficial. A second motivation is the need to advance depression and emotion recognition systems to be able to deal with fully naturalistic behaviours in large volumes of un-segmented, non-prototypical and non-preselected data, as this is exactly the type of data that both multimedia and human-machine/human-robot communication interfaces have to face in the real world. We are calling for teams to participate in a Challenge of fully-continuous depression and emotion detection from audio, or video, or physiological data, or any combination of these three modalities. As benchmarking database the SimSensei corpus of human-agent interactions will be used for the depression sub-challenge, and the RECOLA multimodal corpus of remote and collaborative affective interactions will be used for the Emotion sub-challenge. Both Depression and Emotion will have to be recognised in terms of continuous time and continuous value. Besides participation in the Challenge we are calling for papers addressing the overall topics of this workshop, in particular works that address the differences between audio, video, and physiological processing of emotive data, and the issues concerning combined audio-visual-physiological emotion recognition.