Ssj

Social Signal Processing for Android

SSJ is an extensible android framework for social signal processing in an out of lab envirnoment. It packages common signal processing tools in a flexible, mobile friendly Java library which can be easily integrated into Android Apps.

<img align="right" width="220" src="assets/screen_ssj.png"/>

Features

• Realtime signal processing using independent components as processing steps in a pipeline
• Synchronized data streams
• Support for most standard android sensors e.g. Camera, Microphone, Acceleration, GPS
• Support for external sensors via bluetooth e.g. Microsoft Band 2, Myo, Angel Sensor, Empatica
• Advanced signal processing functionality, including machine learning approaches (Neural Networks, SVM, NaiveBayes)
• On device model training capabilities (batch and online learning)
• I/O functionality: local storage, sockets, bluetooth
• Energy efficient processing thanks to advanced sleep state management and support for discrete data propagation
• Live data visualization (using <a href="https://github.com/hcmlab/GraphView">GraphView</a> library)
• SSJ Creator: Android App for building, editing and running SSJ pipelines without writing a single line of code

Download

To use libssj in your own application, download the latest .aar file from the releases section, place it under app/libs/ and include the following line in your app's gradle file:

implementation files('libs/libssj-0.7.8.aar')

<a href='https://play.google.com/store/apps/details?id=hcm.ssj.creator&utm_source=global_co&utm_medium=prtnr&utm_content=Mar2515&utm_campaign=PartBadge&pcampaignid=MKT-Other-global-all-co-prtnr-py-PartBadge-Mar2515-1'><img alt='Get it on Google Play' src='https://play.google.com/intl/en_us/badges/images/generic/en_badge_web_generic.png' height="70" align="right"/></a> The latest version of the SSJ Creator app can be downloaded from the releases section as well. Alternatively, an older version is available in the <a href="https://play.google.com/store/apps/details?id=hcm.ssj.creator">Google Play Store</a>.

Documentation

• White-paper: <a href="https://www.frontiersin.org/articles/10.3389/fict.2018.00013/full">frontiersin.org</a>
• Api (Javadoc): http://hcmlab.github.io/ssj/api
• Example pipeline: Github wiki

About

The Social Signal Processing for Java/Android (SSJ) framework is being developed at the Lab for Human Centered Multimedia of the University of Augsburg. The authors of the framework are: <a href="https://www.informatik.uni-augsburg.de/lehrstuehle/hcm/staff/_formerstaff/damian/">Ionut Damian</a>, <a href="https://www.informatik.uni-augsburg.de/lehrstuehle/hcm/staff/dietz/">Michael Dietz</a>, <a href="https://www.informatik.uni-augsburg.de/lehrstuehle/hcm/staff/_formerstudents/gaibler/">Frank Gaibler</a>, <a href="https://www.informatik.uni-augsburg.de/lehrstuehle/hcm/staff/_formerstudents/langerenken/">Daniel Langerenken</a>, <a href="https://www.informatik.uni-augsburg.de/lehrstuehle/hcm/staff/flutura/">Simon Flutura</a>, <a href="https://www.informatik.uni-augsburg.de/lehrstuehle/hcm/staff/_formerstudents/krumins/">Vitalijs Krumins</a>, Antonio Grieco.

SSJ has been inspired by the SSI (http://openssi.net) framework. SSJ is not a one-to-one port of SSI to Java, it is an approximation. Nevertheless, it borrows a lot of programming patterns from SSI and preserves the same vision for signal processing which makes SSI great. It than packages everything in a flexible, mobile friendly Java library which can be easily integrated into Android Apps.

If you use SSJ for a research project, please reference the following papers:

<ul> <li>Ionut Damian, Michael Dietz, Elisabeth André, <i>The SSJ Framework: Augmenting Social Interactions Using Mobile Signal Processing and Live Feedback</i>, Frontiers in ICT, 2018<br/> <a href="https://www.frontiersin.org/articles/10.3389/fict.2018.00013/full">paper</a> | <a href="https://www.frontiersin.org/articles/10.3389/fict.2018.00013/bibTex">BibTex</a> </li> <li>Ionut Damian, Michael Dietz, Frank Gaibler, Elisabeth André, <i>Social Signal Processing for Dummies</i>, In Proceedings of International Conference on Multimodal Interaction (ICMI), ACM, 2016<br/> <a href="https://www.informatik.uni-augsburg.de/lehrstuehle/hcm/publications/2016-ICMI-Damian2/">paper</a> | <a href="https://www.informatik.uni-augsburg.de/lehrstuehle/hcm/publications/2016-ICMI-Damian2/Damian-SocialSignalProcessing-2016-bib.txt">BibTex</a> | <a href="https://dl.acm.org/citation.cfm?doid=2993148.2998527">dl.acm.org</a> </li> </ul>

License

This library is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 3 of the License, or any later version.

This library is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

You should have received a copy of the GNU General Public License along with this library; if not, write to the Free Software Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA