search

davidfoerster / KaleidOK-examples

KaleidOk invites participants to use a new kind of interactive media tool and take part in an emerging experience which explores speech recognition, media retrieval and visuals generating in a collaborative context (between people, and between people and machines).
http://www.kaleidok.co/
5 stars 0 forks source link

Audio processing thread freezing and going idle #26

Closed Disastergirl closed 9 years ago

Disastergirl commented 9 years ago

kaleidOk is freezeng a lot and going Idle very often. This is new behaviour and I think unrelated to my graphics card

See the video: https://drive.google.com/file/d/0BwbcYwZE23T1SHg1MVR0SFZkY1E/view?usp=sharing

davidfoerster commented 9 years ago

You're running it with JDK 1.8, but neither Processing v3.0a5 nor TarsosDSP v2.1 support it (yet). Please try again with JDK 1.7 until KaleidOK is migrated to a newer version of Processing, that supports JDK 1.8 (exclusively).

If you submit a new video, it would be good to have a description, of what you're doing at each moment, if it's not obvious visually – either through an audio commentary (should work at the same time as the audio stuff from KaleidOK) or timed "subtitles".

davidfoerster commented 9 years ago

I also noticed, that the sampling format might be different than expected in your setup. There exceptions in the program output pointing towards this and some of the freezes seem to occur at the same time as the exceptions. I'll investigate this issue further, if it reappears with JDK 1.7.

davidfoerster commented 9 years ago

According to our conversation, installing and switching to JDK 1.7 as the project SDK in IntelliJ fixed the exception visible in the video (AssertionError at com.getflourish.stt2.AudioTranscriptionProcessor.convertTo16Bit(AudioTranscriptionProcessor.java:195)).

davidfoerster commented 9 years ago

Reopening since the issue reappeared. Error log from @Disastergirl via Skype:

/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/bin/java -Djava.library.path=/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/gluegen-rt-natives-linux-amd64.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/gluegen-rt-natives-linux-armv6hf.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/gluegen-rt-natives-linux-i586.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/gluegen-rt-natives-windows-amd64.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/gluegen-rt-natives-windows-i586.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/jogl-all-natives-linux-amd64.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/jogl-all-natives-linux-armv6hf.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/jogl-all-natives-linux-i586.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/jogl-all-natives-windows-amd64.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/jogl-all-natives-windows-i586.jar -ea -Didea.launcher.port=7533 "-Didea.launcher.bin.path=/Applications/IntelliJ IDEA 14 CE.app/Contents/bin" -Dfile.encoding=UTF-8 -classpath "/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/lib/dt.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/lib/javafx-doclet.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/lib/javafx-mx.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/lib/jconsole.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/lib/sa-jdi.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/lib/tools.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/htmlconverter.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/jfxrt.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/rt.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Volumes/Disasterchine/Applications2/GitHub/KaleidOK-examples/out/production/Kaleidoscope:/Volumes/Disasterchine/Processing/projects/libraries/TarsosDSP-2.2/library/TarsosDSP-2.2-bin.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/gluegen-rt-natives-linux-amd64.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/gluegen-rt-natives-linux-armv6hf.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/gluegen-rt-natives-linux-i586.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/gluegen-rt-natives-macosx-universal.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/gluegen-rt-natives-windows-amd64.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/gluegen-rt-natives-windows-i586.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/gluegen-rt.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/jogl-all-natives-linux-amd64.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/jogl-all-natives-linux-armv6hf.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/jogl-all-natives-linux-i586.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/jogl-all-natives-macosx-universal.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/jogl-all-natives-windows-amd64.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/jogl-all-natives-windows-i586.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/jogl-all.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/core.jar:/Volumes/Disasterchine/Applications2/GitHub/KaleidOK-examples/out/production/libraries:/Volumes/Disasterchine/Tran2cre8/Audio Applications/minim/minim.jar:/Users/kimberleybianca/.m2/repository/com/google/code/gson/gson/2.3.1/gson-2.3.1.jar:/Volumes/Disasterchine/Applications2/GitHub/KaleidOK-examples/out/production/javaFlacEncoder:/Volumes/Disasterchine/Applications2/GitHub/synesketch/bin:/Users/kimberleybianca/.m2/repository/org/apache/httpcomponents/fluent-hc/4.5/fluent-hc-4.5.jar:/Users/kimberleybianca/.m2/repository/org/apache/httpcomponents/httpclient/4.5/httpclient-4.5.jar:/Users/kimberleybianca/.m2/repository/org/apache/httpcomponents/httpcore/4.4.1/httpcore-4.4.1.jar:/Users/kimberleybianca/.m2/repository/commons-logging/commons-logging/1.2/commons-logging-1.2.jar:/Users/kimberleybianca/.m2/repository/commons-codec/commons-codec/1.9/commons-codec-1.9.jar:/Users/kimberleybianca/.m2/repository/com/jakewharton/disklrucache/2.0.2/disklrucache-2.0.2.jar:/Users/kimberleybianca/.m2/repository/org/apache/httpcomponents/httpclient-cache/4.5/httpclient-cache-4.5.jar:/Users/kimberleybianca/.m2/repository/org/apache/commons/commons-collections4/4.0/commons-collections4-4.0.jar:/Applications/IntelliJ IDEA 14 CE.app/Contents/lib/idea_rt.jar" com.intellij.rt.execution.application.AppMain kaleidok.examples.kaleidoscope.KaleidoscopeApp
RECORDING
Exception in thread "Audio dispatching" java.lang.AssertionError
  at com.getflourish.stt2.AudioTranscriptionProcessor.convertTo16Bit(AudioTranscriptionProcessor.java:195)
  at com.getflourish.stt2.AudioTranscriptionProcessor.process(AudioTranscriptionProcessor.java:41)
  at be.tarsos.dsp.AudioDispatcher.run(AudioDispatcher.java:269)
  at kaleidok.examples.kaleidoscope.Kaleidoscope$1.run(Kaleidoscope.java:329)
  at java.lang.Thread.run(Thread.java:745)

This appears to be platform-specific, so I need to debug this on your machine. Screensharing through TeamViewer or similar would be the easiest route for that.