vavi-sound-sandbox

🎸 play in the sandbox ♪

Status

SPI	Codec	IN Status	OUT Status	SPI Status	project	Description	Comment
midi	unknown	🚫	🚫	-	this	MFi by unknown
midi	ittake	🚫	🚫	-	this	MFi by ittake
sampled	ilbc	✅	?	✅	this	c
sampled	ldcelp	✅	?	✅	this	c
sampled	mp3	🚫	-	-	this	mp3	need to deal tags
sampled	mp3	✅	-	✅	mp3spi	jlayer
sampled	sse	✅	-	?	this	sse
sampled	normalizer	✅	-	?	this
sampled	resampling	✅	-	✅	this	laoe
sampled	resampling	✅	-	✅	this	rohm
sampled	polyphase	✅	-	✅	this	sox resampling
sampled	resampler	✅	-	✅	this	sox resampling
sampled	perfect	✅	-	✅	this	sox resampling
sampled	monauralize	✅	-	✅	tritonus-remaining	PCM2PCMConversionProvider	works but not suitable for resampling
sampled	alac	✅	-	✅	vavi-sound-alac		🎓 graduated to vavi-sound-alac
sampled	QTKit	✅	-	?	this	rococoa	deprecated
sampled	AVFoundation	🚧	-	🚧	this	rococoa	use AVAudioConverter how to return objc value in callback?
sampled	twinvq	✅	-	✅	this		ffmpeg
midi	vsq	🚧	-	🚧	this		YAMAHA Vocaloid
sampled	opus	✅	🚫	✅	this	concentus
midi	AudioUnit	✅	-	✅	this	rococoa	use AVAudioUnitMIDIInstrument/kAudioUnitSubType_DLSSynth
midi	AudioUnit	✅	-	🚫	this	rococoa	use AVAudioUnitSampler, how to adjust sf2 patch?
midi	JSyn	✅	-	✅	this	JSyn	looking for good drums
midi	OPL3	✅	-	✅	this	adplug	opl3-player, YmF262(cozendey)
midi	?	-	-	-	this		opl, ma
midi	CoreMIDI	✅	?	✅	osxmidi4j	rococoa	iac ✓, network ✓, bluetooth ?
midi	CoreMIDI	✅	?	✅	CoreMidi4J	jni	iac ✓, network ✓, bluetooth ?
sampled	speex	✅	-	✅	jspeex		sample rate is limited to convert
sampled	flac	✅	-	✅	vavi-sound-flac
sampled	flac	✅	-	✅	vavi-sound-flac-nayuki
sampled	aac	-	-	✅	JAADec
sampled	vorbis	-	-	✅	tritonus-jorbis
sampled	atrac3	✅	-	?	vavi-sound-atrack	jpcsp	Sony MD
sampled	atrac3+	✅	-	✅	vavi-sound-atrack	jpcsp	Sony MD
sampled	atrac9	✅	-	✅	vavi-sound-atrack	libatrac9	Sony Playstation
sampled	g728	✅	-	✅	vavi-sound-amr	libCodec
sampled	g729	✅	-	✅	vavi-sound-amr	libCodec
sampled	g729a	✅	-	✅	vavi-sound-amr	libCodec
sampled	amrnb	✅	-	✅	vavi-sound-amr	amrnb
midi	mml	✅	-	✅	this	mml	pc-8801 cmd sing like
midi	karplusStrong	✅	-	✅	this
sampled	xma	✅	-	✅	this	Echo
sampled	wma	✅	-	✅	this	ffmpeg
sampled	auto wiring	✅	-	✅	this		chains the registered conversion spi, no format of its own

Features

• ALAC Java sound SPI ... (graduated incubation)
• OPUS Java sound SPI ... (candidate to graduate)
• sox polyphase resampler Java sound SPI ... (done)
• sox perfect resampler Java sound SPI ... (done)
• sox no name resampler Java sound SPI ... (done)
• sse (equalizer) spi ... (wip)
• normalizer Java sound SPI ... (wip)
• Mac AudioUnit synthesizer Java MIDI SPI ... (candidate to graduate)
• JSyn synthesizer Java MIDI SPI ... (wip)
• OPL3 (about 60 formats) synthesizer Java MIDI SPI ... (candidate to graduate)
• iTunes Library (rococoa) ... Music.app Music Database
• MML synthesizer Java MIDI SPI ... (done)
• karplus strong synthesizer ... (done)
• sf3, sf4, exs soundfont spi ... (done)
• macOS AU panel ... (done)
• twinvq Java sound SPI ... (done)
• wma Java sound SPI ... (done)
• xma Java sound SPI ... (done)
• auto wiring format conversion Java sound SPI ... (done)

Install

• maven

Usage

AudioInputStream opusAis = AudioSystem.getAudioInputStream(new BufferedInputStream(Files.newInputStream(opus)));
AudioFormat inFormat = sourceAis.getFormat();
AudioFormat outFormat = new AudioFormat(44100, 16, 2, true, false);
AudioInputStream pcmAis = AudioSystem.getAudioInputStream(outFormat, opusAis);
SourceDataLine line = (SourceDataLine) AudioSystem.getLine(new DataLine.Info(SourceDataLine.class, pcmAis.getFormat()));
line.open(pcmAis.getFormat());
line.start();
byte[] buffer = new byte[line.getBufferSize()];
int bytesRead;
while ((bytesRead = pcmAis.read(buffer)) != -1) {
  line.write(buffer, 0, bytesRead);
}
line.drain();

system properties

• vavi.sound.sampled.spi.autowired ... set false, only kicks in when no single provider can do the conversion

References

• Gervill
  • https://github.com/HectorRicardo/final-gervill
• https://github.com/philfrei/AudioCue-maven
• https://github.com/jitsi/libjitsi (voice codecs)
• https://amei.or.jp/midistandardcommittee/MIDI1.0.pdf 🇯🇵
• dsp
  • https://github.com/Frieve-A/effetune
  • https://github.com/psambit9791/jdsp
• https://github.com/eclab/edisyn
• https://github.com/eclab/seq

Lesson

• javaassist doesn't support enhanced for
• com.sun.media.sound.SoftMidiAudioFileReader has a bug that consumes 4 bytes and not releases (resets) those after examination

Tech Know

• tritonus-mp3 only supports mp3 w/o tags
• the reason we got "javax.sound.midi.MidiUnavailableException: MIDI OUT transmitter not available" is that sound.jar of JMF is in the class path.

TODO

• jni in maven
• resampling spi
• qt has been deprecated
• volume enabled clip
  • mmscomputing
  • 🎯 playn
• caf
  • https://github.com/ruda/caf

Library

• midi is super heavy
• Transcoder (outdated)
• channels
• jsyn pink noise
• jsyn synth volume
• separate alac (git subtree, split?)
• rename vavi.sound.midi.opl3 to vavi.sound.midi.adlib ?
• check midi reader
  • tritonus???
  • instrument is not needed???
• system property that off opl spi

codec

• twinvq
  • https://github.com/hendriks73/ffsampledsp
  • https://github.com/Icenowy/jcadencii (?)
  • http://k-takata.o.oo7.jp/mysoft/tvqdec.html
  • clean up twinvq
• https://github.com/hendriks73/casampledsp/tree/master (coreaudio is base of avfoundation?)
• https://github.com/drogatkin/JustFLAC → vavi-sound-flac
• lc3 → vavi-sound-lc3
  • https://github.com/ninjasource/lc3-codec
  • https://www.iis.fraunhofer.de/ja/ff/amm/communication/lc3.html
• https://jmac.sourceforge.net/ (monkey's audio) → jmac

midi

macos coremidi

• osxmidi4j → osxmidi4j
• https://github.com/DerekCook/CoreMidi4J (jni)

macos audiounit

• open audiounit custom view
  • https://github.com/nativelibs4java/BridJ (is able to deal objective-c blocks inactive)
• volume
• soundfont spi

others

• opl3
  • need to fix: dro(old), midi, etc?
  • opl3 volume
  • opl3 midi reader
  • https://github.com/Wohlstand/ADLMIDI-Player-Java (android)
• https://github.com/fedex81/emuSandbox
• https://github.com/toyoshim/tss
• Apple DLS Sound device (done)
• https://github.com/comsonica/comsonica-studio
• https://github.com/jtrfp/javamod (has graphical equalizer, opl2,3 emulator) → javamod
• http://www.jfugue.org/download.html
• https://sourceforge.net/projects/bristol/
• https://github.com/Xycl/JSynthLib
• https://github.com/jonasreese/soundsgood
• https://www.kvraudio.com/plugins/macosx/audio-units/
• https://github.com/ggrandes-clones
• pc88 (mml)
  • https://github.com/onitama/mucom88
  • https://github.com/BouKiCHi/mucom88
    • ... https://github.com/umjammer/vavi-sound-mucom88
  • https://github.com/kuma4649/MDPlayer ... https://github.com/umjammer/vavi-apps-mdplayer
• mml (cmd sing)
  • thanks
  • crackling at end https://stackoverflow.com/a/9630897
  • https://github.com/trrk/FlMML-for-Android
  • spi
• Karplus-Strong
  • synthesizer
• exs24 soundfont
  • https://github.com/git-moss/ConvertWithMoss
  • AVAudioUnitSampler can read exs24 soundfont???
• Muse-Sounds
  • https://github.com/CarlGao4/Muse-Sounds
  • ~/Library/Containers/com.muse.hub/Data/InstallData/Instruments/
• spi
  • https://github.com/hendriks73/pcmsampledsp
  • https://github.com/hendriks73/casampledsp
• sf3
  • https://github.com/cognitone/sf2convert
• sfz
  • https://github.com/git-moss/ConvertWithMoss
• sse (equalizer)
• TargetDataLine wav out, data transfer → vavi-sound:HijackSourceDataLine

ebml (Extensible Binary Meta Language: Matroska)

• https://github.com/Matroska-Org/jebml
• https://github.com/matthewn4444/EBMLReader

---

_{image designed by @umjammer, drawn by nano banana}