Home
TS-AudioToMIDI Web Online Help
Introduction
What is Music Recognition
TS-AudioToMIDI in brief
What's new?
Features
Features
Supported formats
System Requirements
Installation
Installing and Uninstalling TS-Audio2MIDI
Quick Start
How to transcribe a WAVE file
How to transcribe music in realtime
Using TS-Audio To MIDI
Basic Operation
Wave Recording
Perform recognition of pre-recorded audio
Realtime recognition
MIDI Playback
Audio Playback
Advanced Topics
Setting Equalizer
Tuning up Selectivity Window
Setting Recognition Parameters
Choosing Recognition Algorithm
Auto Tune
Setting up Threshold and Noise Gate
Setting Harmonic Model
Saving settings
TS-Audio To MIDI Reference
TS-AudioToMIDI Main Window
Wave Playback and Convert controls
Wave Recorder
Device Controls
Tune
Spectrum Analyzer and Keyboard
Filter Window
Graphic Equalizer
Selectivity Window
Noise Gate and Threshold
Instrument selector
Transponse control
Volume control
Harmonic model
MIDI Settings dialog
Algorithm selector
MIDI Channel selector
Minimal Note and Pause duration
Play/Keep silence control
Build-in MIDI Sequencer
Save and Load Recognition Settings
Time Window
MIDI Player position
Spectrum Window
Additional Info
How does TS Audio to MIDI recognizes music
Recognizing pre-recordered files vs on-fly recognition
Recomendations on improving recognition quality
Contacts & Support
Registration
License agreement
FAQ & Troubleshooting
How TS-AudioToMIDI recognizes music
   
All TS-AudioToMIDI recognition algorithms except Mono Correlator are based on a set of oscillatory circuits we call "sensors". There are 87 sensors in the set, by number of keys in a standard piano keyboard. Each sensor is tuned to one of the standard note frequencies. Corellation of sensors is controlled by Selectivity parameter. By changing Selectivity you change resonance curve shape (it is drawn in yellow color on Selectivity window). The set of sensors gives spectrogram as output.

Next stage is spectrogram analysis. First, spectrum is amplified by Equalizer values. The result is processed by one of the note detection algorithms. All algorithms except Mono Correlator use Harmonic Model as one of the most important components. Each musical note nave many spectral components. The lowest one is fundamental tone, it's frequency is perceived as note frequency, and other components, called overtones, have frequencies at 12, 19, 24 and so on semi-tomes higher than base tone. Overtones determine the timble of note. Each instrument has it's own harmonic components amplitude ratio. TS-AudioToMIDI assumes that all notes to be detected have inter-component ratio as it is set in Harmonic model window. Except harmonics ratio for each note two others features are analyzed. They are: amplitude (if amplitude is less than Threshold value, note is rejected) and pitch shape, controlled by Sharpness parameter.
After this each note is compared with Minimal Note duration value, and all notes forbidden in Filter window are filtered out.
In contrast, Mono Correlator recognition algorithm is based on correlation function. Correlation analysis allows to trace a note during all the time it sounds. Mono Correlator does not use Harmonic model, however Minimal Note and Pause duration values as well as Filter settings are taken into account.

Please note, that real-time recognition does not take into account Minimal Note and Minimal Pause duration values, that leads to the difference between what you hear during real-time recognition and what is recordered by built-in MIDI sequencer. To avoid this difference set Minimal Note and Minimal Pause durations to zero.

Related topics:
Choosing Recognition Algorithm
Tuning up Selectivity Window