VST Testing Methodology
1. Preparing for Testing
Before testing begins, we set up a controlled environment to ensure reliable results:
Identify Plugin Type: Synthesizer, effect, or utility. Understanding the plugin’s purpose allows us to tailor our testing approach.
DAW and System Setup: We test across multiple DAWs and operating systems, using professional hardware, accurate monitoring, and a variety of sample rates and bit depths.
Test Material: Synths are evaluated with full-range MIDI sequences and velocity layers. Effects are tested using diverse audio stems, including drums, bass, vocals, and full mixes.
2. Functionality Testing
We make sure the plugin works as intended in a variety of scenarios:
Preset and Loading Checks: Factory presets are tested for accuracy and reliability.
Parameter Response: All controls are verified for smooth operation and proper automation response.
MIDI and Sidechain Testing: Synths are tested for MIDI mapping, velocity response, and modulation, while effects are checked for correct sidechain routing.
3. Sound Quality Evaluation
Sound is our main focus:
Tonal Accuracy: We check whether the plugin’s output is clear, rich, and free of artifacts.
Dynamic Range and Transparency: Compressors, limiters, and EQs are evaluated for coloration and fidelity.
Frequency Response and Stereo Imaging: We analyze consistency across frequencies and ensure stereo effects are phase-accurate.
4. Performance and Stability
We test the plugin under stress to ensure reliability:
CPU and Memory Usage: Light and heavy patches are evaluated.
Latency: Both DAW-reported and audible latency are measured.
Stress Testing: Multiple instances, extreme modulation, and high polyphony are tested to detect any instability or crashes.
5. Usability and Interface
A plugin should be intuitive and easy to use:
GUI and Layout: Controls are logically arranged, labels and meters are clear.
Workflow: We evaluate preset management, randomization, undo/redo, and documentation accessibility.
6. Compatibility
Plugins are tested to ensure they work across platforms:
DAWs: VST2, VST3, AU, and AAX formats
Operating Systems: Windows 10/11 and macOS (Intel & Apple Silicon)
Bit Depth and Sample Rate: Evaluated across different session settings to ensure consistency
7. Documentation and Reporting
Each plugin receives a detailed report including:
| Category | Score (1–10) | Observations / Issues | Suggested Improvements | Priority (Low/Med/High) |
|-------------------------|--------------|---------------------|----------------------|-------------------------|
| Feature Clarity | | | | |
| Parameter Control | | | | |
| Usability | | | | |
| Stability | | | | |
| CPU Usage | | | | |
| Overall Recommendation | Accept / Marginal / Reject | | | |
The report may also include audio examples demonstrating plugin performance under various conditions.
8. Optional Advanced Testing
For more thorough evaluations, we may also perform:
Blind testing to reduce bias
A/B comparisons with reference plugins
Extreme scenario testing, such as unusual sample rates, complex MIDI input, or chained instances