Release the Verification Script

[jwcullen]

When cutting releases there seems to be manually run verification scripts (1.1 verification, 1.0.0-errata verificiation).

Related scripts are not checked into this repo - only test wav files and textprotos. It's opaque on what is supposed to be the "conformance test", what the expected SNR threshold is etc.

Those attached files imply somewhere there is a tool to actually generate each test vectors script, run the reports, check if they passed etc. At the very least, let's check those scripts into this repo

Then, we can further improve by adding documentation on how to actually run them, add them to automated CI, etc.

[kavithaig]

Hi,
Would it be possible to bump up the priority of this ticket ? We need this to get the validation right from our side.

thanks!

[kavithaig]

Hello,
Would it be possible to release the scripts being used to generate the commandlines for testing? We used the PSNR scripts against the given open source IAMF codec i.e. iamf_reference_codec_output Vs released_reference_wav files and we see failures with the given PSNR script and it's dB expectation. So, I am guessing we might be getting the commandlines wrong there. If you can release the commandlines and the set of guidelines for what will be tested during ceritification, that will be a big help.

Thankyou!