In this online appendix, we test the performance of the AOMAP (asymptotically optimal myopic allocation policy) algorithm under the unknown variances scenario and compare it with EI (expected improvement) and OCBA (optimal computing budget allocation).