| ... | ... | @@ -128,6 +128,29 @@ We run each test twice, once on NLSAS, once on SSD. The tests are: |
|
|
|
| mdtest hard files per t | 500K | 62.5K | 100K | 500K |
|
|
|
|
| mdtest hard files total | 1000K | 2000K | 16000K | 16000K |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2n1t was chosen to fit a simple MPI job. 4n8t was requested by HPC team to match one of their bigger jobs. 10n16t is to match with certain known IO500 submissions from vendors. 32n1t is to match some non-IO500 benchmarks done by vendors. |
|
|
\ No newline at end of file |
|
|
|
Why these test?
|
|
|
|
|
|
|
|
* 2n1t was chosen to fit a simple MPI job.
|
|
|
|
* 4n8t was requested by HPC team to match one of their bigger jobs.
|
|
|
|
* 10n16t is to match with certain known IO500 submissions from vendors.
|
|
|
|
* 32n1t is to match some non-IO500 benchmarks done by vendors.
|
|
|
|
|
|
|
|
## Results
|
|
|
|
|
|
|
|
| Tests | 2n1t-nlsas | 2n1t-ssd | 4n8t-nlsas | 4n8t-ssd | 10n16t-nlsas | 10n16t-ssd | 32n1t |
|
|
|
|
| ----------------------- | -----------| ----------- | ----------- | ----------- | ------------ | ---------- | ------ |
|
|
|
|
| **ior_easy_write GB/s** | **2.687** | **2.756** | **6.150** | **11.541** | **6.283** | **11.897** | n/a (2)|
|
|
|
|
| mdtest_easy_write kiops | 5.304 | 4.146 | 12.446 | 9.387 | 6.872 | 6.220 | n/a |
|
|
|
|
| ior_hard_write GB/s | 0.008 | 0.036 | 0.049 | 0.366 | 0.156 | 0.953 | n/a |
|
|
|
|
| mdtest_hard_write kiops | 5.088 | 4.067 | 6.260 | 4.743 | 6.762 | 5.570 | n/a |
|
|
|
|
| **find kiops** | **63.520** | **126.030** | **108.610** | **105.110** | **131.290** | **99.810** | n/a |
|
|
|
|
| **ior_easy_read GB/s** | **2.605** | **2.435** | **15.398** | **18.598** | **41.064** | **22.847** | n/a |
|
|
|
|
| mdtest_easy_stat kiops | 13.112 | 11.833 | 15.977 | 15.485 | 18.632 | 19.441 | n/a |
|
|
|
|
| ior_hard_read GB/s | 0.013 | 0.062 | 0.111 | 0.908 | 0.359 | 3.890 | n/a |
|
|
|
|
| mdtest_hard_stat kiops | 10.462 | 11.996 | 23.456 | 19.114 | 15.759 | 18.722 | n/a |
|
|
|
|
| mdtest_easy_del kiops | 2.856 | 2.341 | 5.345 | 3.983 | 4.451 | 4.463 | n/a |
|
|
|
|
| mdtest_hard_read kiops | n/a (1) | 1.392 | 2.560 | 4.242 | 3.958 | 5.038 | n/a |
|
|
|
|
| mdtest_hard_del kiops | n/a (1) | 2.673 | 4.160 | 4.310 | 4.577 | 4.491 | n/a |
|
|
|
|
|
|
|
|
* (1) had a ceph MDS hiccup with client failing to release caps error, killed the slurm job as it was taking too long
|
|
|
|
* (2) 32n1t ssd put too high loads on the SSD pool, perhaps due to having too few storage nodes there vs the clients, and also the big mismatch in network speed (100G on client vs 25G on storage), and crashed 2 storage nodes. Did not have time to run the 32n1t nlsas |
|
|
\ No newline at end of file |
