Skip to content

Instantly share code, notes, and snippets.

@gangliao

gangliao/baseline.txt

Last active September 13, 2019 06:45
Show Gist options
  • Save gangliao/8795b45bfdc9387c827994aa481a08f0 to your computer and use it in GitHub Desktop.
Save gangliao/8795b45bfdc9387c827994aa481a08f0 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
baseline.txt
RHEL:
Create:
| | # threads | # files | Ops/sec | average time |
|------|-----------|---------|----------|--------------|
| Volt | 1 | 1 | 20.83 | 47 |
| Volt | 1 | 10 | 166.67 | 6 |
| Volt | 1 | 100 | 555.55 | 1 |
| Volt | 1 | 1000 | 1377.41 | 0 |
| VOLT | 1 | 10000 | 2749.51 | 0 |
Open Op:
| | # threads | # files | Ops/sec | average time |
|------|-----------|---------|----------|--------------|
| Volt | 1 | 1 | 333.33 | 3 |
| Volt | 1 | 10 | 1250.0 | 0 |
| Volt | 2 | 10 | 2000.0 | 1 |
| Volt | 1 | 100 | 2777.77 | 0 |
| Volt | 2 | 100 | 4347.82 | 0 |
| Volt | 1 | 1000 | 3816.79 | 0 |
| Volt | 2 | 1000 | 6097.56 | 0 |
| Volt | 1 | 10000 | 5807.20 | 0 |
| Volt | 2 | 10000 | 9442.87 | 0 |
| Volt | 4 | 10000 | 10460.25 | 0 |
| Volt | 8 | 10000 | 11574.07 | 0 |
| Volt | 16 | 10000 | 12987.01 | 1 |
| Volt | 32 | 10000 | 12239.90 | 2 |
---------------------------
Create Op:
| | # threads | # files | Ops/sec | average time |
|------|-----------|---------|----------|--------------|
| HDFS | 1 | 1 | 9.174 | 108 |
| HDFS | 1 | 10 | 108.696 | 9 |
| HDFS | 1 | 100 | 227.790 | 4 |
| HDFS | 1 | 1000 | 522.172 | 2 |
| HDFS | 1 | 10000 | 760.227 | 1 |
| | # threads | # files | Ops/sec | average time |
|------|-----------|---------|----------|--------------|
| Volt | 1 | 1 | 2.08 | 478 |
| Volt | 1 | 10 | 38.02 | 26 |
| Volt | 1 | 100 | 170.06 | 5 |
| Volt | 1 | 1000 | 534.47 | 1 |
| VOLT | 1 | 10000 | 874.12 | 1 |
Open Op:
| | # threads | # files | Ops/sec | average time |
|------|-----------|---------|----------|--------------|
| Volt | 1 | 1 | 14.92 | 66 |
| Volt | 1 | 10 | 133.33 | 7 |
| Volt | 1 | 100 | 444.44 | 2 |
| Volt | 1 | 1000 | 1048.22 | 0 |
| Volt | 1 | 10000 | 1433.89 | 0 |
Add one router: hdfs://localhost:65212
PVolt: Proxy Layer on HFS with VoltDB
Volt: HDFS with VoltDB
| | # threads | # files | Ops/sec | average time |
|-------|-----------|---------|----------|--------------|
| PVolt | 1 | 1000 | 127.82 | 7 |
| PVolt | 10 | 1000 | 871.08 | 11 |
| PVolt | 12 | 1000 | 938.96 | 11 |
| Volt | 12 | 1000 | 1639.34 | 6 |
| PVolt | 24 | 1000 | 1336.89 | 16 |
| Volt | 24 | 1000 | 1557.63 | 14 |
| PVolt | 36 | 1000 | 1331.55 | 25 |
| Volt | 36 | 1000 | 1418.43 | 23 |
./bin/hadoop org.apache.hadoop.hdfs.server.namenode.NNThroughputBenchmark -fs hdfs://localhost:9000 -op create -threads 1 -files 10000 -filesPerDir 10000 -keepResults -logLevel INFO
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment