Skip to content

Commit

Permalink
Add: Benchmark result
Browse files Browse the repository at this point in the history
  • Loading branch information
@tkf
tkf committed Jun 30, 2020
1 parent 2b84eb5 commit 76538f7
Show file tree
Hide file tree
Showing 2 changed files with 263 additions and 0 deletions.
263 changes: 263 additions & 0 deletions 2020/06/30/091108/result.md
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,263 @@
# Benchmark result

* Target commit: [`4ff215dd7f17dd7d4730d18d3ede2f0a77683722`](https://github.com/JuliaFolds/FLoops.jl/commit/4ff215dd7f17dd7d4730d18d3ede2f0a77683722)
* Pull request: <https://github.com/JuliaFolds/FLoops.jl/pull/13> (Use BenchmarkCI.pushresult)

# Judge result
# Benchmark Report for */home/runner/work/FLoops.jl/FLoops.jl*

## Job Properties
* Time of benchmarks:
- Target: 30 Jun 2020 - 09:10
- Baseline: 30 Jun 2020 - 09:10
* Package commits:
- Target: 2fcc79
- Baseline: 621ecb
* Julia commits:
- Target: 44fa15
- Baseline: 44fa15
* Julia command flags:
- Target: None
- Baseline: None
* Environment variables:
- Target: None
- Baseline: None

## Results
A ratio greater than `1.0` denotes a possible regression (marked with :x:), while a ratio less
than `1.0` denotes a possible improvement (marked with :white_check_mark:). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

| ID | time ratio | memory ratio |
|--------------------------------------------------------------|------------------------------|--------------|
| `["sum", ":label => \"BlockVector\"", ":impl => \"floop\""]` | 0.88 (5%) :white_check_mark: | 1.00 (1%) |
| `["sum", ":label => \"BlockVector\"", ":impl => \"for\""]` | 1.05 (5%) :x: | 1.00 (1%) |
| `["sum", ":label => \"filter\"", ":impl => \"floop\""]` | 0.90 (5%) :white_check_mark: | 1.00 (1%) |
| `["sum", ":label => \"flatten\"", ":impl => \"floop\""]` | 0.87 (5%) :white_check_mark: | 1.00 (1%) |
| `["sum", ":label => \"flatten\"", ":impl => \"for\""]` | 1.05 (5%) :x: | 1.00 (1%) |

## Benchmark Group List
Here's a list of all the benchmark groups executed by this job:

- `["sum", ":label => \"BlockVector\""]`
- `["sum", ":label => \"Vector\""]`
- `["sum", ":label => \"filter\""]`
- `["sum", ":label => \"flatten\""]`

## Julia versioninfo

### Target
```
Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
OS: Linux (x86_64-pc-linux-gnu)
Ubuntu 18.04.4 LTS
uname: Linux 5.3.0-1031-azure #32~18.04.1-Ubuntu SMP Mon Jun 22 15:27:23 UTC 2020 x86_64 x86_64
CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz:
speed user nice sys idle irq
#1 2294 MHz 12510 s 0 s 1390 s 9807 s 0 s
#2 2294 MHz 7742 s 0 s 1668 s 14666 s 0 s
Memory: 6.764884948730469 GB (3020.33203125 MB free)
Uptime: 254.0 sec
Load Avg: 1.1650390625 0.82763671875 0.37255859375
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-8.0.1 (ORCJIT, broadwell)
```

### Baseline
```
Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
OS: Linux (x86_64-pc-linux-gnu)
Ubuntu 18.04.4 LTS
uname: Linux 5.3.0-1031-azure #32~18.04.1-Ubuntu SMP Mon Jun 22 15:27:23 UTC 2020 x86_64 x86_64
CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz:
speed user nice sys idle irq
#1 2294 MHz 15332 s 0 s 1411 s 11686 s 0 s
#2 2294 MHz 9602 s 0 s 1756 s 17437 s 0 s
Memory: 6.764884948730469 GB (3063.18359375 MB free)
Uptime: 302.0 sec
Load Avg: 1.1328125 0.8720703125 0.412109375
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-8.0.1 (ORCJIT, broadwell)
```

---
# Target result
# Benchmark Report for */home/runner/work/FLoops.jl/FLoops.jl*

## Job Properties
* Time of benchmark: 30 Jun 2020 - 9:10
* Package commit: 2fcc79
* Julia commit: 44fa15
* Julia command flags: None
* Environment variables: None

## Results
Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

| ID | time | GC time | memory | allocations |
|--------------------------------------------------------------|----------------:|--------:|----------------:|------------:|
| `["sum", ":label => \"BlockVector\"", ":impl => \"floop\""]` | 1.670 μs (5%) | | | |
| `["sum", ":label => \"BlockVector\"", ":impl => \"for\""]` | 29.200 μs (5%) | | | |
| `["sum", ":label => \"Vector\"", ":impl => \"floop\""]` | 822.500 ns (5%) | | | |
| `["sum", ":label => \"Vector\"", ":impl => \"for\""]` | 823.457 ns (5%) | | | |
| `["sum", ":label => \"filter\"", ":impl => \"floop\""]` | 811.364 ns (5%) | | | |
| `["sum", ":label => \"filter\"", ":impl => \"for\""]` | 2.033 μs (5%) | | | |
| `["sum", ":label => \"flatten\"", ":impl => \"floop\""]` | 1.660 μs (5%) | | | |
| `["sum", ":label => \"flatten\"", ":impl => \"for\""]` | 152.602 μs (5%) | | 220.91 KiB (1%) | 8053 |

## Benchmark Group List
Here's a list of all the benchmark groups executed by this job:

- `["sum", ":label => \"BlockVector\""]`
- `["sum", ":label => \"Vector\""]`
- `["sum", ":label => \"filter\""]`
- `["sum", ":label => \"flatten\""]`

## Julia versioninfo
```
Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
OS: Linux (x86_64-pc-linux-gnu)
Ubuntu 18.04.4 LTS
uname: Linux 5.3.0-1031-azure #32~18.04.1-Ubuntu SMP Mon Jun 22 15:27:23 UTC 2020 x86_64 x86_64
CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz:
speed user nice sys idle irq
#1 2294 MHz 12510 s 0 s 1390 s 9807 s 0 s
#2 2294 MHz 7742 s 0 s 1668 s 14666 s 0 s
Memory: 6.764884948730469 GB (3020.33203125 MB free)
Uptime: 254.0 sec
Load Avg: 1.1650390625 0.82763671875 0.37255859375
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-8.0.1 (ORCJIT, broadwell)
```

---
# Baseline result
# Benchmark Report for */home/runner/work/FLoops.jl/FLoops.jl*

## Job Properties
* Time of benchmark: 30 Jun 2020 - 9:10
* Package commit: 621ecb
* Julia commit: 44fa15
* Julia command flags: None
* Environment variables: None

## Results
Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

| ID | time | GC time | memory | allocations |
|--------------------------------------------------------------|----------------:|--------:|----------------:|------------:|
| `["sum", ":label => \"BlockVector\"", ":impl => \"floop\""]` | 1.900 μs (5%) | | | |
| `["sum", ":label => \"BlockVector\"", ":impl => \"for\""]` | 27.700 μs (5%) | | | |
| `["sum", ":label => \"Vector\"", ":impl => \"floop\""]` | 800.000 ns (5%) | | | |
| `["sum", ":label => \"Vector\"", ":impl => \"for\""]` | 800.000 ns (5%) | | | |
| `["sum", ":label => \"filter\"", ":impl => \"floop\""]` | 900.000 ns (5%) | | | |
| `["sum", ":label => \"filter\"", ":impl => \"for\""]` | 2.100 μs (5%) | | | |
| `["sum", ":label => \"flatten\"", ":impl => \"floop\""]` | 1.900 μs (5%) | | | |
| `["sum", ":label => \"flatten\"", ":impl => \"for\""]` | 144.901 μs (5%) | | 220.91 KiB (1%) | 8053 |

## Benchmark Group List
Here's a list of all the benchmark groups executed by this job:

- `["sum", ":label => \"BlockVector\""]`
- `["sum", ":label => \"Vector\""]`
- `["sum", ":label => \"filter\""]`
- `["sum", ":label => \"flatten\""]`

## Julia versioninfo
```
Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
OS: Linux (x86_64-pc-linux-gnu)
Ubuntu 18.04.4 LTS
uname: Linux 5.3.0-1031-azure #32~18.04.1-Ubuntu SMP Mon Jun 22 15:27:23 UTC 2020 x86_64 x86_64
CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz:
speed user nice sys idle irq
#1 2294 MHz 15332 s 0 s 1411 s 11686 s 0 s
#2 2294 MHz 9602 s 0 s 1756 s 17437 s 0 s
Memory: 6.764884948730469 GB (3063.18359375 MB free)
Uptime: 302.0 sec
Load Avg: 1.1328125 0.8720703125 0.412109375
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-8.0.1 (ORCJIT, broadwell)
```

---
# Runtime information
| Runtime Info | |
|:--|:--|
| BLAS #threads | 2 |
| `BLAS.vendor()` | `openblas64` |
| `Sys.CPU_THREADS` | 2 |

`lscpu` output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
NUMA node(s): 1
Vendor ID: GenuineIntel
CPU family: 6
Model: 79
Model name: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Stepping: 1
CPU MHz: 2294.686
BogoMIPS: 4589.37
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 32K
L1i cache: 32K
L2 cache: 256K
L3 cache: 51200K
NUMA node0 CPU(s): 0,1
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt md_clear


| Cpu Property | Value |
|:------------------ |:------------------------------------------------------- |
| Brand | Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz |
| Vendor | :Intel |
| Architecture | :Broadwell |
| Model | Family: 0x06, Model: 0x4f, Stepping: 0x01, Type: 0x00 |
| Cores | 2 physical cores, 2 logical cores (on executing CPU) |
| | No Hyperthreading detected |
| Clock Frequencies | Not supported by CPU |
| Data Cache | Level 1:3 : (32, 256, 51200) kbytes |
| | 64 byte cache line size |
| Address Size | 48 bits virtual, 44 bits physical |
| SIMD | 256 bit = 32 byte max. SIMD vector size |
| Time Stamp Counter | TSC is accessible via `rdtsc` |
| | TSC increased at every clock cycle (non-invariant TSC) |
| Perf. Monitoring | Performance Monitoring Counters (PMC) are not supported |
| Hypervisor | Yes, Microsoft |

Binary file added 2020/06/30/091108/result.tar.zst
View file
Binary file not shown.

0 comments on commit 76538f7

Please sign in to comment.