Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

feat: parallelize VisibilityTracker::from_crate #424

Merged

Conversation

jalil-salame
Copy link
Contributor

@jalil-salame jalil-salame commented Aug 28, 2024

Small perf gains as there isn't much we can parallelize without more code massaging:

(92a9868) ❯ cargo criterion --bench indexed_crate --features rayon
IndexedCrate/new(aws-sdk-ec2)
                        time:   [574.13 ms 575.49 ms 576.92 ms]

(changes) ❯ cargo criterion --bench indexed_crate --features rayon
IndexedCrate/new(aws-sdk-ec2)
                        time:   [557.73 ms 559.38 ms 560.96 ms]
                        change: [-3.1709% -2.8003% -2.4380%] (p = 0.00 < 0.05)
                        Performance has improved.

Last part of #402

Small perf gains as there isn't much we can parallelize without more
code massaging:

```
(92a9868) ❯ cargo criterion --bench indexed_crate --features rayon
IndexedCrate/new(aws-sdk-ec2)
                        time:   [574.13 ms 575.49 ms 576.92 ms]

(changes) ❯ cargo criterion --bench indexed_crate --features rayon
IndexedCrate/new(aws-sdk-ec2)
                        time:   [557.73 ms 559.38 ms 560.96 ms]
                        change: [-3.1709% -2.8003% -2.4380%] (p = 0.00 < 0.05)
                        Performance has improved.
```
@jalil-salame jalil-salame force-pushed the rayon-visibility-tracker branch from 5dc3ca8 to 792961f Compare August 28, 2024 21:20
@obi1kenobi obi1kenobi merged commit 9a6d3dd into obi1kenobi:rustdoc-v33 Aug 29, 2024
12 checks passed
obi1kenobi pushed a commit that referenced this pull request Aug 29, 2024
Small perf gains as there isn't much we can parallelize without more
code massaging:

```
(92a9868) ❯ cargo criterion --bench indexed_crate --features rayon
IndexedCrate/new(aws-sdk-ec2)
                        time:   [574.13 ms 575.49 ms 576.92 ms]

(changes) ❯ cargo criterion --bench indexed_crate --features rayon
IndexedCrate/new(aws-sdk-ec2)
                        time:   [557.73 ms 559.38 ms 560.96 ms]
                        change: [-3.1709% -2.8003% -2.4380%] (p = 0.00 < 0.05)
                        Performance has improved.
```
obi1kenobi pushed a commit that referenced this pull request Aug 29, 2024
Small perf gains as there isn't much we can parallelize without more
code massaging:

```
(92a9868) ❯ cargo criterion --bench indexed_crate --features rayon
IndexedCrate/new(aws-sdk-ec2)
                        time:   [574.13 ms 575.49 ms 576.92 ms]

(changes) ❯ cargo criterion --bench indexed_crate --features rayon
IndexedCrate/new(aws-sdk-ec2)
                        time:   [557.73 ms 559.38 ms 560.96 ms]
                        change: [-3.1709% -2.8003% -2.4380%] (p = 0.00 < 0.05)
                        Performance has improved.
```
obi1kenobi pushed a commit that referenced this pull request Aug 29, 2024
Small perf gains as there isn't much we can parallelize without more
code massaging:

```
(92a9868) ❯ cargo criterion --bench indexed_crate --features rayon
IndexedCrate/new(aws-sdk-ec2)
                        time:   [574.13 ms 575.49 ms 576.92 ms]

(changes) ❯ cargo criterion --bench indexed_crate --features rayon
IndexedCrate/new(aws-sdk-ec2)
                        time:   [557.73 ms 559.38 ms 560.96 ms]
                        change: [-3.1709% -2.8003% -2.4380%] (p = 0.00 < 0.05)
                        Performance has improved.
```
obi1kenobi pushed a commit that referenced this pull request Aug 29, 2024
Small perf gains as there isn't much we can parallelize without more
code massaging:

```
(92a9868) ❯ cargo criterion --bench indexed_crate --features rayon
IndexedCrate/new(aws-sdk-ec2)
                        time:   [574.13 ms 575.49 ms 576.92 ms]

(changes) ❯ cargo criterion --bench indexed_crate --features rayon
IndexedCrate/new(aws-sdk-ec2)
                        time:   [557.73 ms 559.38 ms 560.96 ms]
                        change: [-3.1709% -2.8003% -2.4380%] (p = 0.00 < 0.05)
                        Performance has improved.
```
obi1kenobi added a commit that referenced this pull request Aug 29, 2024
Small perf gains as there isn't much we can parallelize without more
code massaging:

```
(92a9868) ❯ cargo criterion --bench indexed_crate --features rayon
IndexedCrate/new(aws-sdk-ec2)
                        time:   [574.13 ms 575.49 ms 576.92 ms]

(changes) ❯ cargo criterion --bench indexed_crate --features rayon
IndexedCrate/new(aws-sdk-ec2)
                        time:   [557.73 ms 559.38 ms 560.96 ms]
                        change: [-3.1709% -2.8003% -2.4380%] (p = 0.00 < 0.05)
                        Performance has improved.
```

Co-authored-by: Jalil David Salamé Messina <60845989+jalil-salame@users.noreply.github.com>
obi1kenobi added a commit that referenced this pull request Aug 29, 2024
Small perf gains as there isn't much we can parallelize without more
code massaging:

```
(92a9868) ❯ cargo criterion --bench indexed_crate --features rayon
IndexedCrate/new(aws-sdk-ec2)
                        time:   [574.13 ms 575.49 ms 576.92 ms]

(changes) ❯ cargo criterion --bench indexed_crate --features rayon
IndexedCrate/new(aws-sdk-ec2)
                        time:   [557.73 ms 559.38 ms 560.96 ms]
                        change: [-3.1709% -2.8003% -2.4380%] (p = 0.00 < 0.05)
                        Performance has improved.
```

Co-authored-by: Jalil David Salamé Messina <60845989+jalil-salame@users.noreply.github.com>
obi1kenobi added a commit that referenced this pull request Aug 29, 2024
Small perf gains as there isn't much we can parallelize without more
code massaging:

```
(92a9868) ❯ cargo criterion --bench indexed_crate --features rayon
IndexedCrate/new(aws-sdk-ec2)
                        time:   [574.13 ms 575.49 ms 576.92 ms]

(changes) ❯ cargo criterion --bench indexed_crate --features rayon
IndexedCrate/new(aws-sdk-ec2)
                        time:   [557.73 ms 559.38 ms 560.96 ms]
                        change: [-3.1709% -2.8003% -2.4380%] (p = 0.00 < 0.05)
                        Performance has improved.
```

Co-authored-by: Jalil David Salamé Messina <60845989+jalil-salame@users.noreply.github.com>
obi1kenobi added a commit that referenced this pull request Aug 29, 2024
Small perf gains as there isn't much we can parallelize without more
code massaging:

```
(92a9868) ❯ cargo criterion --bench indexed_crate --features rayon
IndexedCrate/new(aws-sdk-ec2)
                        time:   [574.13 ms 575.49 ms 576.92 ms]

(changes) ❯ cargo criterion --bench indexed_crate --features rayon
IndexedCrate/new(aws-sdk-ec2)
                        time:   [557.73 ms 559.38 ms 560.96 ms]
                        change: [-3.1709% -2.8003% -2.4380%] (p = 0.00 < 0.05)
                        Performance has improved.
```

Co-authored-by: Jalil David Salamé Messina <60845989+jalil-salame@users.noreply.github.com>
@jalil-salame jalil-salame deleted the rayon-visibility-tracker branch August 29, 2024 05:25
@obi1kenobi
Copy link
Owner

Resolves #401.

@obi1kenobi obi1kenobi linked an issue Aug 29, 2024 that may be closed by this pull request
4 tasks
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Offer rayon crate feature that parallelizes index-building
2 participants