Unstable Feature Usage Metrics #129485

yaahc · 2024-08-23T20:40:14Z

Unstable Feature Usage Metrics

Track unstable feature usage trends by Rust users.

Motivation

Support feature stabilization prioritization.
Helping teams know which unstable features to invest their energy into.
Evaluating how representative crates.io is as a sample of the rust ecosystem (will we see different patterns in crates.io feature usage vs private feature usage?)

Context

research paper on unstable feature usage in the rust ecosystem

Steps / History (PROVISIONAL)

define the format the metrics will be stored in
add flag to dump unstable feature status metrics (what features exist, if they're stable or not, both for library and lang/compiler, tidy may already support this for lib features)
add flag to enable unstable feature usage metrics in the compiler
front end to display reports based on gathered usage and status metrics
back end to save metrics data from published crates.io crates (private data should be anonymous and stored separately once we have established the ability to gather that in a statistically relevant volume)
integrate with docs.rs to have it gather metrics and upload them to the backend while building newly uploaded crate versions

…tebank unstable feature usage metrics example output ``` test-lib on  master [?] is 📦 v0.1.0 via 🦀 v1.80.1 ❯ cat src/lib.rs ───────┬─────────────────────────────────────────────────────── │ File: src/lib.rs ───────┼─────────────────────────────────────────────────────── 1 │ #![feature(unix_set_mark)] 2 │ pub fn add(left: u64, right: u64) -> u64 { 3 │ left + right 4 │ } 5 │ 6 │ #[cfg(test)] 7 │ mod tests { 8 │ use super::*; 9 │ 10 │ #[test] 11 │ fn it_works() { 12 │ let result = add(2, 2); 13 │ assert_eq!(result, 4); 14 │ } 15 │ } ───────┴─────────────────────────────────────────────────────── test-lib on  master [?] is 📦 v0.1.0 via 🦀 v1.80.1 ❯ cargo +stage1 rustc -- -Zmetrics-dir=$PWD/metrics Compiling test-lib v0.1.0 (/home/yaahc/tmp/test-lib) Finished `dev` profile [unoptimized + debuginfo] target(s) in 0.08s test-lib on  master [?] is 📦 v0.1.0 via 🦀 v1.80.1 ❯ cat metrics/unstable_feature_usage.json ───────┬───────────────────────────────────────────────────────────────────── │ File: metrics/unstable_feature_usage.json ───────┼───────────────────────────────────────────────────────────────────── 1 │ {"lib_features":[{"symbol":"unix_set_mark"}],"lang_features":[]} ``` related to rust-lang#129485

Rollup merge of rust-lang#130236 - yaahc:unstable-feature-usage, r=estebank unstable feature usage metrics example output ``` test-lib on  master [?] is 📦 v0.1.0 via 🦀 v1.80.1 ❯ cat src/lib.rs ───────┬─────────────────────────────────────────────────────── │ File: src/lib.rs ───────┼─────────────────────────────────────────────────────── 1 │ #![feature(unix_set_mark)] 2 │ pub fn add(left: u64, right: u64) -> u64 { 3 │ left + right 4 │ } 5 │ 6 │ #[cfg(test)] 7 │ mod tests { 8 │ use super::*; 9 │ 10 │ #[test] 11 │ fn it_works() { 12 │ let result = add(2, 2); 13 │ assert_eq!(result, 4); 14 │ } 15 │ } ───────┴─────────────────────────────────────────────────────── test-lib on  master [?] is 📦 v0.1.0 via 🦀 v1.80.1 ❯ cargo +stage1 rustc -- -Zmetrics-dir=$PWD/metrics Compiling test-lib v0.1.0 (/home/yaahc/tmp/test-lib) Finished `dev` profile [unoptimized + debuginfo] target(s) in 0.08s test-lib on  master [?] is 📦 v0.1.0 via 🦀 v1.80.1 ❯ cat metrics/unstable_feature_usage.json ───────┬───────────────────────────────────────────────────────────────────── │ File: metrics/unstable_feature_usage.json ───────┼───────────────────────────────────────────────────────────────────── 1 │ {"lib_features":[{"symbol":"unix_set_mark"}],"lang_features":[]} ``` related to rust-lang#129485

…jieyouxu Add new tool for dumping feature status based on tidy sequel to rust-lang#133514 meaning ... supercedes rust-lang#133351 part of rust-lang#129485 r? `@jieyouxu` cc `@estebank`

Rollup merge of rust-lang#135844 - yaahc:tidy-feature-status-dump, r=jieyouxu Add new tool for dumping feature status based on tidy sequel to rust-lang#133514 meaning ... supercedes rust-lang#133351 part of rust-lang#129485 r? `@jieyouxu` cc `@estebank`

yaahc added T-compiler Relevant to the compiler team, which will review and decide on the PR/issue. A-metrics Area: Metrics labels Aug 23, 2024

rustbot added the needs-triage This issue may need triage. Remove it if it has been sufficiently triaged. label Aug 23, 2024

yaahc mentioned this issue Aug 23, 2024

Tracking Issue for Metrics Initiative #128914

Open

5 tasks

fmease added C-tracking-issue Category: An issue tracking the progress of sth. like the implementation of an RFC and removed needs-triage This issue may need triage. Remove it if it has been sufficiently triaged. labels Aug 23, 2024

yaahc mentioned this issue Nov 15, 2024

unstable feature usage metrics #130236

Merged

This was referenced Nov 22, 2024

add flag to dump unstable feature status information #133351

Closed

Add new tool for dumping feature status based on tidy #133514

Closed

This was referenced Jan 17, 2025

Add new tool for dumping feature status based on tidy #135662

Closed

Add new tool for dumping feature status based on tidy #135844

Merged

yaahc mentioned this issue Feb 28, 2025

Add timestamp to unstable feature usage metrics #137827

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Unstable Feature Usage Metrics #129485

Unstable Feature Usage Metrics #129485

yaahc commented Aug 23, 2024 •

edited

Loading

Unstable Feature Usage Metrics #129485

Unstable Feature Usage Metrics #129485

Comments

yaahc commented Aug 23, 2024 • edited Loading