Jul 18 2019 02:37 PM
Feature Rollout
Hello Edge Insiders! We have so many cool new features in the works for you, and we’d like to share with you the process behind how these new features will become available.
To honor our commitment to building a great browser, we test our feature changes for any regressions by gradually rolling out the feature to a small randomly selected subset of Canary & Dev channel, and then increase this subset as we are more confident about the feature. These controlled feature rollouts begin after completing standard quality, reliability, and compliance tests and determining that the feature is at ship quality. As we progressively ramp up the percentage of users, we are validating that each new feature aligns with our promise to be a safe, fast, and delightful browser in a scientific manner.
But I’m an Insider, so I must be getting these updates first?
Every time we run a controlled feature rollout, we will randomly select a percentage of the Canary and Dev channels to get the treatment, and an equally sized group to remain in the control group. A set of guardrail metrics, including performance, reliability, browser usage, and feedback reports, are measured for each group. Statistical tests to compare the metrics between treatment and control allow us to estimate the impact of each individual change. This also requires that we not tamper with the audience selection to the degree that it would influence behaviors or participation. As a result, we will generally announce new features available in dev at the conclusion of the controlled feature rollout.
What if I really can’t wait?
If a feature has not yet been enabled by default for you, and you’d like to try it out, you can enable it on edge://flags and the new feature will be applied the next time you launch your browser.
edge://flags
Thanks for being an Insider!
Exposing some of you to new features as the final stage of validation not only ensures the feature works better when you all get it; but safeguards later channels as well. Your input (both explicit and aggregated from browser telemetry) is helping us build a better browser.
Continue calling out what’s working, what’s not, what you like, and what could be better. In some cases, you might be ‘one of the few’ seeing a new experience. In those cases, your usage and feedback become even more critical. It helps us decide whether a feature should be enabled or not.
Jul 18 2019 04:44 PM
@Elliot Kirk wow! So many edge://flags
Cool idea. I like how much power you are putting the hands of all testers!
Jul 19 2019 07:20 AM
Jul 19 2019 12:12 PM
Jul 20 2019 03:47 PM
@Elliot Kirk Is there any way to know which flags are unique to Edge and which are ones included due to them being part of Chromium at large?
Aug 11 2019 04:27 PM
@Elliot Kirk A/B testing is very popular but I find it difficult as I never know if I have a new feature enabled or not or later get it enabled but am unaware I have it now.
Aug 20 2019 09:46 AM
Sep 11 2019 12:19 PM
Hi,
in the section where you mentioned "What if I really can’t wait?"
you suggest that we can use flags to enable those features. but there are many features that are unavailable and they don't have any flags to enable them.
Features such as new privacy dashboard, share button, tab grouping, turning off news feed, turning off auto play etc.
Sep 12 2019 09:41 AM
Would be nicer if all features was on by default for everyone in Canary.
Sure it may break and it may be unstable - but isn't that what canary is suppised to be - bleeding edge ?
Sep 04 2020 06:58 PM
Hello @Elliot Kirk
I see that there are many controlled features that are not activated even after activating the flag.
I see that the team will continue in this method where the flag activation will not make any difference
So I have to say that I don't like the controlled feature
Sep 08 2020 04:23 AM
Sep 28 2020 06:49 AM
I can understand controlled features in Stable version, and even Dev. But why made it for Canary?
I want to test Vertical Tabs and there is NO WAY to activate it if you are not in the test group. Activating flags that was mentioned in several how-tos (Shy UI) do nothing...
For the test purposes it will be cool to have flags for every testing features.
Nov 04 2020 01:44 AM
Nov 05 2020 08:51 AM
Nov 05 2020 11:49 PM