Forum Discussion
Elliot Kirk
Nov 19, 2019Former Employee
Ask Cortana / Ask Bing - Discussion
Hello Insiders! You have told us that you really want the Ask Cortana / Ask Bing feature in our next version of Microsoft Edge.
In the current version of Microsoft Edge, you can select text or click on an image and get a result from Cortana / Bing in a side panel, without leaving the page you are browsing.
We hear you and from your feedback we understand you would like similar contextual search functionality in a way that does not pull you out of your browsing flow.
We are investigating our ability to add this to the next version of Microsoft Edge and we would like to understand what makes this feature useful for you.
How did you use this feature? If you ever attempted to use Ask Cortana / Ask Bing and couldn’t get the answer you were looking for, what steps did you take, if any, to get the answer you were looking for?
What aspects of the Ask Cortana experience do you like or appreciate? What improvements would you like to see?
Please let us know, either in the comments below or by using the Send-A-Smile feedback.
Thanks – Jared Brown and the Microsoft Edge Search Team
Hello Insiders!
Thank you so much for your feedback. We are excited to announce sidebar search - the first step in our evolution of contextual search in the new Microsoft Edge.
You can find more details about sidebar search in this post - https://techcommunity.microsoft.com/t5/discussions/introducing-sidebar-search-in-microsoft-edge/m-p/1406242
Thanks!
123 Replies
Sort By
- Freddie-ZhangCopper ContributorThis is like the Sidebar Search feature. I think that unless you give some good new features (like maybe the option to read aloud the selection and open it in Cortana, using it), Sidebar Search would do just fine.
- mayusuf
Microsoft
Hello Insiders!
Thank you so much for your feedback. We are excited to announce sidebar search - the first step in our evolution of contextual search in the new Microsoft Edge.
You can find more details about sidebar search in this post - https://techcommunity.microsoft.com/t5/discussions/introducing-sidebar-search-in-microsoft-edge/m-p/1406242
Thanks!
- martinnnIron ContributorIs Ask Cortana the only "Cortana" (of course it's really just a Bing search) feature that will be integrated into Chromium Edge?
- Migue333Iron Contributor
So we're at least getting the search from sidebar portion of Ask Cortana, which is the Cortana feature I used most.
- Inspecteur_GaxsCopper Contributor
Elliot Kirk a pop-up menu like on Edge on mobile phone would be extremely useful!
- martinnnIron Contributor
Ask Cortana wasn't the only Cortana feature that was great about Edge--it was the fact that Cortana could pop up in the URL bar and help with other things too. It was super useful to see her provide better deals when doing online shopping or providing more news articles, and I'd like to see that be reimplemented along with Ask Cortana.
Better yet, I'd like to see that feature be expanded to other features. I don't know exactly how she could be implemented, but I think a potentially great idea would be if Cortana could automatically suggest or create Collections based on sites you visit--the shopping feature, for example, could be expanded to not only suggest better deals, but to group them all in a Collection automatically so you can view them later. The same feature could be used for her suggestion of similar news articles. Collections could be a wonderful tool for expanding Cortana's abilities within Edge.
Also, one of the features I like most about Cortana was that she appeared in a sidebar that didn't take you out of your workflow. This was great about the Edge experience overall, and I'd love to see that implemented back in with Favorites, History, and Downloads.
- Mason425Iron Contributor
The Cortana feature was very useful in the original Edge. It came in very useful when researching movies or something when Cortana would offer to bring up a page to view it, and it was very useful for online shopping. Times when you see the message to the right of the address bar were decently rare, but it was very useful the times that you did see it. It's hard to mention all the times I could use that feature. It was just very handy and very useful.
- winiston2212Copper Contributor
I loved the Ask Cortana feature. I mostly used it to quickly find the definition of a word I didn't know, which was quite often. I also used it for just about everything. If I needed to find out where a referenced location was, I would use "Ask Cortana". The ability to pin it to the side of the page was also very useful. The only thing I would change about it is the look. It would be great to have dark mode added, and it would also be nice if it looked more like Windows Search web results. That would make it more consistent and sleek. I'm really excited to see this feature in the future. The "search the for..." feature just isn't as convenient.
- OriginalZaneCopper ContributorI did send a feedback suggestion regarding Cortana. I'll repost it here so the community can expand and get creative on ways to integrate Cortana within the new Edge!
TAILORED EDGE UI.
If I said "Hey Cortana," and she popped out within Edge's window instead of the taskbar, that would be a convenient and clean way to involve her more while browsing the web. A small smart box that hovers within the tab itself would be great. Able to be dragged around within the Edge window, or outside its borders on top of the desktop for instance.
INTEREST SEARCH. Let's take a look at the problem first.
Sometimes, you'd be reading an article online, let's say I'm reading an article regarding Miley Cyrus on Buzzfeed.com (like the majority of Millennials and Gen Zs). When I finished reading the article, intriguing questions might pop in my head. Things like "What happened next?", "What happened before?", "I wonder if she recovered from that injury."
Today, you'd open a new tab and search for Miley Cyrus and include other keywords regarding the injury (she didn't have an injury, it's just an example). And try to sort things out and find out what happened next or before.
How can Cortana solve this? That's where Interest Search comes in.
Imagine instead of opening a new tab, you'd say "Hey Cortana, what's up with Miley?"... imagine the possibilities. I'll explain in detail below, but here's the basic explanation first;
Cortana would lookup the web using Bing technologies for articles similar to the one you're reading when gave the voice command. It will pull up the results in a clean side bar (remember the UI I mentioned above? It would expand vertically into a "Smart Card") And give you the results it found on multiple sources, sorting by relevance and Date-Match*
*It looks at the date of the published article and tries to find articles published within the same date window.
How can Cortana find similar articles? How Interest Search works?
1) Cortana would analyze the title of the article you're reading for keywords. E.g. (Miley Cyrus injured her leg in a skiing accident.) Cortana would ignore words like "the" and "her" and even "a". So the keywords extracted here are Miley + Cyrus + injured + leg + skiing + accident.
2) Since most websites nowadays include who published the article and when was it published, Cortana would take note of the date and create a "Search Filter" for use later in the upcoming steps.
3) It would take results from Step 01, and find matches within the article itself.
4) When matches are found in Step 03, Cortana would look into the sentences each match-found for additional keywords. When it reaches a comma or a full stop, Cortana would stop extending the sentence. Again, ignoring words like "the". But, this time, emphasize on Capital letter words in the middle of sentences (like names and places), creating another "Search Filter" for use in addition to the date in Step 02.
5) Cortana would have sentences of keywords after Step 04. Cortana would then try to find similarities within those sentences by using an actual dictionary. If two words from two different sentences have common synonyms (the same exact meaning), then Cortana would pick one of them and drop the Other Keyword (referred later as Dropped Keywords).
6) After Step 05, Cortana would now have "Search Keywords". She would take those "Search Keywords" and combine them Once with the "Search Filter" it created in Step 04. (E.g. Miley +Cyrus + Paris + France + skiing + injury). This is referred to as "Interest Phrase"
7) Cortana would take the "Dropped Keywords" and create another "Interest Phrase". Now, Cortana has TWO "Interest Phrases"
😎 Cortana would apply the "Search Filter" it created in Step 02 (the Publishing Date) and consider your voice command to both "Interest Phrases". (e.g. "Hey Cortana, what's up with Miley?", by noticing "What's Up" in your command, Cortana would look for results AFTER the Publishing Date from Step 02.)
9) Each "Interest Phrase" would bring up certain results. Cortana would combine duplicate results and sort the final result according to Date-Match inside its Edge UI Smart Card. - Reza_Ameri-ArchivedBronze ContributorLet me back to Internet Explorer, we had something call Accelerator and let say in one website I select address and use accelerator and it shows location in Bing map. I select non-English text and it translate it to English, so I don't have to copy them and open new tab and then go to translator, map or other website and paste it to see it.
Cortana in Microsoft Edge did similar task but it has some limitation. What I want is smart way and let say when I click on address, it shows location inside current page and not new tab , same for weather, translators and so on. It is also good to search name and something in Bing.
Therefore, we need this Cortana feature but with more flexibility of view , so user could select if show it in right side or in mini windows like accelerators in Internet Explorer.- OriginalZaneCopper ContributorTwo feature suggestions within Edge.
SMART ASSIST.
1) SMART TABS.
When you're in the middle of using the web (say few minutes into some research you're doing) and you click a new tab. An on-device Cortana-powered page should pop up. Similar to Siri Suggestions within Safari. However, more powerful since it already suggests pages from the web similar to what you have opened in other tabs because chances are that you're looking for something similar. However, if Cortana utilizes a suggestion I already mentioned in a different Reply (Interest Search), this would be powerful! Cortana would suggest articles from multiple sources in a layout similar to the Microsoft Store homepage on Windows 10. With the "Preview" feature, you can expand an article within the "Smart Tab" before fully loading its webpage. If you liked it, click a button within the expanded UI and it would open the full website in the same "Smart Tab", if you don't. Close the expanded preview and find another result. You can ALWAYS bypass this feature by typing whatever you want in the address bar like you would normally do today in a "New Tab".
2) SMART CONVERTER
By noticing you're location (processed on device) and language, Cortana can tell if you prefer the Imperial or Metric system. While reading a recipe that is using the Metric system, Cortana can hover-in you're Edge window with a question "Would you like me to convert units to Imperial?". Since Edge is already reading the website's source code, it can change the text if it needs to. So, if the user clicked yes, Cortana would then convert all Metric units on the website within the tab to Imperial.
INFO CARDS.
When reading online, if you highlight text, a small Cortana icon would animate-in next to it. If you click it, Cortana would expand vertically an Info Card experience on the right side (Latin language websites, on the left for right-to-left language website like Arabic).
The Info Card would be powered by Bing technologies to find relevant information (mostly from Wikipedia like Google cards), pictures, and maps if available. The Info Card would be expandable and resizable and can be dragged around, even outside Edge's window if possible. The "Experience" would allow the user to "read more" of the Wikipedia article within the Info Card itself (or click a button to read in a new tab from source). Same thing with maps and media content found.
- MaryBSteel Contributor
Elliot KirkI use both 'Search the web for' and 'ask Cortana about' all the time
I use ask Cortana when I need a quick definition or extra info about something without leaving the page, when the quck info will be enough and I don't need to explore further, for info about where an image comes from or as a quick way of seeing an image full size in its own tab.
I use 'search the web for' when I want to explore a topic in more depth and expect to open multiple links and go to multiple page and so want a persistent list of search results