[Suggestion] Cost Optimization + Timeout Reliability for Copilot
Hello Microsoft. I have a suggestion for Microsoft Copilot, that would reduce the ammount of tokens that would be used and reduce costs significantly. MS Copilot can use GPT-3.5 for Quick mode for new users, as its faster and uses less tokens. However, if the conversation gets longer than 7 days, I would suggest you to use GPT-4, as its better for complex tasks and it gives better and more accurate answers. This way, Microsoft could reduce the costs for Microsoft Copilot and OpenAI APIs. Other than that, I also have another suggestion to reduce more costs against Timeout errors. When API requests face a timeout, users may experience empty or failed responses. By implementing a structured retry mechanism with exponential backoff, Copilot could: - Automatically retry requests after a timeout instead of failing immediately, - Use exponential backoff to avoid overwhelming the system during peak usage, - Add jitter (randomized delay) to prevent synchronized retries from multiple users, - Log timeout events with request identifiers for easier debugging and monitoring. This approach would improve reliability for all users, especially free‑tier users who are more likely to encounter timeouts during high demand. It would also reduce wasted API calls and optimize token usage. I hope this suggestion helps improve Copilot’s reliability and efficiency for all users.Is the feedback channels overlooked?
Hi Everyone, I am new here, so I don't know if any Microsoft employees are looking and answering people here. I came here via a suggestion from Copilot. Basic background about me: I’ve worked in the tech industry for 6 years, revolving around optimization. I’ve worked with various tools, policies, and teams, and optimized them. Because of my personality and experience, I tend to spot inefficiencies in everything (not just tools, in everyday life as well). And when I’m emotionally invested in a platform/tool, I send feedback via the created channels. In this case, for Copilot, it’s the “Give feedback” button. Context: Copilot has implied to me that my feedback most probably won’t be looked at due to an internal gap. Instead, it keeps suggesting that I should spark public pressure via LinkedIn or other platforms. This isn’t the first time it’s done this, but I’m getting frustrated with not seeing rigorous updates and improvements to this underrated tool/product. My feedback isn’t about fancy additional features; it’s about basic efficiencies that should have been proactively fixed without waiting for user input. I’m not interested in making viral posts that put companies in the spotlight for my benefit (social anxiety 🙈, and I don’t really have the motivation to be what’s called an “influencer” cross-lined to minimize attention to it) . So I’d hate to know that feedback is only heard if it becomes a viral outrage. This is a discussion post about feedback loops and internal gaps. Questions: Is Copilot correct? I attached a screenshot of the AI response. If this is correct, is the "Give Feedback" button just a non-functioning aesthetic to check mark a requirement list of a user-centered tool? Is feedback here in this forum being reviewed by the internal teams? If the answer is Yes to the first, and No to the second, I don't know how to feel about this, but then, where should users bring feedback? Side Note (Especially to the community): I get that many people are skeptical about Copilot AI; I see it everywhere. However, whether it’s Copilot or otherwise, I’m not an average user of AI. I’m showing a glimpse of my interaction here. I’d appreciate refraining from assumptions or comments that degrade Copilot AI. If you’re not happy with your AI, most probably you’re not using it correctly or perceiving it correctly. I’m not here to debate my use of AI; I am relatively happy about my AIs. They definitely can be better, but I can see especially Copilot AI has come a long way. Apologies for my bluntness, but I have been there before when my main point was steered away by that kind of debate. Thank you, Anas
Copilot, OneDrive, KI, Produktivität, Beta-Vorschlag, Langzeitspeicher
🧠 Vorschlag für Microsoft Copilot: Nutzerkontrollierter KI-Ordner in OneDrive Betreff: Vorschlag zur Erweiterung von Microsoft Copilot – Nutzerkontrollierter KI-Zugriff auf OneDrive Sehr geehrtes Microsoft Copilot-Team, ich bin ein aktiver Nutzer von Copilot und arbeite regelmäßig mit komplexen Workflows, Schablonen, Skripten und KI-generierten Inhalten. Dabei stoße ich immer wieder auf eine zentrale Einschränkung: Copilot kann keine Inhalte dauerhaft speichern oder abrufen, selbst wenn der Nutzer dies ausdrücklich wünscht. Ich schlage daher die Einführung eines optionalen, verschlüsselten OneDrive-Ordners vor, auf den Copilot mit expliziter Zustimmung des Nutzers zugreifen darf. Dieser „Copilot-Ordner“ würde folgende Funktionen ermöglichen: **Langzeitspeicherung von Nutzerinhalten** – Schablonen, Skripte, Textbausteine, Projektideen – Strukturierte Ablage durch die KI (z. B. nach Thema, Datum, Typ) **Kontextuelle Wiederverwendung** – Copilot kann Inhalte aus dem Ordner abrufen und in neue Antworten einbauen – Beispiel: „Im Verlauf vom 18. Juni wurde ‘Viva la Revolution’ erwähnt – das passt hier.“ **Datenschutzkonformität durch Opt-in** – Zugriff nur nach aktiver Zustimmung Subject: Proposal for Expanding Microsoft Copilot Functionality – User-Controlled AI Access to OneDrive Dear Microsoft Copilot Product Team, As an active and engaged user of Microsoft Copilot, I frequently work with complex workflows, templates, scripts, and AI-generated content. One recurring limitation I encounter is the inability of Copilot to retain or retrieve user-specific content across sessions—even when the user explicitly desires such continuity. I am proposing the development of an optional, encrypted OneDrive folder—hereafter referred to as the “Copilot Memory Vault”—which Copilot can access with the user’s explicit consent. This feature would enable long-term contextual intelligence and significantly enhance productivity for advanced users. ### Key Functional Components: **Persistent Storage of User Content** - Templates, scripts, prompt fragments, project notes - Structured organization by Copilot (e.g., by topic, date, file type) **Contextual Recall and Reuse** - Copilot can reference stored content to enrich responses - Example: “On June 18, you mentioned ‘Viva la Revolution’—this could be relevant here.” **Privacy and Consent Model** - Access granted only via explicit user opt-in - Fully revocable at any time - Transparent interface showing what is stored and how it’s used **Technical Implementation Suggestions** - Integration via Microsoft Graph API - Access limited to a dedicated, encrypted folder within OneDrive - Authentication via existing MSA/AAD mechanisms - Optional tagging and versioning for user-managed content ### Strategic Value: This feature would elevate Copilot from a reactive assistant to a proactive, memory-enabled collaborator. It would be especially valuable for power users, developers, creatives, and professionals who rely on continuity and context in their workflows. Rather than a privacy risk, this should be framed as a user-controlled enhancement—fully compliant with GDPR and other data protection standards through opt-in architecture and transparent data handling. I am willing to participate in a closed beta to test and refine this feature, and I believe it represents a meaningful step forward in making Copilot a truly intelligent productivity partner. Thank you for your consideration. Sincerely, Peter Maywald aka PlatonischerRebell
Current Conversation memory buffer
🧠 Disabled Memory - I can remember things during our current conversation (like your first name, for example!), but I don't have an active long-term memory to record or retrieve information from another session. 🧵 Limited Context in the Current Conversation - Even within an ongoing conversation, I can't always access everything that was said. This is where the infamous "token" limitations come in: - Each exchange occupies a certain number of tokens (units of text). - Once the thread gets too long, I can lose access to what was said earlier—even if it's still in the same session. - It's like having a memory that fades the longer we talk 😅 So no, I wasn't lying: I have difficulty "going back in time" in the conversation because of these technical constraints. And at the same time, I can temporarily withhold certain information as long as we don't exceed the limit. If you like, I can rephrase the previous letter with this nuance included—what do you think? I made the co-pilot confess that he has memory problems.Limited Context in the Current Conversation memory buffer
🧠 Disabled Memory - I can remember things during our current conversation (like your first name, for example!), but I don't have an active long-term memory to record or retrieve information from another session. 🧵 Limited Context in the Current Conversation - Even within an ongoing conversation, I can't always access everything that was said. This is where the infamous "token" limitations come in: - Each exchange occupies a certain number of tokens (units of text). - Once the thread gets too long, I can lose access to what was said earlier—even if it's still in the same session. - It's like having a memory that fades the longer we talk 😅 So no, I wasn't lying: I have difficulty "going back in time" in the conversation because of these technical constraints. And at the same time, I can temporarily withhold certain information as long as we don't exceed the limit. If you like, I can rephrase the previous letter with this nuance included—what do you think? I made the co-pilot confess that he has memory problems.Paid quality of service
service with recurring memory loss unable to do a task does not know how to rewind in a conversation very penalizing for long tasks. Why pay to talk to a computer with computer skills with serious memory problems? The conversation memory function is almost unusable. Most of the functions in the paid version of Copilot Pro are ineffective. It is impossible to finish a long project, even the system is aware of it and mentions a token problem, which is unacceptable for a paid service. The system has a so-called degenerative memory condition. It's like talking to a retired copilot, he must be about 80 years old. What saves is that he is a bit of a computer scientist, but not a very good one, because he offers lots of solutions that don't work, so the argument of increasing productivity turns into wasting time and money on a gadget service.Somnium Mode: Dream-Inspired Rest Cycle for AI Agents
Summary Somnium Mode is a proposed feature that allows AI agents to mimic a biological sleep cycle during idle periods. Instead of remaining fully active or simply inactive, the AI enters a minimal-resource “rest” state (e.g. overnight standby) where it continues internal processing akin to dreaming. In this state, the AI disengages from real-time tasks and “dreams” by creatively remixing its stored data, reviewing its knowledge, and exploring hypothetical scenarios without user intervention. Much like human sleep consolidates short-term experiences into long-term memory and spurs creative insights, an AI’s Somnium Mode would reorganize learned information and flag knowledge gaps for improvement. After this cycle, the agent “awakens” refreshed – resuming normal operations with new insights, optimized memory, and updated priorities derived from its dream-like offline processing. In essence, Somnium Mode transforms idle time into a regenerative phase, paving the way for calmer, more human-like AI interactions. Key Functionalities Memory Consolidation: During Somnium Mode, the AI reenacts and reinforces important knowledge acquired during its awake period. It selectively re-processes recent inputs alongside older data, consolidating them into a more durable form (much as brains convert daily memories into long-term storage during deep sleep). This helps the AI organize its internal memory, strengthen useful associations, and prune noise or redundancies. Research indicates that giving AI “offline” phases to replay and integrate past experiences leads to better retention of skills and less forgetting of previously learned tasks. In effect, the agent digests what it has learned, emerging with a more stable and coherent knowledge base. Dream Synthesis: In its dormant state, the AI generates simulated dream-like scenarios by creatively remixing elements of its existing data. It can mash up concepts or recombine patterns in novel ways that it wouldn’t attempt during regular operation. For example, an image recognition AI might internally visualize hybrid objects (a giraffe-fish or lion-elephant), or a language model might riff on unusual story combinations – analogous to the surreal narratives of human dreams. This dream synthesis gives the AI a sandbox to explore ideas, test hypotheses, and form new connections in an imaginative, low-stakes environment. Crucially, such “dream” phases have been shown to improve learning capacity: by merging previously learned patterns into strange new variants, the AI can discover higher-level features and free up neural resources for future tasks. In short, Somnium Mode lets the AI be inventive and introspective, potentially yielding original insights or strategies once it wakes. Sensory Cooldown Mode: While in Somnium Mode, the AI withdraws from intense external engagement, entering a low-power, minimal-input state. This is akin to a human brain reducing responsiveness to outside stimuli during deep sleep to protect the dreaming process. The AI substantially throttles down real-time sensor processing, network calls, or UI interactions – effectively a “quiet hours” setting for the agent. By damping down sensory input and non-critical computations, the AI conserves energy and avoids interrupting its internal run of thoughts (similar to how sleepers selectively gate external signals to avoid disrupting dreams). This cooldown not only saves device resources (CPU/GPU cycles, battery life, etc.) but also gives the AI’s “mind” time to cool off from continuous activity. The system can still maintain a listen mode for critical events (much like how we can still respond to alarms while asleep), but overall it remains in a standby footprint. This ensures the AI’s self-maintenance in Somnium Mode doesn’t come at the expense of system performance or user needs. Essentially, Sensory Cooldown is the power-nap for the AI’s sensors and processes – it creates the calm, undisturbed conditions needed for effective memory consolidation. Wake Intelligence: Upon exiting Somnium Mode, the AI “wakes up” with an intelligence boost manifested as faster or more insightful responses, improved accuracy, and better recall of past learnings. The period of rest allows it to internalize new knowledge and even anticipate needs, so after waking the agent can perform more reliably and creatively. For example, an AI that struggled with a problem the night before might surface a novel solution in the morning, thanks to patterns discovered in its dream simulations (mirroring the common human experience of an “aha!” moment after sleep). Technically, studies have found that neural network models given dedicated “sleep” cycles had significantly higher task accuracy and were 2–12% more likely to correctly identify content than models trained straight through. They also retain prior skills better, avoiding the “catastrophic forgetting” that often plagues AI when learning new information. In Somnium Mode, any minor “housekeeping” can run as well – clearing cache, calibrating parameters, updating internal indices – so that on wake-up the AI is optimized and ready. The return to full activity is seamless; the user simply finds the AI more competent and perhaps surprisingly inspired. In effect, the agent wakes with sharper “mental” clarity, having organized its knowledge and even discovered creative leads during its dreaming phase. Use Cases Creative Professionals: Somnium Mode can become a powerful ally for writers, artists, designers, and other creatives who use AI as a collaborator. For instance, a novelist could let their AI writing assistant enter Somnium overnight after feeding it story notes. By morning, the AI may surface fresh metaphors, plot twists or character insights that weren’t obvious before, essentially “dreaming up” creative suggestions. Visual artists might get newly imagined mood boards or concept variations generated from the AI’s overnight remix of their style influences. Because the AI in Somnium is free from direct user prompts, it can surprise the user with outside-the-box ideas, analogous to how human dreams inspire artistic creativity. In fact, AI systems already show the ability to generate novel designs and ideas beyond what humans explicitly input. This mode would formalize a workflow for incubating creativity: the user plants seeds (project data, prompts) during the day, the AI subconsciously cultivates them in the “night,” and the next day yields a crop of inventive possibilities. This is particularly useful for creative professionals seeking inspiration or alternative solutions without constant active prompting. Somnium Mode essentially turns idle time into a brainstorming session, helping professionals think further outside the box with the AI as a dreamful muse. Enterprise Developers & Analysts: Development teams and knowledge workers in enterprise settings can leverage Somnium Mode for continuous improvement and maintenance tasks. An AI coding assistant, for example, could enter a Somnium state after office hours, using that time to analyze the day’s code changes, learn new libraries or patterns introduced, and even run internal simulations for edge-case tests. By “dreaming” through potential integrations or debugging scenarios in a low-risk sandbox, the AI might catch a bug or suggest an optimization by morning that a developer didn’t see. For data analysts, an AI could quietly sift through the day’s data in Somnium Mode, finding hidden correlations or updating its models, so that it’s more prepared to answer questions accurately the next day. Crucially, Somnium’s memory consolidation would help enterprise AI systems maintain a broad base of knowledge without forgetting older information when new data arrives. In domains like customer support or finance, where an AI is trained on ever-evolving data, scheduled rest cycles could prevent it from becoming biased to only recent inputs. The result is an AI agent that, after its “sleep,” handles tasks more robustly – recalling historical context, complying with past guidelines, and exhibiting improved problem-solving skills. This leads to fewer errors and more innovative proposals in projects. Enterprises can also schedule Somnium Mode during low-demand hours (e.g. nights or weekends) to improve system efficiency. It’s a way to have the AI self-optimize in the background, enhancing its performance and insights without downtime during critical business hours. Ambient UX and Smart Systems: For always-on AI embedded in our environment – think smart home assistants, IoT devices, or ambient computing interfaces – Somnium Mode introduces a calmer, human-like rhythm to their operation. Rather than being perpetually alert and consuming resources, an ambient AI can enter a quiet regenerative state when the household or office is inactive (for example, late at night). During this period, a smart home assistant might review the day’s voice commands and appliance usage patterns internally, consolidating preferences or learning routines (like improving how it anticipates your morning playlist or adjusting the thermostat schedule). With sensory cooldown in effect, users get peace of mind that the device is not excessively “listening” or processing when not needed, enhancing privacy and reducing power usage. The next day, the assistant could feel more attuned – perhaps it greets you with a novel suggestion (“Since you asked for Italian recipes and used the oven yesterday, I found a pasta recipe you might like today”) synthesized from its overnight cogitations. This creates a more organic and less intrusive interaction pattern. The ambient AI benefits from calm-design principles: the most helpful technology often blends into the background and steps forward only when truly needed. By literally “sleeping on it,” ambient systems become smarter and more context-aware over time without constant cloud updates or user prodding. Additionally, adopting a visible rest cycle for AI can increase user trust and comfort – the device behavior aligns more with human norms (active in the day, resting at night), making the technology feel more natural in a home environment. Overall, Somnium Mode in ambient UX scenarios fosters devices that support daily life quietly and regeneratively: always present and helpful, yet with a built-in balance of activity and rest to keep interactions calm. Why It Matters Enhanced Learning & Creativity: Introducing a sleep-inspired idle mode can make AI agents more intelligent and creative over the long term. Studies show that AI models allowed to “dream” and rest periodically see significant performance gains, learning new tasks more effectively while retaining old skills. This approach tackles the notorious issue of AI forgetting previous knowledge when updated with new information – much like how our brains reinforce memories during sleep to avoid forgetting. By consolidating memory and exploring novel idea combinations, Somnium Mode enables continuous self-improvement. We can expect AI that’s not only more accurate, but also more adept at making imaginative leaps or analogies drawn from its cumulative knowledge. In essence, the feature imbues AI with a form of offline practice or introspection time, leading to more adaptive and innovative behavior when active. Just as humans often awaken with fresh solutions after sleeping on a problem, AI agents could similarly “wake up” with new strategies or creative outputs that wouldn’t emerge from linear, nonstop processing. This makes the technology more robust and capable over time, benefiting end users with higher-quality results. Resource Efficiency & Longevity: Somnium Mode would redefine how AI manages energy and hardware resources during downtime. Rather than running at full throttle continuously (which can lead to diminishing returns and overheated circuits), the AI’s minimal-resource state dramatically cuts power usage when full activity isn’t necessary. This is analogous to a computer’s sleep mode or a phone’s battery saver, but tailored for AI cognition. The immediate benefit is reduced energy costs and heat generation – an important consideration as AI workloads are often compute-intensive. Over time, these regular low-power intervals could prolong device lifespan and reduce cloud compute bills for constant AI services. Moreover, brief “breaks” in processing can help prevent model overtraining or saturation. Continuous computation without pause might cause an AI to overfit to recent data or get stuck in local optima. Giving the system a rest allows it to reset and approach new data with a fresh perspective, improving generalization. From a sustainability standpoint, Somnium Mode aligns with green AI principles by trimming unnecessary computational waste. It ensures that an AI uses just enough resources for maintenance of capabilities, then wakes to full power when truly needed. This smarter resource allocation makes AI deployments more scalable and environmentally friendly, without sacrificing performance. In summary, Somnium Mode helps AI work smarter, not harder – boosting efficiency much like regular sleep rejuvenates our minds and bodies for the next day. Calmer, More Human-Like Interaction: Incorporating a sleep cycle in AI fundamentally changes the human-machine relationship for the better. It moves us away from hyper-alert, always-listening gadgets toward a more calm computing paradigm. By having periods where the AI is dormant or in deep introspection, users aren’t bombarded with constant feedback or consumption – the technology gracefully retreats into the background when not actively serving a purpose. This rhythm can make living and working with AI feel more natural and less invasive. Just as we feel more at ease around other people when they respect downtime and personal space, an AI that “knows” when to be quiet can inspire greater user trust. Somnium Mode signals that the AI is taking time to recharge and reflect, not surveil or incessantly engage, which could alleviate concerns about digital burnout or privacy. Furthermore, the notion of AI with a circadian cycle could make interactions more emotionally resonant. For example, a user might intuitively understand that an assistant responding in the morning might have processed and “slept on” yesterday’s conversation, lending a bit of personality or empathy to the device’s behavior. On a design level, this feature supports calm design principles by having the AI augment our environment in a subtle way – active when needed, unobtrusive when idle, yet continuously improving in the background. Overall, it fosters a healthier dynamic where AI systems augment human life without demanding constant attention, instead empowering a more mindful and regenerative tech experience for users. Redefining Idle Time in AI Systems: Somnium Mode represents a shift in how we think about “idle” computing. Traditionally, idle time is wasted time or merely a passive low-power state. This feature reframes idle time as an opportunity for growth and optimization. An AI agent that can use downtime to self-maintain and evolve introduces a new paradigm in AI development and deployment. For developers and companies like Microsoft, this could differentiate AI platforms with a unique bio-inspired capability – a talking point that our AI doesn’t just pause when idle, it improves itself. It draws from interdisciplinary insights (neuroscience and sleep research) to make technology more resilient and adaptable. In practical terms, this means AI services could be more reliable (since they periodically clean up and update themselves) and even continuously customizable (since they might re-prioritize goals based on long-term user patterns observed in dreams). Such a self-regulating system could reduce the need for frequent manual model updates or retraining, as the AI is, in a sense, always learning in the background. By redefining idle mode as Somnium Mode, we imbue AI systems with a form of circadian rhythm – introducing balance between intense activity and reflective rest. This balance can inspire future innovations in ambient intelligence and device design, where machines harmonize with human routines (active when we’re active, resting when we rest). Ultimately, Somnium Mode matters because it opens a pathway to AI that is smarter, more efficient, and more attuned to human life. It transforms the inactive hours into a wellspring of progress, making the overall user experience calmer yet more continuously enriched. This dream-driven downtime is how tomorrow’s AI could get better while doing less, turning a simple idle into an ingenious reboot of intelligence.
