Visual Studio AI Toolkit : Building Phi-3 GenAI Applications
Port Forwarding, a valuable feature within the AI Toolkit, serves as a crucial gateway for seamless communication with the GenAI model. Whether it's through a straightforward API call or leveraging the SDKs, this functionality greatly enhances our ability to harness the power of the LLM/SLM. By enabling Port Forwarding, a plethora of new scenarios unfold, unlocking the full potential of our interactions with the model.
Running Phi-3-vision via ONNX on Jetson Platform
Unlock the potential of NVIDIA's Jetson platform by running the Phi-3-vision model in ONNX format. Dive into the seamless process of compiling onnxruntime-genai, setting up the environment, and executing high-performance inference tasks on low-power devices like Jetson Orin Nano. Discover how to utilize quantized models efficiently, enabling robust image and text dialogue tasks, all while keeping your GPU workload-optimized. Whether you’re working with FP16 or Int 4 models, this guide will walk you through each step, ensuring you harness the full capabilities of edge AI on Jetson.Mondays at Microsoft | Episode 26
Round out May 2024 with the goodness of community news and events. Your co-hosts, https://www.linkedin.com/in/karuanagatimu/ and https://www.linkedin.com/in/heathernewman/, present the next informative "Mondays at Microsoft" (episode 26). Join us LIVE at 8am PST on Monday, May 27th, 2024! Show notes & links to all that was shared: Microsoft Build. All announcements are located the Microsoft Book of News that is published for all of our events: https://news.microsoft.com/build-2024-book-of-news/ Power Platform news at #MSBuild: https://aka.ms/Build2024/PowerPlatform Introducing Team Copilot, the expansion of Copilot for Microsoft 365 from a behind-the-scenes, personal AI assistant to a new, valuable member of your team: https://aka.ms/AAqfbcx Microsoft Copilot Studio is introducing new agent capabilities, empowering developers to build copilots that can proactively respond to data and events, tailored to specific tasks and functions: https://build.microsoft.com/en-US/sessions/90aff741-26a6-490b-9793-f4747895d5c0 Copilot+ PCs are the fastest, most intelligent Windows PCs ever built. With powerful new silicon capable of an incredible 40+ TOPS (trillion operations per second), all–day battery life and access to the most advanced AI models, Copilot+ PCs will enable you to do things you can’t on any other PC: https://blogs.microsoft.com/blog/2024/05/20/introducing-copilot-pcs/ We are excited to add new models to the Phi-3 family of small, open models developed by Microsoft. We are introducing Phi-3-vision, a multimodal model that brings together language and vision capabilities. You can try Phi-3-vision today: https://aka.ms/try-phi3vision Excited to announce the launch the Community News Desk on the Microsoft Tech Community. This represents a unification of amazing work done across Microsoft to a greater audience, and more discoverable location on the MTC. This area on the MTC will host our blog, live events like Mondays at Microsoft and Meet the Makers engineering engagements and more: https://aka.ms/CommunityNewsDesk We are happy to launch this with the first drop of our https://aka.ms/M365ConSessions content on the newly renamed Community Learning channel on YouTube. https://aka.ms/M365ConSessions Microsoft and Khan Academy are announcing a multi-faceted partnership to turn the transformative potential of AI into reality: https://aka.ms/AAq4w15 To start, Microsoft is enabling Khan Academy to offer all K-12 U.S. educators' free access to Khanmigo for Teachers, an AI-powered teaching assistant that frees up teachers’ time so they can focus on what matters most – engaging with and supporting their students. A neurodiverse team has launched Mentra, a hiring platform that uses Microsoft AI to connect more than 44,000 registered users with fulfilling careers. The platform evaluates more than 75 data points entered by the jobseekers, including their skills, goals and accommodations: https://aka.ms/MentraAnnouncement Microsoft Places—available in public preview—is an AI-powered app that coordinates when you’re planning to come in and where you’ll work, enables improved connections with coworkers, and optimizes the effectiveness and engagement of the workplace: https://aka.ms/MicrosoftPlacesBlog AI flows, automation shifts from rules-based to AI-based automation that is adaptive and outcome-based. And with the new AI recorder, desktop flows are getting smarter and more intuitive too. Just show and tell—with your voice—and AI recorder will automate for you: https://www.microsoft.com/en-us/power-platform/blog/2024/05/21/new-ways-of-development-with-copilots-and-microsoft-power-platform/ To learn more about the Microsoft Global Community Initiative - a meeting place for all who are part of the Microsoft Community ecosystem, all are welcome: https://aka.ms/MGCI We launched a new page listing our newly minted regional directors. https://aka.ms/MGCIAdvisors -- As part of our Microsoft Global Community Initiative, we invite you to join us for our monthly General Meeting on the third Tuesday of the month - June 18. Sign Up to join us for our monthly meeting at https://aka.ms/MGCISignUp So many great events coming up and all available to check out on https://www.communitydays.org/ We also just launched a community calls page here so you can find community related called host by Microsoft and the community. FYI, learn more about what to expect at TechCon365 - Seattle | https://aka.ms/TechCon365/2024/Seattle/Guide Until next episode, have great times with your community, Karuana_Gatimu_MSFT and Heather Newman
