The October 2024 update for the AI Toolkit in Visual Studio Code brings transformative enhancements tailored for AI developers, researchers, and enthusiasts. Packed with features like multi-model support, multi-modal capabilities, and full multi-platform compatibility, this release significantly boosts productivity and accessibility for AI development. Here’s a detailed look at the new features:
Multi-Model Support: Expanding Horizons
The AI Toolkit now integrates a broader array of popular generative AI models, allowing developers to mix and match to harness each model's unique strengths. Key inclusions:
- GitHub Models: With the GitHub Models is now available in public preview announcement, every GitHub developer now has access to top AI models in the GitHub playground as well as in the AI Toolkit.
- ONNX Optimized Models: Utilize lightweight, CPU or GPU-optimized models like the Phi family for efficient local performance.
- Anthropic Claude & Google Gemini: Integrate these powerful models seamlessly using your API keys.
- Ollama Models: For those who prefer accessing models locally, Ollama runtime support is now included.
- Custom Models: Bring your custom OpenAI-compatible models by specifying endpoints directly in the AI Toolkit playground.
Users can employ models individually or combine them within a single chat to maximize capabilities, such as using one model for coding and another for quality evaluation.
Enhanced Model Catalog
The updated Model Catalog now includes:
- Comprehensive Filters: Find the best model for your project quickly.
- Detailed Model Cards: Access in-depth information to assess model performance, requirements, and compatibility.
Multi-Modal Support: A Unified Workspace
With increasing demand for multi-modal AI models, the toolkit introduces attachment support in playground chats. This upgrade empowers developers to:
- Input and test text, images, and audio with compatible models.
- Create richer testing environments for multi-modal AI projects.
Multi-Platform Compatibility
Breaking platform barriers, the AI Toolkit is now fully functional on Windows, macOS, and Linux, ensuring accessibility for a diverse user base.
We would love your feedback!
The October 2024 update marks a significant step toward making AI development easier and more accessible in Visual Studio Code. This is just the beginning of an exciting journey, and we can’t wait to hear your feedback on these new capabilities. Try out the AI Toolkit for Visual Studio Code, share your thoughts, and file issues and suggest features on our GitHub repo. Stay tuned for more updates and innovations as we continue to expand and evolve this powerful toolkit. Thank you for being a part of this journey with us!
Microsoft
