Introducing Modzy v1.10: Your Gateway to Faster AI and Edge Deployments
Learn about the newest features made available with the release of Modzy v1.10.
We are thrilled to announce the release of Modzy v1.10, packed with performance improvements and an enhanced edge deployment experience. In this release, we’re bringing you faster model boot times, lower model latency, and superior overall performance. But that's not all – we're also introducing official support for single-node installations, making edge deployments a breeze. To top it all off, we've fine-tuned Modzy Core to ensure that deploying, maintaining, and operating models at the edge is now easier and more reliable than ever before. Plus, we've addressed various bug fixes for a seamless user experience. Let's dive into the highlights.
- Faster Model Boot Times and Lower Model Latency: Models now boot up from a cold start and return inference results in less than 30 seconds, a significant improvement that becomes especially apparent when models are operating in serverless mode, also known as "scale to zero." In this mode, models consume no resources except when there are inference requests, making it a game-changer for batch processing.
- Faster Performance Across All Services: Our new API gateway introduces superior performance across the entire Modzy platform. You'll notice significant performance improvements, regardless of whether you’re using the user interface or accessing Modzy through the API. This ensures that your AI models run more efficiently and provide quicker results.
- Single-Node Installation: Modzy now officially supports installing the platform on a single node, and our installer equips you with all the necessary dependencies to set up a Modzy instance swiftly and effortlessly. While not intended for scaled production, this feature is invaluable for edge-focused deployments or small R&D projects. Check out the full installation guide here.
- Improved Edge Operations: We've made deploying, maintaining, and operating models at the edge easier and more reliable than ever before. Our latest improvements to Modzy Core enhance the overall experience for edge deployments. To learn more, explore our Upgrade Modzy Core guide to upgrade your edge installations.
- Bug Fixes: We've also addressed various bugs and issues to ensure a smoother and more robust user experience.
The enhancements available in the v1.10 release will take your AI deployments to the next level, making Modzy more powerful, efficient, and user-friendly than ever before. Full details related to the features available with v1.10 can be found in the release notes here. Don't wait – explore Modzy v1.10 today and experience the future of AI deployment. If you have any questions or need assistance, our support team is always here to help.