Downloads
Sarathi-Serve
November 2023
Sarathi-Serve (a research prototype) is a high throughput and low-latency LLM serving framework. This repository contains a benchmark suite for evaluating LLM performance from a systems point of view. It contains various workloads and scheduling policies that together can be…
VIDUR: LLM Simulator
November 2023
Vidur is a high-fidelity and extensible LLM inference simulator. It can help you with capacity planning and finding the best deployment configuration for your LLM deployments, test new research ideas like new scheduling algorithms, optimizations like speculative decoding, etc., and…
Verified Telemetry – Solution Sample
May 2021
Uses InfluxDB, Grafana and the Azure IoT Node.js SDK to communicate with Azure IoT Hub and showcase how the Verified Telemetry features can be utilized in real world scenarios.
Verified Telemetry – Device Sample
May 2021
Getting Started with Verified Telemetry, Azure RTOS and Azure IoT
Verified Telemetry
May 2021
Azure Verified Telemetry for IoT is a state-of-the-art solution to seamlessly determine the health of the sensor in real-time.
SDVBench
July 2017
This repository contains a subset of the internal tests used by Microsoft’s Static Driver Verifier tool. These tests are generated from Window’s Device Drivers while checking for one of the various properties that WDM drivers must satisfy. For more information, go to: https://github.com/boogie-org/sdvbench