Loading ...

alibaba/aiconfigurator

Offline optimization of your disaggregated Dynamo graph(Fork for contributing. All changes intended for upstream PRs.)

0

1

0

Notes

Sign in to add notes for this repository

19690

Followers

0

Following

Alibaba Open Source

Branches

Releases

Commits

feat: optimize GEMM lookup with exact hit and 1D interpolation (#721) * feat: optimize GEMM lookup with exact hit and 1D interpolation Signed-off-by: Kimi Zhao <kimiz@nvidia.com> * fix: preserve le

feat: add prefill/decode per-pool GPU budget for heterogeneous disagg serving (#709) Signed-off-by: mandy-li <mandy.j.li@intel.com>

fix: vLLM 0.17.0 collector compat (DSA, MLA module, MoE) (#718) * feat: vLLM 0.17.0 collector v2 files with version routing Create version-specific collector files for vLLM >= 0.17.0, isolating fram

Issues