Vendor-agnostic ML inference on production edge devices