참고 자료

Untitled

ML 모니터링 요구사항

ML 모니터링 솔루션별 지원 유무

func Neptune.ai Arize AI WhyLabs Grafana + Prometheus Evidently Qualdo Fiddler Amazon SageMaker Seldon Core Censius
Model performance in production No Yes Yes Limited Yes Yes Yes Yes Yes Yes
Model input/output distribution No Yes Yes Limited Yes Yes Yes Yes Yes Yes
Model training and re-training Yes Limited Limited No No No No Yes No No
Model evaluation and testing Yes Limited Limited No No No No Yes No No
Hardware metrics Yes No No Yes No No No No No No
CI/CD pipelines for ML Yes No No No No No No Yes No No