Machine learning systems

Designing machine learning systems - Chip Huyen

2024: What's new with ML in production - Vicki Boykis

Hidden Technical Debt in Machine Learning Systems - NIPS-2015-hidden-technical-debt-in-machine-learning-systems-Paper.pdf

MLOps

MLOps guide

MLOps: Continuous delivery and automation pipelines in machine learning  |  Cloud Architecture Center  |  Google Cloud

The only reason I became interested in this domain is everything is analogous to message handling systems and eventing which I had a ton of experience. I can clearly say that AI systems are behind of the systems we designed in early 2000s. -Jaana Dogan, Google

Tools

Managing your machine learning infrastructure as code with Terraform

Bash One-Liners for LLMs

Infra

Overview — Ray 2.34.0

Distributed Computing in Pallas for TPUs — JAX documentation

Costs

Price Listing of Cloud Compute Resources - Spare Cores

Estimating required compute

Transformer FLOPs | Adam Casson

Distributed servers

Price Listing of Cloud Compute Resources - Spare Cores