Alluxio

Alluxio accelerates data access at every stage of the AI lifecycle – from model training to deployment and inference cold starts to feature store queries – all without replacing your storage or changing your code. Alluxio customers achieve sub-millisecond time-to-first-byte (TTFB) latency and push more than a TB/sec of throughput accessing AI data stored in the cloud. Alluxio deploys as a lightweight, distributed cache between your AI compute workloads (training jobs, feature stores, inference servers) and wherever your AI data is persistently stored (e.g, cloud storage like S3, data lakes, HDFS, NFS, etc).