PipelineAI

End-to-End ML and AI Platform for Real-time Spark and Tensorflow Data Pipelines

PipelineAI: The Standard Runtime for Every Prediction in the Enterprise PipelineAI’s primary focus is Continuous ML and AI Model Deploying, Optimizing and Scaling. Using a combination of open source and proprietary technologies, the PipelineAI service enables data scientists to rapidly train, test, optimize, deploy, and scale models in production directly from a Jupyter Notebook or command-line interface. We treat model optimizing and serving as a first-class citizen in the modern data pipeline - alongside model training. We give data scientists and engineers the freedom to quickly deploy, test, and rollback (if needed) their models directly in production. A concept we practiced heavily at Netflix, this freedom comes with responsibility. PipelineAI provides the tooling, infrastructure, and dashboards necessary to responsibily manage production directly - and with no downtime. We currently support models built with Spark, Tensorflow, Scikit-learn, XGBoost, and R. We are constantly tuning and optimizing our runtime to provide the best price per prediction available - even across multiple data centers and cloud vendors. Our hybrid-cloud “auto-shift” technology compliments the traditional, single-cloud “auto-scale” technology. PipelineAI opens up new ways to increase performance of your predictions, improve the uptime of your model serving infrastructure, and reduce cost per prediction. Media Highlights * Danny Bickson Blog (formerly GraphLab, acquired by Apple late last year): http://bickson.blogspot.com/2017/01/pipelineio-production-environment-to.html * Dylan Raithel from InfoQ (this is on the PANCAKE STACK Workshop that has been driving a lot of our POCs): https://www.infoq.com/articles/fregly-pancake-stack * Jeff Meyerson’s Software Engineering Daily Podcast (this is a much bigger deal than I thought - lots of global listeners, as well.) https://www.podcastchart.com/podcasts/software-engineering-daily-podcast/episodes/pancake-stack-data-engineering-with-chris-fregly