.. _index: .. image:: Image/logo_s.jpg **A unified Data Analytics and AI platform for distributed TensorFlow, Keras and PyTorch on Apache Spark/Flink & Ray** What is Analytics Zoo? --------------------- Analytics Zoo seamless scales TensorFlow, Keras and PyTorch to distributed big data (using Spark, Flink & Ray). .. image:: Image/blockdiagram.jpg - **End-to-end pipeline for applying AI models (TensorFlow, PyTorch, OpenVINO, etc.) to distributed big data** * Write `TensorFlow `_ or `PyTorch `_ inline with Spark code for distributed training and inference. * Native deep learning (TensorFlow/Keras/PyTorch/BigDL) support in `Spark ML `_ Pipelines. * Directly run `Ray `_ programs on big data cluster through _RayOnSpark_. * Plain Java/Python APIs for (TensorFlow/PyTorch/BigDL/OpenVINO) `Model Inference `_. - **High-level ML workflow for automating machine learning tasks** * `Cluster Serving `_ for automatically distributed (TensorFlow/PyTorch/Caffe/OpenVINO) model inference . * Scalable `AutoML `_ for time series prediction. - **Built-in models for** `Recommendation `_, `Time Series `_, `Computer Vision `_ and `NLP `_ applications Why use Analytics Zoo? --------------------- You may want to develop your AI solutions using Analytics Zoo if: * You want to easily apply AI models (e.g., TensorFlow, Keras, PyTorch, BigDL, OpenVINO, etc.) to distributed big data. * You want to transparently scale your AI applications from a single laptop to large clusters with "zero" code changes. * You want to deploy your AI pipelines to existing YARN or K8S clusters *WITHOUT* any modifications to the clusters. * You want to automate the process of applying machine learning (such as feature engineering, hyperparameter tuning, model selection, distributed inference, etc.). How to use Analytics Zoo? --------------------- * Check out the `Getting Started page `_ for a quick overview of how to use Analytics Zoo. * Refer to the `Python `_, `Scala `_ and `Docker `_ guides to install Analytics Zoo. * Visit the `Document Website `_ (`mirror `_ in China) for more information on Analytics Zoo. * Check the `Powered By `_ & `Presentations `_ pages for real-world applications using Analytics Zoo. * Join the `Google Group `_ (or subscribe to the `Mail List `_ for more questions and discussions on Analytics Zoo. .. toctree:: :hidden: :maxdepth: -1 :caption: Overview overview.md .. toctree:: :hidden: :maxdepth: -1 :caption: Python API zoo.automl zoo.common zoo.feature zoo.models zoo.orca zoo.pipeline zoo.ray zoo.tfpark zoo.zouwu zoo.util