Table of Contents |
---|
The purpose of this Document document is to enumerate the APIs which are exposed by Akraino Blue print project to the external projects Akraino/Non Akraino for interaction/integration.
This document should be used in conjunction with the architecture document to understand APIs at at a modular level and their interactions.
...
ML Offloading APIs provides synchronization of ML inference service with UE side. It serves application developers and enable machine learning apps to offload computation intensive jobs from UE device to close by edge nodes. ML offloading services satisfie satisfy the requirement the ML computing resource requirement, meanwhile its responses faster than cloud ML services.
ML offlading offloading APIs offer ML inference services (support different ML frameworks) from KubeEdge sites through ML APIs, which contains a set of commonly used model pool. Machine Learning models in the pool have detail features published and performance has been tested. It has different categories to cover a wide variety of user use cases in ML domain. The ML API enables traditional app developer to leverage the fast response time of edge computing, and lower entry barriers of machine learning knowledge. Just use those ML offloading API in app, and stable new ML feature can be delivered to user devices from the nearest edge node. The KubeEdge ML offloading service has a Facial recognition demo api. Developer’s application can input face image to it via https request, and the edge ML offloading service identify the expression and return coorsponding facial code. It is a sample component of KubeEdge to address users' data security or latency concerns. With high scalability of model acceleration on demand. Mobile app developerd developers don't need to worry of on about the device resource limitation , and latency issues to the public cloud.
The ML offloading APIs is a set of intelligence services on edge cloud which offers various of AI services, and it can be triggered by mobile applications. For example, it can be used to determine if an image contains faces or translate text into different languages. Those APIs are available only if developers deploy it those KubeEdge. The ML offlading APIs can support different ML categories, including Vision, ASR, dialog engine and more in the future, ans serves as REST web service.
...