L. Golubchik

Partition-aware scheduling for mobile heterogeneous inference co-execution

This work defines the problem of partition-aware DAG scheduling for mobile heterogeneous inference, and proposes an online iterative search framework, which decomposes large DAGs into stages, focuses search on critical operators, and uses latency predictors to estimate partitioned execution without exhaustive profiling...