coderplay
5/25/2012 - 4:35 PM
Dragon job submission flow path
Dragon job submission flow path
- check first vertex has specified input data path or not
- fetch a new application id from resource manager
- get secret keys and tokens from namenodes and store them into TokenCache
- copy local files/archives into remote filesystem (e.g. hdfs)
- write job config file to submit dir
- write job description file to submit dir
- get the security token of the jobSubmitDir and store in Credentials
- create submission context for the job
- create launch context for application master
- submit the application to resource manager
- get application report from resource manager