1.sql 通过SqlParser 解析成 Unresolved Logical Plan; 2.analyzer 结合catalog 进行绑定,生成 Logical Plan; 3.optimizer 对 Logical Plan 优化,生成 Optimized LogicalPlan; 4.SparkPlan 将 Optimized LogicalPlan 转换成 Physical...
Analyzer结合 catalog 进行绑定,生成 Resolved Logical Plan,在其父类RuleExecutor中匹配相应规则 lazy val analyzed: LogicalPlan = { SparkSession.setActiveSession(sparkSession) sparkSession.sessionState.analyzer.execu...
Optimizer与一样,也是继承自RuleExecutor,匹配规则对SQL进行优化 lazy val withCachedData: LogicalPlan = { assertAnalyzed() assertSupported() sparkSession.sharedState.cacheManager.useCachedData(analyzed) } lazy ...
Spark SQL Planner
Spark SQL SqlParser
A new version of content is available.