Home Delta 实现分析
Post
Cancel

Delta 实现分析

delta lake

API DeltaTable

DeltaTable(DeltaTableOperations)

executeDelete

executeUpdate

SQL DeltaSparkSessionExtension

DeltaDataSource

1
2
3
4
5
6
7
8
class DeltaDataSource
  extends RelationProvider
  with StreamSourceProvider
  with StreamSinkProvider
  with CreatableRelationProvider
  with DataSourceRegister
  with TableProvider
  with DeltaLogging {
  1. RelationProvider 批量读取
  2. CreatableRelationProvider 批量写入
  3. StreamSourceProvider stream source
  4. StreamSinkProvider stream sink
This post is licensed under CC BY 4.0 by the author.