Skip to content

Base

`base` ¶

`ArrowType = TypeVar('ArrowType')` `module-attribute` ¶

`P = ParamSpec('P')` `module-attribute` ¶

`R = TypeVar('R')` `module-attribute` ¶

`DEFAULT_BATCH_SIZE: Final[int] = 1048576` `module-attribute` ¶

`DEFAULT_FORMAT: Final[str] = 'arrow'` `module-attribute` ¶

`BaseExpression = PyArrowWrapper[ds.Expression]` `module-attribute` ¶

`BaseDataset = PyArrowWrapper[ds.Dataset]` `module-attribute` ¶

`PyArrowWrapper` ¶

Bases: Generic[ArrowType]

`init(wrapped: ArrowType) -> None` ¶

`to_pyarrow() -> ArrowType` ¶

`BaseDatasetLoader` ¶

Bases: Generic[P, R]