pw.io.sqlite
read(path, table_name, schema, *, autocommit_duration_ms=1500, name=None, max_backlog_size=None, debug_data=None)
sourceReads a table from a rowid table in SQLite database.
- Parameters
- path (
PathLike|str) – Path to the database file. - table_name (
str) – Name of the table in the database to be read. - schema (
type[Schema]) – Schema of the resulting table. - autocommit_duration_ms (
int|None) – The maximum time between two commits. Every autocommit_duration_ms milliseconds, the updates received by the connector are committed and pushed into Pathway’s computation graph. - name (
str|None) – A unique name for the connector. If provided, this name will be used in logs and monitoring dashboards. Additionally, if persistence is enabled, it will be used as the name for the snapshot that stores the connector’s progress. - max_backlog_size (
int|None) – Limit on the number of entries read from the input source and kept in processing at any moment. Reading pauses when the limit is reached and resumes as processing of some entries completes. Useful with large sources that emit an initial burst of data to avoid memory spikes.
- path (
- Returns
Table – The table read.