We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent bdbf8c1 commit df1d264Copy full SHA for df1d264
1 file changed
docs/source/user-guide/data-sources.rst
@@ -158,7 +158,12 @@ as Delta Lake. This will require a recent version of
158
df = ctx.table("my_delta_table")
159
df.show()
160
161
-On older versions of ``deltalake`` (prior to 0.22) you can use the
+Any Python object that implements the
162
+``__arrow_c_stream__`` protocol can be registered with
163
+``register_dataset``. This includes scanners from libraries such as
164
+``nanoarrow``, ``Polars``, or ``DuckDB``.
165
+
166
+On older versions of ``deltalake`` (prior to 0.22) you can use the
167
`Arrow DataSet <https://arrow.apache.org/docs/python/generated/pyarrow.dataset.Dataset.html>`_
168
interface to import to DataFusion, but this does not support features such as filter push down
169
which can lead to a significant performance difference.
0 commit comments