Read csv in polar coordinates

Question content

polars.read_csv and polars.read_csv_batched and polars.scan_csv What's the difference?

polars.read_csv looks equivalent to pandas.read_csv since they have the same name.

Which one to use in which scenario and how are they similar/different from pandas.read_csv?

correct answer

• polars.read_csv_batched is very equivalent to pandas.read_csv(iterator=True)一个>.

• polars.scan_csv will not do anything until you do something like dask.dataframe.read_csv## on the dataframe # (lazy loading).

Scenes:

• When I use

  pandas.read_csv, my data is messy or the structure is complex, and the amount of data is not too large

• I use

  polars.read_csv when my data file is very large (> 10GB).

This is an answer based entirely on my (modest) opinion.

The above is the detailed content of Read csv in polar coordinates. For more information, please follow other related articles on the PHP Chinese website!