Package: parquetize 0.5.8

parquetize: Convert Files to Parquet Format

Collection of functions to get files in parquet format. Parquet is a columnar storage file format <https://parquet.apache.org/>. The files to convert can be of several formats ("csv", "RData", "rds", "RSQLite", "json", "ndjson", "SAS", "SPSS"...).

Authors:Damien Dotta [aut, cre], Nicolas Chuche [aut]

parquetize_0.5.8.tar.gz
parquetize_0.5.8.zip(r-4.7)parquetize_0.5.8.zip(r-4.6)parquetize_0.5.8.zip(r-4.5)
parquetize_0.5.8.tgz(r-4.6-any)parquetize_0.5.8.tgz(r-4.5-any)
parquetize_0.5.8.tar.gz(r-4.7-any)parquetize_0.5.8.tar.gz(r-4.6-any)
parquetize_0.5.8.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
DESCRIPTION |NEWS
card.svg |card.png
parquetize/json (API)

# Install 'parquetize' in R:

install.packages('parquetize', repos = c('https://ddotta.r-universe.dev', 'https://cloud.r-project.org'))

Bug tracker:https://github.com/ddotta/parquetize/issues

Pkgdown/docs site:https://ddotta.github.io

On CRAN:

conversion convert converter csv parquet sas spss sqlite stata

7.41 score 79 stars 65 scripts 505 downloads 17 exports 42 dependencies

Last updated from:ed08a773ff. Checks:9 OK. Indexed: yes.

Target	Result	Time
linux-devel-x86_64	OK	161
source / vignettes	OK	217
linux-release-x86_64	OK	149
macos-release-arm64	OK	190
macos-oldrel-arm64	OK	190
windows-devel	OK	134
windows-release	OK	126
windows-oldrel	OK	137
wasm-release	OK	125

Exports:check_parquet csv_to_parquet dbi_to_parquet download_extract expect_missing_argument expect_parquet fst_to_parquet get_parquet_info get_partitions json_to_parquet parquetize_example rbind_parquet rds_to_parquet sqlite_to_parquet table_to_parquet write_parquet_at_once write_parquet_by_chunk

Dependencies:arrow assertthat bit bit64 blob cachem cli clipr cpp11 crayon curl DBI dplyr fastmap forcats fst fstcore generics glue haven hms jsonlite lifecycle magrittr memoise pillar pkgconfig prettyunits progress purrr R6 Rcpp readr rlang RSQLite tibble tidyselect tzdb utf8 vctrs vroom withr

Convert huge input file to parquet

With table_to_parquet() | Spliting data by memory consumption | Splitting data by number of lines | Function rbind_parquet() | Alternatives to

Rendered fromaa-conversions.Rmdusingknitr::rmarkdown

Last update: 2024-05-17
Started: 2022-11-18

Citation

Development and contributors

Readme and manuals

Help Manual

Help page	Topics
Check if parquet file or dataset is readable and return basic informations	check_parquet
Convert a csv or a txt file to parquet format	csv_to_parquet
Convert a SQL Query on a DBI connection to parquet format	dbi_to_parquet
download and uncompress file if needed	download_extract
Convert a fst file to parquet format	fst_to_parquet
Get various info on parquet files	get_parquet_info
get unique values from table's column	get_partitions
Convert a json file to parquet format	json_to_parquet
Get path to parquetize example	parquetize_example
Function to bind multiple parquet files by row	rbind_parquet
Convert a rds file to parquet format	rds_to_parquet
Convert a sqlite file to parquet format	sqlite_to_parquet
Convert an input file to parquet format	table_to_parquet
write parquet file or dataset based on partition argument	write_parquet_at_once
read input by chunk on function and create dataset	write_parquet_by_chunk