Column major dataset abstraction for efficiently manipulating in memory datasets.

Conversions of categorical values into numbers and back. Two forms of conversions are supported, a straight value->integer map and one-hot encoding.

Optional namespace that copies a dataset to the clipboard for pasting into applications such as excel or google sheets.

Queries to select column subsets that have various properites such as all numeric columns, all feature columns, or columns that have a specific datatype.

CSV parsing based on charred.api/read-csv.

Helpful and well tested string->datetime pathways.

Parsing functions based on raw data that is represented by a sequence of string arrays.

Bindings to univocity. Transforms csv's, tsv's into sequences of string arrays that are then passed into tech.v3.dataset.io.string-row-parser methods.

implementation of join algorithms, both exact (hash-join) and near.

Various mathematic transformations of datasets such as (inefficiently) building simple tables, pca, and normalizing columns to have mean of 0 and variance of 1. More in-depth transformations are found at tech.v3.dataset.neanderthal.

This is an auto-generated api system - it scans the namespaces and changes the first to be metamorph-compliant which means transforming an argument that is just a dataset into an argument that is a metamorph context - a map of {:metamorph/data ds}. They also return their result as a metamorph context.

Methods related specifically to machine learning such as setting the inference target. This file integrates tightly with tech.v3.dataset.categorical which provides categorical -> number and one-hot transformation pathways.

Specific high performance reductions intended to be performend over a sequence of datasets. This allows aggregations to be done in situations where the dataset is larger than what will fit in memory on a normal machine. Due to this fact, summation is implemented using Kahan algorithm and various statistical methods are done in using statistical estimation techniques and thus are prefixed with prob- which is short for probabilistic.

Reduction reducers based on the apache data sketch family of algorithms.

Implement a generalized rolling window including support for time-based variable width windows.

Extensions to datasets to do per-row bag-semantics set/union and intersection.

Conversion mechanisms from dataset to tensor and back.

Load zip data. Zip files with a single file entry can be loaded with ->dataset. When a zip file has multiple entries you have to call zipfile->dataset-seq.

Support for reading/writing apache arrow datasets. Datasets may be memory mapped but default to being read via an input stream.

Transit bindings for the jvm version of tech.v3.dataset.

Parse a dataset in xlsx format. This namespace auto-registers a handler for the 'xlsx' file type so that when using ->dataset, xlsx will automatically map to (first (workbook->datasets)).

Use a google guava cache to memoize function results. Function must not return nil values. Exceptions propagate to caller.

Support for reading Parquet files. You must require this namespace to enable parquet read/write support.

Parse a dataset in xls or xlsx format. This namespace auto-registers a handler for the xls file type so that when using ->dataset, xls will automatically map to (first (workbook->datasets)).

Bindings to the smile DataFrame system.

Bindings to make working with tribuo more straight forward when using datasets.