Installation
Install this package using pip like so:
pip install jaxonloader
Usage
It's quite similar to the PyTorch dataloader.
- Create a dataset which inherits from
jaxonloader.JaxonDataset
. - Implement all the abstract methods.
- Create a dataloader using
jaxonloader.JaxonDataLoader
. - Iterate over the dataloader.
- ???
- Profit!
Here's an example:
import pandas as pd
from jaxonloader import JaxonDataLoader, SingleArrayDataset
# Step 1
df = pd.read_csv('data.csv')
# Step 2
df['column'] = df['column'].apply(lambda x: x + 1)
# Step 3
jaxon_dataset = SingleArrayDataset(df.to_numpy())
# Step 4
jaxon_dataloader = JaxonDataLoader(
jaxon_dataset, batch_size=64, shuffle=True
)
# Step 5
for x in jaxon_dataloader:
pass
# Step 6
print('Profit!')