Tonic provides publicly available event-based vision and audio datasets and event transformations. The package is fully compatible with PyTorch Vision/Audio, giving you the flexibility you need.
Tonic caters to both the event-based world that works directly with events or time surfaces and to more conventional frameworks that might convert events into dense representations in one way or another.