sinabs.reset_states...
 
Notifications
Clear all

sinabs.reset_states() vs buffer detach

2 Posts
3 Users
0 Likes
230 Views
0
Topic starter

The SINABS documentation makes it clear that during training we need to reset the states of the spiking neural network layers since they are stateful.

In the SINABS docs ( https://sinabs.readthedocs.io/en/v1.2.9/tutorials/nmnist.html) this is done via the sinabs.reset_states() method.

In the sinabs-dynapcnn documentation ( https://synsense.gitlab.io/sinabs-dynapcnn/getting_started/notebooks/nmnist_quick_start.html) the call to sinabs.reset_states() is missing, and instead a manual detach() is run on the buffer of the stateful layers.

Are these two methods equivalent?

1 Answer
0

Hi, Hovren. These two methods are not equivalent; 'reset' will set vmem to 0, but 'detach' won't.

Avatar hovren Topic starter 20/10/2023 7:52 pm

@clarence OK, can you please expand on why and how they are different? I understand why I need to reset the neurons vmem between trainig samples, but what is the use for detach? Do I need both? When should I use one or the other? Thanks!

Share:
Close
Back To