Voxels are unstable enough. Animation with voxels is quite different from animating a mesh too. Think of it as the old monitors and TVs which had analog input. This meant that whenever something updated, you have to draw the whole picture again. So, it means that individual voxels are moving and not the mesh itself. On the good side, we get pretty much perfect pixely look. However, I've heard voxels also are quite resource demanding, meaning that even more optimisation would be required and that is quite the problem with the current engine I've been working with.
Personally, I'd say no.