I did go some years ago and it is the most beautiful place I have ever been. We flew to Cochin and then Agatti it is then a boat trip and you did need visas.
We booked it as part of a package but I think you would be able to book direct with alot of hassal...personally I think it is worth it.
You could book it direct through Casino hotel group who also own spice village