There are networks that can be “damaged” (in the sense of having neurons ripped out) and still function reasonably well.