I agree that often people choose to use the object versions unnecessary, but many operations (including relu) have functional versions: https://pytorch.org/docs/stable/generated/torch.nn.functiona...