RuntimeError: Expected all tensors to be on the same device, but found at least two devices

Beginners
1

I want to use 4 GPUs for training. I load the model with device_map='auto'. I also prepare the model with accelerator.prepare_model(model, device_placement=True). What am I doing wrong?

1 Like