num_workers

num_workers is how many child processes to use to import data.Set to 0, that is, use the main process to import data.Note: This number must be greater than or equal to 0, negative numbers are estimated to be wrong

from torch.utils.data import DataLoadertrain_loader = DataLoader(dataset=train_data, batch_size=train_bs, shuffle=True, num_worker=4)valid_loader = DataLoader(dataset=valid_data, batch_size=valid_bs, num_worker=4)

num_workers affects training speed by affecting data loading speed

In the process of adjusting num_workers, I found that the training speed has not changed