Skip to content

Instantly share code, notes, and snippets.

@taoyds

taoyds/fairseq_task_intro.py

Created March 20, 2020 12:31
Show Gist options
  • Save taoyds/27735b22aa4fa964d5d5060c7f5cf1f7 to your computer and use it in GitHub Desktop.
Save taoyds/27735b22aa4fa964d5d5060c7f5cf1f7 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
fairseq_task_intro.py
for epoch in range(num_epochs):
itr = task.get_batch_iterator(task.dataset('train'))
for num_updates, batch in enumerate(itr):
task.train_step(batch, model, criterion, optimizer)
average_and_clip_gradients()
optimizer.step()
lr_scheduler.step_update(num_updates)
lr_scheduler.step(epoch)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment