You can download all student submissions for an assignment in bulk.
All submissions are downloaded as a single zip file, which you can then use to grade submissions offline on your computer.
If you allow more than one submission attempt, and a student resubmitted an assignment, the zip file will only contain the most recent submission. You can access the previous submission attempts via SpeedGrader.