The government was forced to close down its Gateway site following the loss of a memory stick.