There were a lot more ghosts than that. You probably forgot this part:

Scrooge followed to the window, desperate in his curiosity. He looked out.

The air was filled with phantoms, wandering hither and thither in restless haste, and moaning as they went.