When connected to live it should disconnect you upon launch and tell you there is a title update for it. After that you should be able to play. Please Note: They Discontinued Online Multiplayer For ALL original x-box titles. So for Halo 2 you can do campaign and local multiplayer only.
Also keep in mind that you can use X Link Kai or XBConnect to play Halo 2 multiplayer through system link.