Howards Sports occupied a rather unusual building on Lady & Assembly Streets. It's unusual in that it has a frontage on both streets, but is not a corner building, but instead wraps around behind Moe Levy's (which is the corner building) and Reliable Loan Office. As far as I can tell, Howard's identified itself only with the Lady Street address, but the Loopnet listing specified both addresses.
It's definitely an interesting building even aside from the shape, brick with three levels, murals on the north side and a corner stair-case. I'm saying 2005 for the closing date, as the business license in the window was for 2004. Interestingly though, there is a 2010 license pasted below that, and the Loopnet listing above claims the building is now off the market, though it was still plastered with "For Sale" signs when I took these shots on 14 Feb 2010 and 10 April 2010.
(I see references to the name both with and without an apostrophe -- I'm going by the signs in the window and leaving it out).
UPDATE 7 Feb 2013: See the interesting note in the comments as to the history of this building. And also note that Howards Sports is still there (though looking to move) and does custom printing of sports apparel now.