If you want to get into advanced statistical metrics, I normally would recommend fangraphs.com, but it's not exactly user/noob friendly. Your best bet is to ask those questions here, although it's very likely you would get some biased responses here (this site heavily favors advanced metric baseball as opposed to fanboy/casual baseball)
If you want to get into general baseball info, then I suggest you visit the trifecta of sports websites
si.com/mlb
espn.com/mlb
foxsports.com/mlb
http://www.nbcsports.com/mlb is good too
In the front pages of these websites you will always see the typical day-to-day stuff, such as boxscores, but you will always see a lot of nice featurettes about the ins and outs and the whos who in baseball. I also strongly suggest you sign up on twitter and follow the esteemed reporters in the baseball reporting industry. Such notable individuals include Ken Rosenthal, Jon Morosi and Buster Olney. (BTW I do not suggest you sign up to those pay-wall sites, like ESPN insider)
Also I suggest bookmarking this subreddit as it has a lot of interesting tidbits from around baseball:
http://www.reddit.com/r/baseball/
edit: Oh and welcome to the community. Some people here are very passionate about their club which sometimes leads to quite negative interaction. Just suck it up and move on