It's a good point.
There are certain kinds of hitting talent that take longer to stabilize to the true talent level. This means that players who possess these talents may be unfairly discriminated against when/if they struggle for short periods of time, depending on the stage of their career.
These are some commonly used "50% stabilization points" for offensive stats:
80 BIP: GB rate
80 BIP: FB rate
600 BIP: LD rate
820 BIP: BABIP
60 PA: Strikeout rate
120 PA: Walk rate
240 PA: HBP rate
290 PA: Single rate
1610 PA: XBH rate
170 PA: HR rate
910 AB: AVG
460 PA: OBP
320 AB: SLG
160 AB: ISO
So to illustrate... in 160 AB you might have a good idea that a certain player can hit for power (ISO) and make contact (K rate), causing a team to give them more leash. But if a player of equal or greater talent does not excel in those areas you might cut him because his skills take longer to give you confidence. Maybe he is an OBP guy... 460 PA. Or worse, a guy who has a knack for hitting Line Drives for AVG with a high BABIP.