Is it Fine to Use a CSS Reset?

Yes, yes, yes absolutely use a CSS Reset if you plan to develop for cross-browser compatibility.

Also, Yahoo YUI reset in another excellent choice.