Publication is a central means by which scholars establish their reputation. In consequence, how publications are vetted has significant impact on academic careers.
The Center for Studies in Higher Education at UC Berkeley has extensively surveyed the imperatives of scholarly publication in several disciplines. You could see a current overview at their web site.
Three of their reports from which to start are:
The CRA itself sponsored a “Best Practices Memo” on Evaluating Computer Scientists and Engineers For Promotion and Tenure, Computing Research News, Sep. 1999. A central point made in this report is that conference publication is both rigorous and prestigious in many sub-areas of Computer Science, and unlike most other disciplines.
Bibliometrics, including citation counts in particular, play a major role in assessing the reputation of a scholar. Some thoughtful pieces on the appropriate role for these are:
COMPUTING RESEARCH ASSOCIATION
1828 L STREET, NW SUITE 800, WASHINGTON, DC 20036
P: 202-234-2111 | F: 202-667-1066 | E: INFO @ CRA . ORG